2024-09-15T23:11:38.826 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T23:11:38.851 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:11:38.947 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906315' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 1 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 8921c8ef947807b717db041d85f0761b7914d5fc subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: dry_run: true install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVM72jr+BSJ38eONLLHjvav2TADn0ZIpiXdL7y4hjLz6+hcj9QwAd2ZbFyuLLgLPz1UzBNXKxZZ1bkezdIYDMs= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdgXI4/m985zKqyVUQM8vxRvvgXRkpWXZtxcZOJXBskObs/Qg0cLQystZzNXiIsZv1q+i2HbgJi1VhC8pXoi8I= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO75dwD5rw4+Zj9T0daf6OZR+QqHrLDGJdg50jmE4aJK+IjfwDlx4OojRYGT32ZHRlGZSvcuk1HWyGXeY4nAxIU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T23:11:38.947 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T23:11:38.948 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T23:11:38.948 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T23:11:38.949 INFO:teuthology.task.internal:Checking packages... 2024-09-15T23:11:38.971 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T23:11:38.971 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T23:11:38.971 INFO:teuthology.packaging:ref: None 2024-09-15T23:11:38.971 INFO:teuthology.packaging:tag: None 2024-09-15T23:11:38.971 INFO:teuthology.packaging:branch: squid 2024-09-15T23:11:38.971 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:11:38.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-15T23:11:39.170 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-328.gad35db06 2024-09-15T23:11:39.172 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T23:11:39.179 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T23:11:39.179 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T23:11:39.269 INFO:teuthology.task.internal:Saving configuration 2024-09-15T23:11:39.288 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T23:11:39.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T23:11:39.383 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:06:25.640518', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVM72jr+BSJ38eONLLHjvav2TADn0ZIpiXdL7y4hjLz6+hcj9QwAd2ZbFyuLLgLPz1UzBNXKxZZ1bkezdIYDMs='} 2024-09-15T23:11:39.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:06:25.639041', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAdgXI4/m985zKqyVUQM8vxRvvgXRkpWXZtxcZOJXBskObs/Qg0cLQystZzNXiIsZv1q+i2HbgJi1VhC8pXoi8I='} 2024-09-15T23:11:39.430 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 23:06:25.641723', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO75dwD5rw4+Zj9T0daf6OZR+QqHrLDGJdg50jmE4aJK+IjfwDlx4OojRYGT32ZHRlGZSvcuk1HWyGXeY4nAxIU='} 2024-09-15T23:11:39.430 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T23:11:39.445 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-15T23:11:39.445 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-15T23:11:39.445 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-15T23:11:39.445 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T23:11:39.577 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8c9f9cfbe0>, signals=[15]) 2024-09-15T23:11:39.577 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T23:11:39.585 INFO:teuthology.task.internal:Opening connections... 2024-09-15T23:11:39.585 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:11:39.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:11:39.666 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-15T23:11:39.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:11:39.745 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-15T23:11:39.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:11:39.824 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T23:11:39.831 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-15T23:11:39.850 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-15T23:11:39.851 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-15T23:11:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-15T23:11:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-15T23:11:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-15T23:11:39.908 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:11:39.909 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:11:39.910 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-15T23:11:39.932 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-15T23:11:39.951 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-15T23:11:39.951 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-15T23:11:40.009 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:11:40.010 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:11:40.011 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:11:40.011 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-15T23:11:40.033 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-15T23:11:40.051 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-15T23:11:40.051 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-15T23:11:40.110 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-15T23:11:40.111 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-09-15T23:11:40.112 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-15T23:11:40.112 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-15T23:11:40.112 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-15T23:11:40.112 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-15T23:11:40.133 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T23:11:40.142 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T23:11:40.244 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T23:11:40.245 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:11:40.247 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:11:40.250 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-15T23:11:40.267 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T23:11:40.276 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T23:11:40.276 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:11:40.305 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:11:40.308 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-15T23:11:40.411 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T23:11:40.485 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T23:11:40.501 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T23:11:40.501 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-15T23:11:40.501 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-15T23:11:40.501 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:11:40.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:11:40.518 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-15T23:11:40.576 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-503.el9.x86_64 2024-09-15T23:11:40.576 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-503.el9.x86_64 2024-09-15T23:11:40.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-09-15T23:11:43.787 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.2 MB 00:01 2024-09-15T23:11:46.030 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 18 MB/s | 20 MB 00:01 2024-09-15T23:11:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-15T23:11:51.906 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-15T23:11:52.861 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-15T23:11:58.325 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 46 kB/s | 1.7 kB 00:00 2024-09-15T23:12:00.398 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-15T23:12:00.398 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-15T23:12:00.492 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-15T23:12:00.502 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 79 M 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 126 M 2024-09-15T23:12:00.503 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T23:12:00.626 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 294 kB/s | 23 kB 00:00 2024-09-15T23:12:01.202 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-09-15T23:12:01.718 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-15T23:12:02.086 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 20 MB/s | 29 MB 00:01 2024-09-15T23:12:02.086 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:12:02.086 INFO:teuthology.orchestra.run.smithi077.stdout:Total 50 MB/s | 79 MB 00:01 2024-09-15T23:12:02.763 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T23:12:03.119 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T23:12:03.119 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T23:12:04.095 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T23:12:04.095 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T23:12:06.570 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T23:12:07.213 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:12:07.287 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:12:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:12:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:12:15.142 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:12:15.225 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:20.074 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:58.319 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:58.360 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:58.754 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:58.754 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-15T23:12:58.754 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-15T23:12:58.754 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:12:59.605 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T23:12:59.912 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:12:59.996 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:12:59.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:12:59.996 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-15T23:12:59.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-15T23:12:59.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-15T23:12:59.996 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-15T23:12:59.997 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-09-15T23:12:59.997 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-15T23:13:00.055 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-15T23:13:00.055 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-15T23:13:00.055 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-09-15T23:13:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-09-15T23:13:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-09-15T23:13:00.087 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 82.el9 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8274670 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-09-15T23:13:00.088 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:13:00.089 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-09-15T23:13:00.090 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-15T23:13:00.090 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-505.el9.x86_64 2024-09-15T23:13:00.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-15T23:13:00.671 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-15T23:13:02.042 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-15T23:13:02.059 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-15T23:13:02.062 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-15T23:13:02.077 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.6zlg4JPsyc 2024-09-15T23:13:02.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6zlg4JPsyc 2024-09-15T23:13:02.149 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.6zlg4JPsyc 2024-09-15T23:13:02.301 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.6zlg4JPsyc is 6KB 2024-09-15T23:13:02.349 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.6zlg4JPsyc 2024-09-15T23:13:02.364 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-09-15T23:13:02.427 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-15T23:13:02.427 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-15T23:13:02.427 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-15T23:13:02.427 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-15T23:13:02.428 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-15T23:13:02.575 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-09-15T23:13:32.578 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T23:13:32.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:13:32.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:14:07.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-15T23:14:16.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:14:16.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:14:34.433 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-15T23:14:46.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:14:46.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:14:46.795 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-15T23:14:47.194 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:14:47.194 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-505.el9.x86_64"... 2024-09-15T23:14:47.194 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-15T23:14:47.209 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-505.el9.x86_64 2024-09-15T23:14:47.209 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-15T23:14:47.210 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T23:14:47.210 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-15T23:14:48.211 DEBUG:teuthology.parallel:result is None 2024-09-15T23:14:48.211 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T23:14:48.218 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T23:14:48.219 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:14:48.221 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:14:48.224 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T23:14:48.243 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T23:14:48.253 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T23:14:48.287 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T23:14:48.288 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:14:48.290 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:14:48.292 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T23:14:48.355 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T23:14:48.365 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T23:14:48.365 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:14:48.382 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:48.382 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T23:14:48.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:48.400 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:14:48.402 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:14:48.425 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T23:14:48.495 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.505 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.510 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.512 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.525 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.539 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T23:14:48.541 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T23:14:48.553 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T23:14:48.553 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:14:48.555 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:14:48.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T23:14:48.585 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T23:14:48.598 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T23:14:48.598 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:14:48.618 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:14:48.626 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T23:14:48.642 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:48.714 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:48.759 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:48.837 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:48.874 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:14:48.875 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:14:48.944 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:48.986 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:49.039 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:49.124 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:49.165 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:14:49.165 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:14:49.232 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:49.278 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T23:14:49.334 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:49.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T23:14:49.459 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:14:49.460 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T23:14:49.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-15T23:14:49.528 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-15T23:14:49.531 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-15T23:14:49.567 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:14:49.589 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:14:49.609 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:14:50.005 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T23:14:50.013 INFO:teuthology.task.internal:Starting timer... 2024-09-15T23:14:50.013 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T23:14:50.057 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T23:14:50.089 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-15T23:14:50.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-15T23:14:50.144 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-15T23:14:50.146 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-09-15T23:14:50.214 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-09-15T23:14:50.216 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-09-15T23:14:50.276 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-09-15T23:14:50.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T23:14:50.278 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-15T23:14:50.311 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-15T23:14:50.311 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-09-15T23:14:50.336 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-09-15T23:14:50.337 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-09-15T23:14:50.362 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-09-15T23:14:50.362 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi077.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi159.front.sepia.ceph.com': 'permissive'} 2024-09-15T23:14:50.362 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:14:50.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:50.387 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:14:50.415 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:50.415 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:14:50.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:14:50.443 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T23:14:50.443 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:14:50.474 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:14:50.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-09-15T23:14:50.543 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T23:14:50.553 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T23:14:50.564 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T23:14:50.577 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi077.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T23:18:51.190 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi077.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-09-15T23:18:51.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:18:51.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:18:51.273 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-15T23:18:51.363 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-15T23:18:51.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-15T23:18:51.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:18:51.443 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-15T23:18:51.487 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-15T23:18:51.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-15T23:18:51.488 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T23:18:51.572 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-15T23:18:51.660 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-15T23:18:51.661 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T23:18:51.673 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T23:18:51.673 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:18:51.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:18:51.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:18:51.676 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:18:51.678 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T23:18:51.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:18:51.706 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:18:51.707 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:18:51.721 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:18:51.723 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:18:51.728 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-15T23:18:51.743 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-15T23:18:51.746 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-09-15T23:18:51.749 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-15T23:18:51.757 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-09-15T23:18:51.762 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-15T23:18:51.767 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-09-15T23:18:51.771 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:18:51.777 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:18:51.778 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-09-15T23:18:51.785 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:18:51.793 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:18:51.793 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-15T23:18:51.807 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-15T23:18:51.843 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.847 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.849 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.854 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.874 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.878 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:18:51.879 INFO:teuthology.run_tasks:Running task install... 2024-09-15T23:18:51.888 DEBUG:teuthology.task.install:project ceph 2024-09-15T23:18:51.888 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T23:18:51.888 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T23:18:51.888 INFO:teuthology.task.install:Using flavor: default 2024-09-15T23:18:51.894 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T23:18:51.894 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T23:18:51.894 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:18:51.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:18:51.897 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:18:51.897 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:18:51.898 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'tag': None, 'wait_for_package': False} 2024-09-15T23:18:51.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:18:52.058 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:18:52.058 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:18:52.062 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:18:52.062 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:18:52.069 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/ 2024-09-15T23:18:52.069 INFO:teuthology.task.install.rpm:Package version is 19.1.1-326.g8921c8ef 2024-09-15T23:18:52.170 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:18:52.170 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:18:52.170 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:18:52.175 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:18:52.175 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:18:52.176 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:18:52.180 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-15T23:18:52.180 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:18:52.180 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-15T23:18:52.196 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:18:52.197 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:18:52.201 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:18:52.201 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:18:52.210 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-15T23:18:52.210 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8921c8ef947807b717db041d85f0761b7914d5fc/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-15T23:18:52.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:18:52.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:18:52.276 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-15T23:18:52.338 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:18:52.343 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:18:52.351 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-15T23:18:52.402 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-15T23:18:52.403 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-15T23:18:52.407 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-09-15T23:18:52.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-09-15T23:18:52.415 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-09-15T23:18:52.417 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-09-15T23:18:52.630 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-15T23:18:52.633 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-09-15T23:18:52.641 INFO:teuthology.orchestra.run.smithi155.stdout:45 files removed 2024-09-15T23:18:52.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:18:52.659 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:18:52.668 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-15T23:18:53.203 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 313 kB/s | 83 kB 00:00 2024-09-15T23:18:53.217 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 310 kB/s | 83 kB 00:00 2024-09-15T23:18:53.222 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 297 kB/s | 83 kB 00:00 2024-09-15T23:18:53.487 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T23:18:53.506 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-15T23:18:53.535 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 43 kB/s | 12 kB 00:00 2024-09-15T23:18:53.763 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T23:18:53.782 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T23:18:53.810 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-15T23:18:54.532 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-09-15T23:18:54.588 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-09-15T23:18:55.152 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 6.3 MB/s | 8.2 MB 00:01 2024-09-15T23:18:57.145 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-09-15T23:18:57.749 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 20 MB 00:02 2024-09-15T23:18:58.698 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 6.8 MB/s | 20 MB 00:03 2024-09-15T23:19:01.934 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-15T23:19:02.629 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-15T23:19:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-15T23:19:04.176 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 18 kB/s | 19 kB 00:01 2024-09-15T23:19:04.525 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-15T23:19:04.822 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-15T23:19:05.449 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-15T23:19:05.720 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-15T23:19:05.967 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-15T23:19:10.855 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-15T23:19:11.332 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-15T23:19:11.343 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-15T23:19:13.157 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.158 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.169 INFO:teuthology.orchestra.run.smithi077.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:19:13.170 INFO:teuthology.orchestra.run.smithi077.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.171 INFO:teuthology.orchestra.run.smithi077.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:19:13.172 INFO:teuthology.orchestra.run.smithi077.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.174 INFO:teuthology.orchestra.run.smithi077.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:19:13.176 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.177 INFO:teuthology.orchestra.run.smithi077.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.239 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:19:13.249 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:19:13.250 INFO:teuthology.orchestra.run.smithi077.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:19:13.251 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:19:13.252 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:19:13.253 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:19:13.254 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:19:13.255 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:19:13.256 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:19:13.257 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:19:13.258 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:19:13.259 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:19:13.260 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:19:13.261 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================== 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout:Install 148 Packages 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 8 Packages 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 226 M 2024-09-15T23:19:13.262 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-15T23:19:13.578 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.579 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.592 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:19:13.593 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.594 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:19:13.595 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.597 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:19:13.600 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.601 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.665 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:19:13.675 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:19:13.676 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:19:13.677 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:19:13.678 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:19:13.679 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:19:13.681 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:19:13.682 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:19:13.683 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:19:13.684 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:19:13.685 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:19:13.686 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:19:13.687 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:19:13.688 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:19:13.689 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-15T23:19:13.689 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-15T23:19:13.689 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-09-15T23:19:13.689 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 8 Packages 2024-09-15T23:19:13.689 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:19:13.690 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.690 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.690 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 226 M 2024-09-15T23:19:13.690 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-15T23:19:13.694 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-15T23:19:13.695 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-15T23:19:13.695 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-15T23:19:13.696 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.698 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-15T23:19:13.701 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.702 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-15T23:19:13.765 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-09-15T23:19:13.781 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-15T23:19:13.781 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 6.5 k 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.4 M 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 896 k 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 145 k 2024-09-15T23:19:13.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 1.5 M 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 146 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 3.6 M 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 7.4 M 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 49 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 11 M 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 49 M 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 285 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 765 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 228 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 27 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 18 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-15T23:19:13.783 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 32 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 751 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 127 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 161 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 320 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 300 k 2024-09-15T23:19:13.784 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 99 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 85 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.1 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 170 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.4 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 3.2 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-15T23:19:13.785 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 21 M 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 32 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 2.4 M 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 249 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 4.7 M 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 17 M 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.1.1-326.g8921c8ef.el9 ceph-noarch 16 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 25 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-15T23:19:13.786 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 163 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-15T23:19:13.787 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 506 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 5.3 M 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-15T23:19:13.788 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 45 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.1.1-326.g8921c8ef.el9 ceph 136 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-15T23:19:13.789 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-15T23:19:13.790 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-15T23:19:13.791 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-15T23:19:13.792 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-15T23:19:13.793 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:19:13.794 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-09-15T23:19:13.795 INFO:teuthology.orchestra.run.smithi159.stdout:====================================================================================== 2024-09-15T23:19:13.795 INFO:teuthology.orchestra.run.smithi159.stdout:Install 148 Packages 2024-09-15T23:19:13.795 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 8 Packages 2024-09-15T23:19:13.795 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:19:13.796 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 226 M 2024-09-15T23:19:13.796 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-09-15T23:19:14.075 INFO:teuthology.orchestra.run.smithi155.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 42 kB/s | 6.5 kB 00:00 2024-09-15T23:19:14.140 INFO:teuthology.orchestra.run.smithi077.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 57 kB/s | 6.5 kB 00:00 2024-09-15T23:19:14.309 INFO:teuthology.orchestra.run.smithi155.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 3.8 MB/s | 896 kB 00:00 2024-09-15T23:19:14.401 INFO:teuthology.orchestra.run.smithi155.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 1.6 MB/s | 145 kB 00:00 2024-09-15T23:19:14.484 INFO:teuthology.orchestra.run.smithi155.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 9.6 MB/s | 5.4 MB 00:00 2024-09-15T23:19:14.610 INFO:teuthology.orchestra.run.smithi155.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-15T23:19:14.632 INFO:teuthology.orchestra.run.smithi077.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.8 MB/s | 896 kB 00:00 2024-09-15T23:19:14.777 INFO:teuthology.orchestra.run.smithi155.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 6.4 MB/s | 2.4 MB 00:00 2024-09-15T23:19:14.807 INFO:teuthology.orchestra.run.smithi077.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 830 kB/s | 145 kB 00:00 2024-09-15T23:19:14.885 INFO:teuthology.orchestra.run.smithi155.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-15T23:19:14.919 INFO:teuthology.orchestra.run.smithi159.stdout:(1/156): ceph-19.1.1-326.g8921c8ef.el9.x86_64.r 22 kB/s | 6.5 kB 00:00 2024-09-15T23:19:15.144 INFO:teuthology.orchestra.run.smithi155.stdout:(8/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 17 MB/s | 21 MB 00:01 2024-09-15T23:19:15.202 INFO:teuthology.orchestra.run.smithi155.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 433 kB/s | 25 kB 00:00 2024-09-15T23:19:15.257 INFO:teuthology.orchestra.run.smithi077.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 4.4 MB/s | 5.4 MB 00:01 2024-09-15T23:19:15.519 INFO:teuthology.orchestra.run.smithi155.stdout:(10/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 17 MB/s | 11 MB 00:00 2024-09-15T23:19:15.561 INFO:teuthology.orchestra.run.smithi159.stdout:(2/156): ceph-fuse-19.1.1-326.g8921c8ef.el9.x86 1.4 MB/s | 896 kB 00:00 2024-09-15T23:19:15.566 INFO:teuthology.orchestra.run.smithi077.stdout:(5/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 3.1 MB/s | 2.4 MB 00:00 2024-09-15T23:19:15.620 INFO:teuthology.orchestra.run.smithi155.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 2.2 MB/s | 228 kB 00:00 2024-09-15T23:19:15.712 INFO:teuthology.orchestra.run.smithi155.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 295 kB/s | 27 kB 00:00 2024-09-15T23:19:15.720 INFO:teuthology.orchestra.run.smithi159.stdout:(3/156): ceph-immutable-object-cache-19.1.1-326 917 kB/s | 145 kB 00:00 2024-09-15T23:19:15.766 INFO:teuthology.orchestra.run.smithi077.stdout:(6/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 3.0 MB/s | 1.5 MB 00:00 2024-09-15T23:19:15.795 INFO:teuthology.orchestra.run.smithi155.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 381 kB/s | 32 kB 00:00 2024-09-15T23:19:15.904 INFO:teuthology.orchestra.run.smithi155.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 6.8 MB/s | 751 kB 00:00 2024-09-15T23:19:16.121 INFO:teuthology.orchestra.run.smithi155.stdout:(15/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 13 MB/s | 17 MB 00:01 2024-09-15T23:19:16.146 INFO:teuthology.orchestra.run.smithi155.stdout:(16/156): libcephsqlite-19.1.1-326.g8921c8ef.el 675 kB/s | 163 kB 00:00 2024-09-15T23:19:16.171 INFO:teuthology.orchestra.run.smithi155.stdout:(17/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:19:16.213 INFO:teuthology.orchestra.run.smithi155.stdout:(18/156): libradosstriper1-19.1.1-326.g8921c8ef 7.4 MB/s | 506 kB 00:00 2024-09-15T23:19:16.305 INFO:teuthology.orchestra.run.smithi155.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 492 kB/s | 45 kB 00:00 2024-09-15T23:19:16.398 INFO:teuthology.orchestra.run.smithi155.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 1.4 MB/s | 136 kB 00:00 2024-09-15T23:19:16.506 INFO:teuthology.orchestra.run.smithi155.stdout:(21/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 16 MB/s | 5.3 MB 00:00 2024-09-15T23:19:16.555 INFO:teuthology.orchestra.run.smithi155.stdout:(22/156): python3-cephfs-19.1.1-326.g8921c8ef.e 1.0 MB/s | 161 kB 00:00 2024-09-15T23:19:16.584 INFO:teuthology.orchestra.run.smithi155.stdout:(23/156): python3-rados-19.1.1-326.g8921c8ef.el 4.2 MB/s | 320 kB 00:00 2024-09-15T23:19:16.595 INFO:teuthology.orchestra.run.smithi159.stdout:(4/156): ceph-base-19.1.1-326.g8921c8ef.el9.x86 2.7 MB/s | 5.4 MB 00:01 2024-09-15T23:19:16.624 INFO:teuthology.orchestra.run.smithi155.stdout:(24/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.3 MB/s | 300 kB 00:00 2024-09-15T23:19:16.649 INFO:teuthology.orchestra.run.smithi155.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 1.4 MB/s | 99 kB 00:00 2024-09-15T23:19:16.691 INFO:teuthology.orchestra.run.smithi155.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-15T23:19:16.792 INFO:teuthology.orchestra.run.smithi155.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.7 MB/s | 170 kB 00:00 2024-09-15T23:19:16.858 INFO:teuthology.orchestra.run.smithi155.stdout:(28/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-15T23:19:16.879 INFO:teuthology.orchestra.run.smithi155.stdout:(29/156): ceph-grafana-dashboards-19.1.1-326.g8 363 kB/s | 32 kB 00:00 2024-09-15T23:19:16.887 INFO:teuthology.orchestra.run.smithi159.stdout:(5/156): ceph-mgr-19.1.1-326.g8921c8ef.el9.x86_ 5.2 MB/s | 1.5 MB 00:00 2024-09-15T23:19:16.921 INFO:teuthology.orchestra.run.smithi155.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 2.3 MB/s | 146 kB 00:00 2024-09-15T23:19:16.941 INFO:teuthology.orchestra.run.smithi077.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 3.4 MB/s | 4.7 MB 00:01 2024-09-15T23:19:17.263 INFO:teuthology.orchestra.run.smithi155.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 9.3 MB/s | 3.6 MB 00:00 2024-09-15T23:19:17.337 INFO:teuthology.orchestra.run.smithi159.stdout:(6/156): ceph-mds-19.1.1-326.g8921c8ef.el9.x86_ 1.5 MB/s | 2.4 MB 00:01 2024-09-15T23:19:17.347 INFO:teuthology.orchestra.run.smithi155.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.9 MB/s | 249 kB 00:00 2024-09-15T23:19:17.447 INFO:teuthology.orchestra.run.smithi155.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 14 MB/s | 7.4 MB 00:00 2024-09-15T23:19:17.464 INFO:teuthology.orchestra.run.smithi155.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 421 kB/s | 49 kB 00:00 2024-09-15T23:19:17.498 INFO:teuthology.orchestra.run.smithi155.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T23:19:17.532 INFO:teuthology.orchestra.run.smithi155.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T23:19:17.590 INFO:teuthology.orchestra.run.smithi155.stdout:(37/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-15T23:19:17.615 INFO:teuthology.orchestra.run.smithi155.stdout:(38/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 219 kB/s | 18 kB 00:00 2024-09-15T23:19:17.662 INFO:teuthology.orchestra.run.smithi159.stdout:(7/156): ceph-mon-19.1.1-326.g8921c8ef.el9.x86_ 6.1 MB/s | 4.7 MB 00:00 2024-09-15T23:19:17.757 INFO:teuthology.orchestra.run.smithi155.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-15T23:19:17.799 INFO:teuthology.orchestra.run.smithi155.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-15T23:19:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:(8/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86_ 7.4 MB/s | 17 MB 00:02 2024-09-15T23:19:18.250 INFO:teuthology.orchestra.run.smithi077.stdout:(9/156): ceph-common-19.1.1-326.g8921c8ef.el9.x 5.0 MB/s | 21 MB 00:04 2024-09-15T23:19:18.275 INFO:teuthology.orchestra.run.smithi155.stdout:(41/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 16 MB/s | 49 MB 00:03 2024-09-15T23:19:18.275 INFO:teuthology.orchestra.run.smithi077.stdout:(10/156): ceph-selinux-19.1.1-326.g8921c8ef.el9 112 kB/s | 25 kB 00:00 2024-09-15T23:19:18.309 INFO:teuthology.orchestra.run.smithi155.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 347 kB/s | 191 kB 00:00 2024-09-15T23:19:18.326 INFO:teuthology.orchestra.run.smithi077.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 4.5 MB/s | 228 kB 00:00 2024-09-15T23:19:18.334 INFO:teuthology.orchestra.run.smithi155.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 474 kB/s | 253 kB 00:00 2024-09-15T23:19:18.367 INFO:teuthology.orchestra.run.smithi077.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 653 kB/s | 27 kB 00:00 2024-09-15T23:19:18.376 INFO:teuthology.orchestra.run.smithi155.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-15T23:19:18.409 INFO:teuthology.orchestra.run.smithi077.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 764 kB/s | 32 kB 00:00 2024-09-15T23:19:18.410 INFO:teuthology.orchestra.run.smithi155.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-15T23:19:18.476 INFO:teuthology.orchestra.run.smithi077.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 751 kB 00:00 2024-09-15T23:19:18.485 INFO:teuthology.orchestra.run.smithi155.stdout:(46/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-15T23:19:18.487 INFO:teuthology.orchestra.run.smithi159.stdout:(8/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9. 13 MB/s | 11 MB 00:00 2024-09-15T23:19:18.510 INFO:teuthology.orchestra.run.smithi155.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 931 kB/s | 125 kB 00:00 2024-09-15T23:19:18.526 INFO:teuthology.orchestra.run.smithi077.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 3.2 MB/s | 163 kB 00:00 2024-09-15T23:19:18.538 INFO:teuthology.orchestra.run.smithi159.stdout:(9/156): ceph-selinux-19.1.1-326.g8921c8ef.el9. 505 kB/s | 25 kB 00:00 2024-09-15T23:19:18.560 INFO:teuthology.orchestra.run.smithi155.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-09-15T23:19:18.568 INFO:teuthology.orchestra.run.smithi077.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 3.0 MB/s | 127 kB 00:00 2024-09-15T23:19:18.644 INFO:teuthology.orchestra.run.smithi077.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 6.6 MB/s | 506 kB 00:00 2024-09-15T23:19:18.660 INFO:teuthology.orchestra.run.smithi155.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-15T23:19:18.703 INFO:teuthology.orchestra.run.smithi155.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 520 kB/s | 22 kB 00:00 2024-09-15T23:19:18.753 INFO:teuthology.orchestra.run.smithi155.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-09-15T23:19:18.795 INFO:teuthology.orchestra.run.smithi155.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-15T23:19:18.820 INFO:teuthology.orchestra.run.smithi155.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-15T23:19:18.845 INFO:teuthology.orchestra.run.smithi155.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-09-15T23:19:18.871 INFO:teuthology.orchestra.run.smithi155.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 363 kB/s | 18 kB 00:00 2024-09-15T23:19:18.905 INFO:teuthology.orchestra.run.smithi155.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 189 kB/s | 11 kB 00:00 2024-09-15T23:19:18.930 INFO:teuthology.orchestra.run.smithi155.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-15T23:19:18.955 INFO:teuthology.orchestra.run.smithi155.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 901 kB/s | 45 kB 00:00 2024-09-15T23:19:19.014 INFO:teuthology.orchestra.run.smithi155.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 9.8 MB/s | 581 kB 00:00 2024-09-15T23:19:19.048 INFO:teuthology.orchestra.run.smithi155.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 739 kB/s | 24 kB 00:00 2024-09-15T23:19:19.077 INFO:teuthology.orchestra.run.smithi077.stdout:(18/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 12 MB/s | 5.3 MB 00:00 2024-09-15T23:19:19.081 INFO:teuthology.orchestra.run.smithi155.stdout:(61/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-15T23:19:19.106 INFO:teuthology.orchestra.run.smithi155.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-09-15T23:19:19.127 INFO:teuthology.orchestra.run.smithi077.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 906 kB/s | 45 kB 00:00 2024-09-15T23:19:19.178 INFO:teuthology.orchestra.run.smithi077.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.6 MB/s | 136 kB 00:00 2024-09-15T23:19:19.181 INFO:teuthology.orchestra.run.smithi155.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.5 MB/s | 188 kB 00:00 2024-09-15T23:19:19.207 INFO:teuthology.orchestra.run.smithi155.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-15T23:19:19.220 INFO:teuthology.orchestra.run.smithi077.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.8 MB/s | 161 kB 00:00 2024-09-15T23:19:19.224 INFO:teuthology.orchestra.run.smithi155.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 918 kB/s | 38 kB 00:00 2024-09-15T23:19:19.271 INFO:teuthology.orchestra.run.smithi077.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 6.2 MB/s | 320 kB 00:00 2024-09-15T23:19:19.321 INFO:teuthology.orchestra.run.smithi077.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 5.9 MB/s | 300 kB 00:00 2024-09-15T23:19:19.437 INFO:teuthology.orchestra.run.smithi077.stdout:(24/156): ceph-radosgw-19.1.1-326.g8921c8ef.el9 4.2 MB/s | 11 MB 00:02 2024-09-15T23:19:19.454 INFO:teuthology.orchestra.run.smithi077.stdout:(25/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 743 kB/s | 99 kB 00:00 2024-09-15T23:19:19.471 INFO:teuthology.orchestra.run.smithi077.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 2.5 MB/s | 85 kB 00:00 2024-09-15T23:19:19.522 INFO:teuthology.orchestra.run.smithi077.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 3.3 MB/s | 170 kB 00:00 2024-09-15T23:19:19.572 INFO:teuthology.orchestra.run.smithi077.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 641 kB/s | 32 kB 00:00 2024-09-15T23:19:19.614 INFO:teuthology.orchestra.run.smithi077.stdout:(29/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 3.4 MB/s | 146 kB 00:00 2024-09-15T23:19:19.674 INFO:teuthology.orchestra.run.smithi155.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.4 MB/s | 3.0 MB 00:00 2024-09-15T23:19:19.748 INFO:teuthology.orchestra.run.smithi077.stdout:(30/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 11 MB/s | 3.1 MB 00:00 2024-09-15T23:19:20.116 INFO:teuthology.orchestra.run.smithi155.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 3.6 MB/s | 1.6 MB 00:00 2024-09-15T23:19:20.231 INFO:teuthology.orchestra.run.smithi077.stdout:(31/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 5.8 MB/s | 3.6 MB 00:00 2024-09-15T23:19:20.298 INFO:teuthology.orchestra.run.smithi077.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 3.7 MB/s | 249 kB 00:00 2024-09-15T23:19:20.308 INFO:teuthology.orchestra.run.smithi155.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.1 MB/s | 4.4 MB 00:01 2024-09-15T23:19:20.375 INFO:teuthology.orchestra.run.smithi155.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-15T23:19:20.381 INFO:teuthology.orchestra.run.smithi077.stdout:(33/156): ceph-mgr-diskprediction-local-19.1.1- 12 MB/s | 7.4 MB 00:00 2024-09-15T23:19:20.407 INFO:teuthology.orchestra.run.smithi077.stdout:(34/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 455 kB/s | 49 kB 00:00 2024-09-15T23:19:20.425 INFO:teuthology.orchestra.run.smithi155.stdout:(70/156): postgresql-contrib-13.16-1.el9.x86_64 2.9 MB/s | 910 kB 00:00 2024-09-15T23:19:20.432 INFO:teuthology.orchestra.run.smithi077.stdout:(35/156): ceph-prometheus-alerts-19.1.1-326.g89 328 kB/s | 16 kB 00:00 2024-09-15T23:19:20.474 INFO:teuthology.orchestra.run.smithi077.stdout:(36/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T23:19:20.524 INFO:teuthology.orchestra.run.smithi077.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 367 kB/s | 18 kB 00:00 2024-09-15T23:19:20.550 INFO:teuthology.orchestra.run.smithi077.stdout:(38/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 6.4 MB/s | 765 kB 00:00 2024-09-15T23:19:20.554 INFO:teuthology.orchestra.run.smithi159.stdout:(10/156): ceph-common-19.1.1-326.g8921c8ef.el9. 3.6 MB/s | 21 MB 00:05 2024-09-15T23:19:20.622 INFO:teuthology.orchestra.run.smithi159.stdout:(11/156): cephfs-mirror-19.1.1-326.g8921c8ef.el 3.3 MB/s | 228 kB 00:00 2024-09-15T23:19:20.641 INFO:teuthology.orchestra.run.smithi077.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 683 kB/s | 80 kB 00:00 2024-09-15T23:19:20.672 INFO:teuthology.orchestra.run.smithi159.stdout:(12/156): cephfs-shell-19.1.1-326.g8921c8ef.el9 542 kB/s | 27 kB 00:00 2024-09-15T23:19:20.722 INFO:teuthology.orchestra.run.smithi159.stdout:(13/156): libcephfs-devel-19.1.1-326.g8921c8ef. 638 kB/s | 32 kB 00:00 2024-09-15T23:19:20.725 INFO:teuthology.orchestra.run.smithi077.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 801 kB 00:00 2024-09-15T23:19:20.742 INFO:teuthology.orchestra.run.smithi155.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-09-15T23:19:20.750 INFO:teuthology.orchestra.run.smithi077.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.7 MB/s | 191 kB 00:00 2024-09-15T23:19:20.776 INFO:teuthology.orchestra.run.smithi155.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.9 MB/s | 1.0 MB 00:00 2024-09-15T23:19:20.784 INFO:teuthology.orchestra.run.smithi077.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-15T23:19:20.818 INFO:teuthology.orchestra.run.smithi077.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-09-15T23:19:20.826 INFO:teuthology.orchestra.run.smithi155.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.0 MB/s | 87 kB 00:00 2024-09-15T23:19:20.843 INFO:teuthology.orchestra.run.smithi077.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-15T23:19:20.855 INFO:teuthology.orchestra.run.smithi159.stdout:(14/156): libcephfs2-19.1.1-326.g8921c8ef.el9.x 5.5 MB/s | 751 kB 00:00 2024-09-15T23:19:20.859 INFO:teuthology.orchestra.run.smithi155.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-15T23:19:20.868 INFO:teuthology.orchestra.run.smithi077.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-15T23:19:20.893 INFO:teuthology.orchestra.run.smithi077.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-15T23:19:20.906 INFO:teuthology.orchestra.run.smithi159.stdout:(15/156): libcephsqlite-19.1.1-326.g8921c8ef.el 3.2 MB/s | 163 kB 00:00 2024-09-15T23:19:20.918 INFO:teuthology.orchestra.run.smithi077.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-15T23:19:20.956 INFO:teuthology.orchestra.run.smithi159.stdout:(16/156): librados-devel-19.1.1-326.g8921c8ef.e 2.5 MB/s | 127 kB 00:00 2024-09-15T23:19:20.960 INFO:teuthology.orchestra.run.smithi155.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-15T23:19:21.048 INFO:teuthology.orchestra.run.smithi159.stdout:(17/156): libradosstriper1-19.1.1-326.g8921c8ef 5.4 MB/s | 506 kB 00:00 2024-09-15T23:19:21.052 INFO:teuthology.orchestra.run.smithi155.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-09-15T23:19:21.086 INFO:teuthology.orchestra.run.smithi155.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 773 kB/s | 26 kB 00:00 2024-09-15T23:19:21.094 INFO:teuthology.orchestra.run.smithi077.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-15T23:19:21.119 INFO:teuthology.orchestra.run.smithi155.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 578 kB/s | 19 kB 00:00 2024-09-15T23:19:21.127 INFO:teuthology.orchestra.run.smithi077.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 689 kB 00:00 2024-09-15T23:19:21.170 INFO:teuthology.orchestra.run.smithi077.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-09-15T23:19:21.194 INFO:teuthology.orchestra.run.smithi155.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-15T23:19:21.203 INFO:teuthology.orchestra.run.smithi077.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 287 kB/s | 22 kB 00:00 2024-09-15T23:19:21.215 INFO:teuthology.orchestra.run.smithi159.stdout:(18/156): ceph-osd-19.1.1-326.g8921c8ef.el9.x86 4.3 MB/s | 17 MB 00:03 2024-09-15T23:19:21.228 INFO:teuthology.orchestra.run.smithi155.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 1.0 MB/s | 35 kB 00:00 2024-09-15T23:19:21.265 INFO:teuthology.orchestra.run.smithi159.stdout:(19/156): python3-ceph-argparse-19.1.1-326.g892 913 kB/s | 45 kB 00:00 2024-09-15T23:19:21.270 INFO:teuthology.orchestra.run.smithi077.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-15T23:19:21.296 INFO:teuthology.orchestra.run.smithi077.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-15T23:19:21.316 INFO:teuthology.orchestra.run.smithi159.stdout:(20/156): python3-ceph-common-19.1.1-326.g8921c 2.7 MB/s | 136 kB 00:00 2024-09-15T23:19:21.366 INFO:teuthology.orchestra.run.smithi159.stdout:(21/156): python3-cephfs-19.1.1-326.g8921c8ef.e 3.2 MB/s | 161 kB 00:00 2024-09-15T23:19:21.379 INFO:teuthology.orchestra.run.smithi077.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-09-15T23:19:21.433 INFO:teuthology.orchestra.run.smithi159.stdout:(22/156): python3-rados-19.1.1-326.g8921c8ef.el 4.7 MB/s | 320 kB 00:00 2024-09-15T23:19:21.446 INFO:teuthology.orchestra.run.smithi077.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-09-15T23:19:21.463 INFO:teuthology.orchestra.run.smithi077.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 133 kB/s | 11 kB 00:00 2024-09-15T23:19:21.500 INFO:teuthology.orchestra.run.smithi159.stdout:(23/156): python3-rbd-19.1.1-326.g8921c8ef.el9. 4.4 MB/s | 300 kB 00:00 2024-09-15T23:19:21.530 INFO:teuthology.orchestra.run.smithi077.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-15T23:19:21.547 INFO:teuthology.orchestra.run.smithi077.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 542 kB/s | 45 kB 00:00 2024-09-15T23:19:21.550 INFO:teuthology.orchestra.run.smithi159.stdout:(24/156): python3-rgw-19.1.1-326.g8921c8ef.el9. 2.0 MB/s | 99 kB 00:00 2024-09-15T23:19:21.614 INFO:teuthology.orchestra.run.smithi077.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 8.5 MB/s | 581 kB 00:00 2024-09-15T23:19:21.647 INFO:teuthology.orchestra.run.smithi077.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-15T23:19:21.689 INFO:teuthology.orchestra.run.smithi077.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 326 kB/s | 24 kB 00:00 2024-09-15T23:19:21.765 INFO:teuthology.orchestra.run.smithi077.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 406 kB/s | 47 kB 00:00 2024-09-15T23:19:21.798 INFO:teuthology.orchestra.run.smithi077.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-15T23:19:21.832 INFO:teuthology.orchestra.run.smithi077.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-15T23:19:21.865 INFO:teuthology.orchestra.run.smithi077.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 577 kB/s | 38 kB 00:00 2024-09-15T23:19:21.991 INFO:teuthology.orchestra.run.smithi077.stdout:(66/156): openblas-openmp-0.3.26-2.el9.x86_64.r 31 MB/s | 4.9 MB 00:00 2024-09-15T23:19:22.009 INFO:teuthology.orchestra.run.smithi159.stdout:(25/156): ceph-test-19.1.1-326.g8921c8ef.el9.x8 14 MB/s | 49 MB 00:03 2024-09-15T23:19:22.034 INFO:teuthology.orchestra.run.smithi159.stdout:(26/156): rbd-fuse-19.1.1-326.g8921c8ef.el9.x86 176 kB/s | 85 kB 00:00 2024-09-15T23:19:22.058 INFO:teuthology.orchestra.run.smithi077.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-09-15T23:19:22.070 INFO:teuthology.orchestra.run.smithi155.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 3.4 MB/s | 5.8 MB 00:01 2024-09-15T23:19:22.100 INFO:teuthology.orchestra.run.smithi077.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T23:19:22.150 INFO:teuthology.orchestra.run.smithi077.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-15T23:19:22.162 INFO:teuthology.orchestra.run.smithi155.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-09-15T23:19:22.175 INFO:teuthology.orchestra.run.smithi077.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-15T23:19:22.176 INFO:teuthology.orchestra.run.smithi159.stdout:(27/156): rbd-nbd-19.1.1-326.g8921c8ef.el9.x86_ 1.2 MB/s | 170 kB 00:00 2024-09-15T23:19:22.251 INFO:teuthology.orchestra.run.smithi159.stdout:(28/156): ceph-grafana-dashboards-19.1.1-326.g8 425 kB/s | 32 kB 00:00 2024-09-15T23:19:22.262 INFO:teuthology.orchestra.run.smithi155.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-09-15T23:19:22.301 INFO:teuthology.orchestra.run.smithi077.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-15T23:19:22.321 INFO:teuthology.orchestra.run.smithi155.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-15T23:19:22.359 INFO:teuthology.orchestra.run.smithi159.stdout:(29/156): librgw2-19.1.1-326.g8921c8ef.el9.x86_ 4.1 MB/s | 5.3 MB 00:01 2024-09-15T23:19:22.363 INFO:teuthology.orchestra.run.smithi155.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-15T23:19:22.375 INFO:teuthology.orchestra.run.smithi077.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 26 MB/s | 5.8 MB 00:00 2024-09-15T23:19:22.385 INFO:teuthology.orchestra.run.smithi159.stdout:(30/156): ceph-mgr-cephadm-19.1.1-326.g8921c8ef 1.1 MB/s | 146 kB 00:00 2024-09-15T23:19:22.401 INFO:teuthology.orchestra.run.smithi077.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 875 kB/s | 87 kB 00:00 2024-09-15T23:19:22.468 INFO:teuthology.orchestra.run.smithi077.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 919 kB/s | 61 kB 00:00 2024-09-15T23:19:22.472 INFO:teuthology.orchestra.run.smithi155.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 269 kB 00:00 2024-09-15T23:19:22.580 INFO:teuthology.orchestra.run.smithi155.stdout:(87/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.3 MB/s | 6.0 MB 00:01 2024-09-15T23:19:22.585 INFO:teuthology.orchestra.run.smithi077.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-09-15T23:19:22.610 INFO:teuthology.orchestra.run.smithi077.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.7 MB/s | 245 kB 00:00 2024-09-15T23:19:22.614 INFO:teuthology.orchestra.run.smithi155.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-15T23:19:22.618 INFO:teuthology.orchestra.run.smithi159.stdout:(31/156): rbd-mirror-19.1.1-326.g8921c8ef.el9.x 5.1 MB/s | 3.1 MB 00:00 2024-09-15T23:19:22.656 INFO:teuthology.orchestra.run.smithi155.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-15T23:19:22.669 INFO:teuthology.orchestra.run.smithi077.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-15T23:19:22.694 INFO:teuthology.orchestra.run.smithi077.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 306 kB/s | 26 kB 00:00 2024-09-15T23:19:22.698 INFO:teuthology.orchestra.run.smithi155.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-15T23:19:22.718 INFO:teuthology.orchestra.run.smithi159.stdout:(32/156): ceph-mgr-modules-core-19.1.1-326.g892 2.4 MB/s | 249 kB 00:00 2024-09-15T23:19:22.736 INFO:teuthology.orchestra.run.smithi077.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 286 kB/s | 19 kB 00:00 2024-09-15T23:19:22.748 INFO:teuthology.orchestra.run.smithi155.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-09-15T23:19:22.770 INFO:teuthology.orchestra.run.smithi077.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-09-15T23:19:22.790 INFO:teuthology.orchestra.run.smithi155.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-15T23:19:22.819 INFO:teuthology.orchestra.run.smithi159.stdout:(33/156): ceph-mgr-rook-19.1.1-326.g8921c8ef.el 493 kB/s | 49 kB 00:00 2024-09-15T23:19:22.828 INFO:teuthology.orchestra.run.smithi077.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 377 kB/s | 35 kB 00:00 2024-09-15T23:19:22.832 INFO:teuthology.orchestra.run.smithi155.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-15T23:19:22.886 INFO:teuthology.orchestra.run.smithi159.stdout:(34/156): ceph-prometheus-alerts-19.1.1-326.g89 247 kB/s | 16 kB 00:00 2024-09-15T23:19:22.916 INFO:teuthology.orchestra.run.smithi155.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-15T23:19:22.945 INFO:teuthology.orchestra.run.smithi077.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 5.1 MB 00:00 2024-09-15T23:19:22.953 INFO:teuthology.orchestra.run.smithi159.stdout:(35/156): ceph-volume-19.1.1-326.g8921c8ef.el9. 4.2 MB/s | 285 kB 00:00 2024-09-15T23:19:22.958 INFO:teuthology.orchestra.run.smithi155.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 865 kB/s | 36 kB 00:00 2024-09-15T23:19:22.971 INFO:teuthology.orchestra.run.smithi077.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 250 kB 00:00 2024-09-15T23:19:22.999 INFO:teuthology.orchestra.run.smithi155.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-15T23:19:23.021 INFO:teuthology.orchestra.run.smithi077.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-09-15T23:19:23.046 INFO:teuthology.orchestra.run.smithi077.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-15T23:19:23.105 INFO:teuthology.orchestra.run.smithi077.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 506 kB/s | 42 kB 00:00 2024-09-15T23:19:23.108 INFO:teuthology.orchestra.run.smithi155.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 2.7 MB/s | 304 kB 00:00 2024-09-15T23:19:23.138 INFO:teuthology.orchestra.run.smithi077.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-15T23:19:23.151 INFO:teuthology.orchestra.run.smithi155.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-15T23:19:23.180 INFO:teuthology.orchestra.run.smithi077.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-15T23:19:23.195 INFO:teuthology.orchestra.run.smithi159.stdout:(36/156): cephadm-19.1.1-326.g8921c8ef.el9.noar 3.1 MB/s | 765 kB 00:00 2024-09-15T23:19:23.214 INFO:teuthology.orchestra.run.smithi077.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-09-15T23:19:23.217 INFO:teuthology.orchestra.run.smithi155.stdout:(99/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-09-15T23:19:23.247 INFO:teuthology.orchestra.run.smithi077.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 763 kB/s | 51 kB 00:00 2024-09-15T23:19:23.280 INFO:teuthology.orchestra.run.smithi159.stdout:(37/156): cephfs-top-19.1.1-326.g8921c8ef.el9.n 215 kB/s | 18 kB 00:00 2024-09-15T23:19:23.298 INFO:teuthology.orchestra.run.smithi077.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 642 kB/s | 54 kB 00:00 2024-09-15T23:19:23.301 INFO:teuthology.orchestra.run.smithi155.stdout:(100/156): python3-numpy-1.20.1-5.el9.x86_64.rp 2.5 MB/s | 5.1 MB 00:02 2024-09-15T23:19:23.326 INFO:teuthology.orchestra.run.smithi155.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-09-15T23:19:23.352 INFO:teuthology.orchestra.run.smithi155.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-15T23:19:23.373 INFO:teuthology.orchestra.run.smithi077.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 556 kB/s | 42 kB 00:00 2024-09-15T23:19:23.414 INFO:teuthology.orchestra.run.smithi159.stdout:(38/156): ceph-mgr-dashboard-19.1.1-326.g8921c8 3.4 MB/s | 3.6 MB 00:01 2024-09-15T23:19:23.435 INFO:teuthology.orchestra.run.smithi155.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-15T23:19:23.502 INFO:teuthology.orchestra.run.smithi155.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-15T23:19:23.544 INFO:teuthology.orchestra.run.smithi155.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-15T23:19:23.570 INFO:teuthology.orchestra.run.smithi155.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 777 kB/s | 19 kB 00:00 2024-09-15T23:19:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:(93/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-09-15T23:19:23.615 INFO:teuthology.orchestra.run.smithi077.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 183 kB/s | 44 kB 00:00 2024-09-15T23:19:23.653 INFO:teuthology.orchestra.run.smithi155.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-09-15T23:19:23.666 INFO:teuthology.orchestra.run.smithi077.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-15T23:19:23.695 INFO:teuthology.orchestra.run.smithi155.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 627 kB/s | 26 kB 00:00 2024-09-15T23:19:23.716 INFO:teuthology.orchestra.run.smithi077.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 357 kB/s | 36 kB 00:00 2024-09-15T23:19:23.720 INFO:teuthology.orchestra.run.smithi155.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-15T23:19:23.754 INFO:teuthology.orchestra.run.smithi155.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-15T23:19:23.758 INFO:teuthology.orchestra.run.smithi077.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 516 kB/s | 47 kB 00:00 2024-09-15T23:19:23.788 INFO:teuthology.orchestra.run.smithi155.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-15T23:19:23.808 INFO:teuthology.orchestra.run.smithi077.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-09-15T23:19:23.833 INFO:teuthology.orchestra.run.smithi077.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-09-15T23:19:23.846 INFO:teuthology.orchestra.run.smithi155.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-09-15T23:19:23.875 INFO:teuthology.orchestra.run.smithi077.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-15T23:19:23.900 INFO:teuthology.orchestra.run.smithi077.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-15T23:19:23.905 INFO:teuthology.orchestra.run.smithi155.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-15T23:19:23.914 INFO:teuthology.orchestra.run.smithi159.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-15T23:19:23.930 INFO:teuthology.orchestra.run.smithi155.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-15T23:19:23.942 INFO:teuthology.orchestra.run.smithi077.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 669 kB/s | 45 kB 00:00 2024-09-15T23:19:23.958 INFO:teuthology.orchestra.run.smithi155.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 839 kB 00:00 2024-09-15T23:19:23.976 INFO:teuthology.orchestra.run.smithi077.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-09-15T23:19:23.981 INFO:teuthology.orchestra.run.smithi155.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 638 kB/s | 32 kB 00:00 2024-09-15T23:19:24.006 INFO:teuthology.orchestra.run.smithi155.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-15T23:19:24.026 INFO:teuthology.orchestra.run.smithi077.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-15T23:19:24.031 INFO:teuthology.orchestra.run.smithi155.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-15T23:19:24.059 INFO:teuthology.orchestra.run.smithi077.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-15T23:19:24.074 INFO:teuthology.orchestra.run.smithi155.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 5.2 MB/s | 358 kB 00:00 2024-09-15T23:19:24.076 INFO:teuthology.orchestra.run.smithi077.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.1 MB/s | 19 kB 00:00 2024-09-15T23:19:24.099 INFO:teuthology.orchestra.run.smithi155.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T23:19:24.141 INFO:teuthology.orchestra.run.smithi155.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-15T23:19:24.175 INFO:teuthology.orchestra.run.smithi155.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-15T23:19:24.200 INFO:teuthology.orchestra.run.smithi155.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-15T23:19:24.225 INFO:teuthology.orchestra.run.smithi155.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 716 kB/s | 18 kB 00:00 2024-09-15T23:19:24.250 INFO:teuthology.orchestra.run.smithi155.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 935 kB/s | 23 kB 00:00 2024-09-15T23:19:24.276 INFO:teuthology.orchestra.run.smithi155.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-15T23:19:24.289 INFO:teuthology.orchestra.run.smithi159.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 915 kB/s | 801 kB 00:00 2024-09-15T23:19:24.326 INFO:teuthology.orchestra.run.smithi155.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 9.0 MB/s | 2.0 MB 00:00 2024-09-15T23:19:24.351 INFO:teuthology.orchestra.run.smithi155.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-15T23:19:24.377 INFO:teuthology.orchestra.run.smithi155.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T23:19:24.402 INFO:teuthology.orchestra.run.smithi155.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-15T23:19:24.406 INFO:teuthology.orchestra.run.smithi159.stdout:(41/156): ceph-mgr-diskprediction-local-19.1.1- 3.7 MB/s | 7.4 MB 00:02 2024-09-15T23:19:24.428 INFO:teuthology.orchestra.run.smithi155.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:19:24.461 INFO:teuthology.orchestra.run.smithi155.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-09-15T23:19:24.487 INFO:teuthology.orchestra.run.smithi155.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-15T23:19:24.520 INFO:teuthology.orchestra.run.smithi155.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-09-15T23:19:24.545 INFO:teuthology.orchestra.run.smithi155.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T23:19:24.570 INFO:teuthology.orchestra.run.smithi155.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-15T23:19:24.577 INFO:teuthology.orchestra.run.smithi077.stdout:(107/156): ceph-test-19.1.1-326.g8921c8ef.el9.x 7.7 MB/s | 49 MB 00:06 2024-09-15T23:19:24.596 INFO:teuthology.orchestra.run.smithi155.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-09-15T23:19:24.622 INFO:teuthology.orchestra.run.smithi155.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-15T23:19:24.647 INFO:teuthology.orchestra.run.smithi155.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-15T23:19:24.652 INFO:teuthology.orchestra.run.smithi077.stdout:(108/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.7 MB/s | 4.4 MB 00:00 2024-09-15T23:19:24.672 INFO:teuthology.orchestra.run.smithi155.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-15T23:19:24.681 INFO:teuthology.orchestra.run.smithi159.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 249 kB/s | 191 kB 00:00 2024-09-15T23:19:24.686 INFO:teuthology.orchestra.run.smithi077.stdout:(109/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.1 MB/s | 863 kB 00:00 2024-09-15T23:19:24.697 INFO:teuthology.orchestra.run.smithi155.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-15T23:19:24.711 INFO:teuthology.orchestra.run.smithi077.stdout:(110/156): liboath-2.6.7-2.el9.x86_64.rpm 964 kB/s | 49 kB 00:00 2024-09-15T23:19:24.723 INFO:teuthology.orchestra.run.smithi155.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-15T23:19:24.748 INFO:teuthology.orchestra.run.smithi155.stdout:(143/156): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-15T23:19:24.775 INFO:teuthology.orchestra.run.smithi077.stdout:(111/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 133 kB/s | 26 kB 00:00 2024-09-15T23:19:24.775 INFO:teuthology.orchestra.run.smithi155.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-15T23:19:24.799 INFO:teuthology.orchestra.run.smithi155.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-15T23:19:24.820 INFO:teuthology.orchestra.run.smithi077.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-09-15T23:19:24.824 INFO:teuthology.orchestra.run.smithi155.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-15T23:19:24.845 INFO:teuthology.orchestra.run.smithi077.stdout:(113/156): libunwind-1.6.2-1.el9.x86_64.rpm 427 kB/s | 67 kB 00:00 2024-09-15T23:19:24.879 INFO:teuthology.orchestra.run.smithi077.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-15T23:19:24.904 INFO:teuthology.orchestra.run.smithi077.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T23:19:24.908 INFO:teuthology.orchestra.run.smithi155.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-15T23:19:24.938 INFO:teuthology.orchestra.run.smithi077.stdout:(116/156): python3-asyncssh-2.13.2-5.el9.noarch 4.6 MB/s | 548 kB 00:00 2024-09-15T23:19:24.963 INFO:teuthology.orchestra.run.smithi077.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 242 kB/s | 14 kB 00:00 2024-09-15T23:19:24.988 INFO:teuthology.orchestra.run.smithi077.stdout:(118/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.8 MB/s | 839 kB 00:00 2024-09-15T23:19:25.014 INFO:teuthology.orchestra.run.smithi077.stdout:(119/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-09-15T23:19:25.047 INFO:teuthology.orchestra.run.smithi077.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-15T23:19:25.073 INFO:teuthology.orchestra.run.smithi077.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-15T23:19:25.106 INFO:teuthology.orchestra.run.smithi077.stdout:(122/156): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-09-15T23:19:25.131 INFO:teuthology.orchestra.run.smithi077.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-15T23:19:25.156 INFO:teuthology.orchestra.run.smithi159.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 292 kB/s | 253 kB 00:00 2024-09-15T23:19:25.157 INFO:teuthology.orchestra.run.smithi077.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-09-15T23:19:25.182 INFO:teuthology.orchestra.run.smithi077.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-15T23:19:25.207 INFO:teuthology.orchestra.run.smithi077.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 460 kB/s | 23 kB 00:00 2024-09-15T23:19:25.232 INFO:teuthology.orchestra.run.smithi077.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-15T23:19:25.258 INFO:teuthology.orchestra.run.smithi077.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-15T23:19:25.283 INFO:teuthology.orchestra.run.smithi077.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T23:19:25.317 INFO:teuthology.orchestra.run.smithi077.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-15T23:19:25.340 INFO:teuthology.orchestra.run.smithi159.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-15T23:19:25.342 INFO:teuthology.orchestra.run.smithi077.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-15T23:19:25.376 INFO:teuthology.orchestra.run.smithi077.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-09-15T23:19:25.401 INFO:teuthology.orchestra.run.smithi077.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-15T23:19:25.407 INFO:teuthology.orchestra.run.smithi159.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 147 kB/s | 106 kB 00:00 2024-09-15T23:19:25.443 INFO:teuthology.orchestra.run.smithi077.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-15T23:19:25.468 INFO:teuthology.orchestra.run.smithi077.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-15T23:19:25.493 INFO:teuthology.orchestra.run.smithi077.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-09-15T23:19:25.518 INFO:teuthology.orchestra.run.smithi077.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-15T23:19:25.525 INFO:teuthology.orchestra.run.smithi155.stdout:(148/156): librados2-19.1.1-326.g8921c8ef.el9.x 4.9 MB/s | 3.4 MB 00:00 2024-09-15T23:19:25.560 INFO:teuthology.orchestra.run.smithi077.stdout:(138/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.0 MB/s | 2.0 MB 00:00 2024-09-15T23:19:25.586 INFO:teuthology.orchestra.run.smithi077.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 886 kB/s | 59 kB 00:00 2024-09-15T23:19:25.600 INFO:teuthology.orchestra.run.smithi155.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 4.6 MB/s | 3.2 MB 00:00 2024-09-15T23:19:25.611 INFO:teuthology.orchestra.run.smithi077.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-09-15T23:19:25.636 INFO:teuthology.orchestra.run.smithi077.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-15T23:19:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-15T23:19:25.675 INFO:teuthology.orchestra.run.smithi155.stdout:(150/156): NetworkManager-1.49.90-1.el9.x86_64. 15 MB/s | 2.3 MB 00:00 2024-09-15T23:19:25.679 INFO:teuthology.orchestra.run.smithi077.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-15T23:19:25.704 INFO:teuthology.orchestra.run.smithi077.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-15T23:19:25.720 INFO:teuthology.orchestra.run.smithi077.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 484 kB/s | 20 kB 00:00 2024-09-15T23:19:25.725 INFO:teuthology.orchestra.run.smithi155.stdout:(151/156): NetworkManager-libnm-1.49.90-1.el9.x 14 MB/s | 1.8 MB 00:00 2024-09-15T23:19:25.742 INFO:teuthology.orchestra.run.smithi155.stdout:(152/156): NetworkManager-team-1.49.90-1.el9.x8 609 kB/s | 41 kB 00:00 2024-09-15T23:19:25.746 INFO:teuthology.orchestra.run.smithi077.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-15T23:19:25.772 INFO:teuthology.orchestra.run.smithi077.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-15T23:19:25.801 INFO:teuthology.orchestra.run.smithi155.stdout:(153/156): NetworkManager-tui-1.49.90-1.el9.x86 3.2 MB/s | 249 kB 00:00 2024-09-15T23:19:25.835 INFO:teuthology.orchestra.run.smithi155.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-09-15T23:19:25.849 INFO:teuthology.orchestra.run.smithi159.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 195 kB/s | 135 kB 00:00 2024-09-15T23:19:25.872 INFO:teuthology.orchestra.run.smithi077.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-09-15T23:19:25.902 INFO:teuthology.orchestra.run.smithi155.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-09-15T23:19:26.025 INFO:teuthology.orchestra.run.smithi159.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 3.9 MB/s | 689 kB 00:00 2024-09-15T23:19:26.049 INFO:teuthology.orchestra.run.smithi159.stdout:(48/156): python3-requests-2.25.1-8.el9.noarch. 176 kB/s | 125 kB 00:00 2024-09-15T23:19:26.055 INFO:teuthology.orchestra.run.smithi077.stdout:(149/156): NetworkManager-1.49.90-1.el9.x86_64. 13 MB/s | 2.3 MB 00:00 2024-09-15T23:19:26.091 INFO:teuthology.orchestra.run.smithi159.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-09-15T23:19:26.113 INFO:teuthology.orchestra.run.smithi077.stdout:(150/156): NetworkManager-libnm-1.49.90-1.el9.x 31 MB/s | 1.8 MB 00:00 2024-09-15T23:19:26.133 INFO:teuthology.orchestra.run.smithi159.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 523 kB/s | 22 kB 00:00 2024-09-15T23:19:26.172 INFO:teuthology.orchestra.run.smithi077.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 699 kB/s | 41 kB 00:00 2024-09-15T23:19:26.175 INFO:teuthology.orchestra.run.smithi159.stdout:(51/156): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-09-15T23:19:26.201 INFO:teuthology.orchestra.run.smithi159.stdout:(52/156): python3-urllib3-1.26.5-6.el9.noarch.r 271 kB/s | 215 kB 00:00 2024-09-15T23:19:26.214 INFO:teuthology.orchestra.run.smithi077.stdout:(152/156): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-15T23:19:26.226 INFO:teuthology.orchestra.run.smithi159.stdout:(53/156): boost-program-options-1.75.0-8.el9.x8 607 kB/s | 107 kB 00:00 2024-09-15T23:19:26.251 INFO:teuthology.orchestra.run.smithi159.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-15T23:19:26.273 INFO:teuthology.orchestra.run.smithi077.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-15T23:19:26.293 INFO:teuthology.orchestra.run.smithi159.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-09-15T23:19:26.318 INFO:teuthology.orchestra.run.smithi159.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-15T23:19:26.343 INFO:teuthology.orchestra.run.smithi159.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-15T23:19:26.348 INFO:teuthology.orchestra.run.smithi077.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 32 MB/s | 2.4 MB 00:00 2024-09-15T23:19:26.402 INFO:teuthology.orchestra.run.smithi159.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-09-15T23:19:26.427 INFO:teuthology.orchestra.run.smithi159.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-15T23:19:26.461 INFO:teuthology.orchestra.run.smithi159.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-15T23:19:26.481 INFO:teuthology.orchestra.run.smithi077.stdout:(155/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 4.4 MB/s | 3.2 MB 00:00 2024-09-15T23:19:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 419 kB/s | 24 kB 00:00 2024-09-15T23:19:26.511 INFO:teuthology.orchestra.run.smithi159.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.9 MB/s | 662 kB 00:00 2024-09-15T23:19:26.528 INFO:teuthology.orchestra.run.smithi159.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 706 kB/s | 47 kB 00:00 2024-09-15T23:19:26.553 INFO:teuthology.orchestra.run.smithi159.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 4.4 MB/s | 188 kB 00:00 2024-09-15T23:19:26.570 INFO:teuthology.orchestra.run.smithi159.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 925 kB/s | 38 kB 00:00 2024-09-15T23:19:26.596 INFO:teuthology.orchestra.run.smithi159.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-15T23:19:26.673 INFO:teuthology.orchestra.run.smithi077.stdout:(156/156): librados2-19.1.1-326.g8921c8ef.el9.x 3.7 MB/s | 3.4 MB 00:00 2024-09-15T23:19:26.679 INFO:teuthology.orchestra.run.smithi159.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-15T23:19:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:19:26.681 INFO:teuthology.orchestra.run.smithi077.stdout:Total 17 MB/s | 226 MB 00:13 2024-09-15T23:19:26.747 INFO:teuthology.orchestra.run.smithi159.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 26 MB/s | 4.9 MB 00:00 2024-09-15T23:19:26.789 INFO:teuthology.orchestra.run.smithi159.stdout:(69/156): postgresql-13.16-1.el9.x86_64.rpm 8.3 MB/s | 1.6 MB 00:00 2024-09-15T23:19:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-15T23:19:26.856 INFO:teuthology.orchestra.run.smithi159.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-15T23:19:26.889 INFO:teuthology.orchestra.run.smithi159.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-15T23:19:26.915 INFO:teuthology.orchestra.run.smithi159.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-15T23:19:26.957 INFO:teuthology.orchestra.run.smithi159.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-15T23:19:27.124 INFO:teuthology.orchestra.run.smithi159.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 17 MB/s | 5.8 MB 00:00 2024-09-15T23:19:27.149 INFO:teuthology.orchestra.run.smithi159.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-15T23:19:27.174 INFO:teuthology.orchestra.run.smithi159.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-15T23:19:27.201 INFO:teuthology.orchestra.run.smithi159.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-09-15T23:19:27.225 INFO:teuthology.orchestra.run.smithi159.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-15T23:19:27.250 INFO:teuthology.orchestra.run.smithi159.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-15T23:19:27.275 INFO:teuthology.orchestra.run.smithi159.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 692 kB/s | 35 kB 00:00 2024-09-15T23:19:27.359 INFO:teuthology.orchestra.run.smithi159.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-09-15T23:19:27.385 INFO:teuthology.orchestra.run.smithi159.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-15T23:19:27.410 INFO:teuthology.orchestra.run.smithi159.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-15T23:19:27.435 INFO:teuthology.orchestra.run.smithi159.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-15T23:19:27.460 INFO:teuthology.orchestra.run.smithi159.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 847 kB/s | 42 kB 00:00 2024-09-15T23:19:27.485 INFO:teuthology.orchestra.run.smithi159.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-15T23:19:27.511 INFO:teuthology.orchestra.run.smithi159.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-15T23:19:27.536 INFO:teuthology.orchestra.run.smithi159.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-15T23:19:27.561 INFO:teuthology.orchestra.run.smithi159.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-15T23:19:27.587 INFO:teuthology.orchestra.run.smithi159.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-15T23:19:27.670 INFO:teuthology.orchestra.run.smithi159.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-15T23:19:27.695 INFO:teuthology.orchestra.run.smithi159.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-15T23:19:27.720 INFO:teuthology.orchestra.run.smithi159.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 887 kB/s | 44 kB 00:00 2024-09-15T23:19:27.746 INFO:teuthology.orchestra.run.smithi159.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-15T23:19:27.771 INFO:teuthology.orchestra.run.smithi159.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-15T23:19:27.796 INFO:teuthology.orchestra.run.smithi159.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-15T23:19:27.821 INFO:teuthology.orchestra.run.smithi159.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-15T23:19:27.847 INFO:teuthology.orchestra.run.smithi159.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-15T23:19:27.863 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-15T23:19:27.864 INFO:teuthology.orchestra.run.smithi159.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 2.2 MB/s | 96 kB 00:00 2024-09-15T23:19:27.889 INFO:teuthology.orchestra.run.smithi159.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-15T23:19:27.915 INFO:teuthology.orchestra.run.smithi159.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-15T23:19:28.010 INFO:teuthology.orchestra.run.smithi155.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.1 MB/s | 16 MB 00:05 2024-09-15T23:19:28.015 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:19:28.016 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 226 MB 00:14 2024-09-15T23:19:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-15T23:19:28.016 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-15T23:19:28.140 INFO:teuthology.orchestra.run.smithi159.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-09-15T23:19:28.157 INFO:teuthology.orchestra.run.smithi159.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 83 kB/s | 22 kB 00:00 2024-09-15T23:19:28.232 INFO:teuthology.orchestra.run.smithi159.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-15T23:19:28.249 INFO:teuthology.orchestra.run.smithi159.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-15T23:19:28.283 INFO:teuthology.orchestra.run.smithi159.stdout:(107/156): abseil-cpp-20211102.0-3.el9.x86_64.r 3.8 MB/s | 548 kB 00:00 2024-09-15T23:19:28.299 INFO:teuthology.orchestra.run.smithi159.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.5 MB/s | 26 kB 00:00 2024-09-15T23:19:28.316 INFO:teuthology.orchestra.run.smithi159.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-15T23:19:28.350 INFO:teuthology.orchestra.run.smithi159.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.9 MB/s | 863 kB 00:00 2024-09-15T23:19:28.375 INFO:teuthology.orchestra.run.smithi159.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-15T23:19:28.442 INFO:teuthology.orchestra.run.smithi159.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-15T23:19:28.468 INFO:teuthology.orchestra.run.smithi159.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-09-15T23:19:28.501 INFO:teuthology.orchestra.run.smithi159.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-15T23:19:28.526 INFO:teuthology.orchestra.run.smithi159.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-15T23:19:28.552 INFO:teuthology.orchestra.run.smithi159.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-15T23:19:28.577 INFO:teuthology.orchestra.run.smithi159.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-09-15T23:19:28.611 INFO:teuthology.orchestra.run.smithi159.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-15T23:19:28.636 INFO:teuthology.orchestra.run.smithi159.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-15T23:19:28.678 INFO:teuthology.orchestra.run.smithi159.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-15T23:19:28.703 INFO:teuthology.orchestra.run.smithi159.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-15T23:19:28.737 INFO:teuthology.orchestra.run.smithi159.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-15T23:19:28.762 INFO:teuthology.orchestra.run.smithi159.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-15T23:19:28.787 INFO:teuthology.orchestra.run.smithi159.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-15T23:19:28.812 INFO:teuthology.orchestra.run.smithi159.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-15T23:19:28.838 INFO:teuthology.orchestra.run.smithi159.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-15T23:19:28.863 INFO:teuthology.orchestra.run.smithi159.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 788 kB/s | 20 kB 00:00 2024-09-15T23:19:28.989 INFO:teuthology.orchestra.run.smithi159.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.0 MB/s | 4.4 MB 00:00 2024-09-15T23:19:29.014 INFO:teuthology.orchestra.run.smithi159.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-15T23:19:29.039 INFO:teuthology.orchestra.run.smithi159.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.0 MB/s | 79 kB 00:00 2024-09-15T23:19:29.090 INFO:teuthology.orchestra.run.smithi159.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.0 MB/s | 2.0 MB 00:00 2024-09-15T23:19:29.144 INFO:teuthology.orchestra.run.smithi159.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 769 kB/s | 58 kB 00:00 2024-09-15T23:19:29.144 INFO:teuthology.orchestra.run.smithi159.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-15T23:19:29.165 INFO:teuthology.orchestra.run.smithi159.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 326 kB/s | 16 kB 00:00 2024-09-15T23:19:29.191 INFO:teuthology.orchestra.run.smithi159.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-15T23:19:29.204 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-15T23:19:29.217 INFO:teuthology.orchestra.run.smithi159.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 565 kB/s | 28 kB 00:00 2024-09-15T23:19:29.241 INFO:teuthology.orchestra.run.smithi159.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 615 kB/s | 31 kB 00:00 2024-09-15T23:19:29.267 INFO:teuthology.orchestra.run.smithi159.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-09-15T23:19:29.291 INFO:teuthology.orchestra.run.smithi159.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-09-15T23:19:29.317 INFO:teuthology.orchestra.run.smithi159.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-15T23:19:29.342 INFO:teuthology.orchestra.run.smithi159.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-15T23:19:29.356 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-15T23:19:29.356 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-15T23:19:29.367 INFO:teuthology.orchestra.run.smithi159.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 986 kB/s | 74 kB 00:00 2024-09-15T23:19:29.393 INFO:teuthology.orchestra.run.smithi159.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-15T23:19:29.418 INFO:teuthology.orchestra.run.smithi159.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-15T23:19:29.435 INFO:teuthology.orchestra.run.smithi159.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 478 kB/s | 20 kB 00:00 2024-09-15T23:19:29.460 INFO:teuthology.orchestra.run.smithi159.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-15T23:19:29.486 INFO:teuthology.orchestra.run.smithi159.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-15T23:19:29.553 INFO:teuthology.orchestra.run.smithi159.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-15T23:19:29.861 INFO:teuthology.orchestra.run.smithi159.stdout:(149/156): librbd1-19.1.1-326.g8921c8ef.el9.x86 8.4 MB/s | 3.2 MB 00:00 2024-09-15T23:19:29.970 INFO:teuthology.orchestra.run.smithi159.stdout:(150/156): librados2-19.1.1-326.g8921c8ef.el9.x 6.7 MB/s | 3.4 MB 00:00 2024-09-15T23:19:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-15T23:19:30.283 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-15T23:19:30.528 INFO:teuthology.orchestra.run.smithi159.stdout:(151/156): NetworkManager-team-1.49.90-1.el9.x8 73 kB/s | 41 kB 00:00 2024-09-15T23:19:30.820 INFO:teuthology.orchestra.run.smithi159.stdout:(152/156): NetworkManager-1.49.90-1.el9.x86_64. 1.8 MB/s | 2.3 MB 00:01 2024-09-15T23:19:30.870 INFO:teuthology.orchestra.run.smithi159.stdout:(153/156): NetworkManager-libnm-1.49.90-1.el9.x 1.8 MB/s | 1.8 MB 00:01 2024-09-15T23:19:31.238 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-15T23:19:31.238 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-15T23:19:31.287 INFO:teuthology.orchestra.run.smithi159.stdout:(154/156): NetworkManager-tui-1.49.90-1.el9.x86 328 kB/s | 249 kB 00:00 2024-09-15T23:19:32.021 INFO:teuthology.orchestra.run.smithi159.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.1 MB/s | 1.4 MB 00:01 2024-09-15T23:19:32.379 INFO:teuthology.orchestra.run.smithi159.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 1.6 MB/s | 2.4 MB 00:01 2024-09-15T23:19:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:19:32.386 INFO:teuthology.orchestra.run.smithi159.stdout:Total 12 MB/s | 226 MB 00:18 2024-09-15T23:19:33.622 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-09-15T23:19:33.775 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-09-15T23:19:33.775 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-09-15T23:19:35.580 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-09-15T23:19:35.580 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-09-15T23:19:36.563 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-15T23:19:36.694 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:19:36.786 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:19:37.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:19:37.053 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:19:37.081 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:19:37.267 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:19:37.593 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:19:37.671 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-15T23:19:37.687 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:37.789 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:19:37.809 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:37.836 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:19:37.838 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:37.898 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:19:37.930 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:37.932 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:19:37.957 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:19:37.960 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:19:38.000 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:19:38.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:19:38.181 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:19:38.209 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:38.311 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:38.329 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:19:38.335 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:38.397 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:38.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:38.439 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:38.441 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:38.563 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:38.584 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:38.646 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:38.675 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:38.705 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:19:38.809 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:38.862 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:19:38.919 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:19:38.945 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:19:38.947 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:39.051 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:39.053 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:39.073 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:39.127 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:39.136 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:39.158 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:39.184 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:39.351 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:39.376 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:39.457 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:19:39.503 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:39.543 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:19:39.591 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:19:39.625 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:19:39.670 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:19:39.689 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:19:39.734 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:19:39.766 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:19:39.775 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:39.810 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:19:39.843 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:19:39.850 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:39.870 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:19:39.938 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:19:39.992 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:19:40.023 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:19:40.058 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:19:40.066 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:40.134 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:19:40.178 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:19:40.187 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:19:40.221 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:19:40.250 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:19:40.281 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:19:40.309 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:19:40.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:19:40.343 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:19:40.365 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:19:40.409 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:19:40.446 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:19:40.453 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:19:40.485 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:19:40.529 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:19:40.561 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:19:40.579 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:19:40.580 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:19:40.633 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:19:40.658 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:19:40.711 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:19:40.742 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:19:40.777 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:19:40.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:19:40.888 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:19:40.939 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:19:40.968 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:19:41.038 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:19:41.091 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:19:41.164 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:19:41.165 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:19:41.246 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:19:41.275 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:19:41.298 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:19:41.318 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:19:41.353 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:19:41.356 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:19:41.420 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:19:41.575 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:19:41.650 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:19:41.713 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:19:41.794 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:19:41.826 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:19:41.862 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:19:41.871 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:19:41.908 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:19:41.915 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-09-15T23:19:41.945 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:19:41.956 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:19:41.986 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:19:41.987 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:19:42.016 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-15T23:19:42.028 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:19:42.030 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:19:42.062 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-15T23:19:42.066 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:19:42.111 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:19:42.116 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-15T23:19:42.165 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:19:42.167 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-15T23:19:42.193 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-15T23:19:42.232 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:19:42.235 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-15T23:19:42.276 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:19:42.323 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:19:42.378 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:19:42.402 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:19:42.451 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:19:42.483 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:19:42.519 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:19:42.557 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-15T23:19:42.566 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:19:42.602 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:19:42.645 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:19:42.668 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:19:42.685 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:42.687 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:19:42.707 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:19:42.754 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:19:42.789 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:19:42.791 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:19:42.820 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:42.822 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:19:42.822 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:19:42.881 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:19:42.894 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:19:42.921 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:19:42.924 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:19:42.930 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:19:43.024 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:19:43.056 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:19:43.059 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:19:43.071 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-15T23:19:43.087 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:19:43.090 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:19:43.113 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:19:43.121 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-15T23:19:43.124 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:19:43.137 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:19:43.149 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:43.165 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:19:43.200 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:19:43.233 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:19:43.243 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:19:43.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:19:43.267 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:43.296 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:19:43.312 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 14/164 2024-09-15T23:19:43.330 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:19:43.334 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:43.360 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-15T23:19:43.371 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:19:43.405 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:19:43.446 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:19:43.491 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:19:43.536 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:19:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:43.567 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:19:43.670 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:19:43.675 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:19:43.697 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-15T23:19:43.712 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:19:43.718 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:19:43.740 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:19:43.774 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:19:43.813 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:19:43.824 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 17/164 2024-09-15T23:19:43.845 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:19:43.875 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:19:43.909 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:19:43.910 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:43.943 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:19:43.984 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:19:44.001 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:44.019 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:19:44.105 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:19:44.149 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:19:44.181 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:19:44.221 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 18/164 2024-09-15T23:19:44.284 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:19:44.338 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-15T23:19:44.340 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:19:44.433 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-15T23:19:44.441 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:19:44.480 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-15T23:19:44.482 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:19:44.515 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-15T23:19:44.516 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:19:44.579 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-15T23:19:44.621 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:19:44.624 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-15T23:19:44.656 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-15T23:19:44.670 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:19:44.700 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-15T23:19:44.736 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-15T23:19:44.744 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:19:44.764 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-15T23:19:44.827 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:19:44.832 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-15T23:19:44.860 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:19:44.886 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-15T23:19:44.918 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-15T23:19:44.977 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-15T23:19:45.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:19:45.058 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:19:45.061 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-15T23:19:45.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:19:45.096 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 34/164 2024-09-15T23:19:45.106 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:19:45.140 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 35/164 2024-09-15T23:19:45.140 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:19:45.152 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:19:45.168 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 36/164 2024-09-15T23:19:45.237 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:19:45.237 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-15T23:19:45.283 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-15T23:19:45.295 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:19:45.340 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:19:45.357 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-15T23:19:45.427 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:19:45.459 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:19:45.490 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-15T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-15T23:19:45.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:19:45.673 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:19:45.751 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:19:45.810 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:19:45.922 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:19:46.062 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-15T23:19:46.139 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-15T23:19:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-15T23:19:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-15T23:19:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 46/164 2024-09-15T23:19:46.308 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-15T23:19:46.393 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:19:46.463 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-15T23:19:46.513 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:19:46.527 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-15T23:19:46.582 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-15T23:19:46.655 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-15T23:19:46.697 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-15T23:19:46.733 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-15T23:19:46.780 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-15T23:19:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-15T23:19:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-15T23:19:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-15T23:19:47.043 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-15T23:19:47.086 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-15T23:19:47.127 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-15T23:19:47.173 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:19:47.229 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-15T23:19:47.261 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:19:47.261 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-15T23:19:47.280 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:19:47.305 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:19:47.309 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-15T23:19:47.343 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-15T23:19:47.368 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-15T23:19:47.443 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-15T23:19:47.568 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-15T23:19:47.614 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:19:47.651 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:47.724 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:19:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-15T23:19:47.741 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:47.773 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:19:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-15T23:19:47.795 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:19:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-15T23:19:47.814 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:19:47.823 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:19:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-15T23:19:47.856 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:19:47.892 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-15T23:19:47.922 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-15T23:19:47.956 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-15T23:19:47.994 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-15T23:19:48.165 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:19:48.174 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-15T23:19:48.219 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:48.297 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:19:48.309 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:48.329 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:48.341 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:19:48.377 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:19:48.394 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-15T23:19:48.400 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:48.430 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:19:48.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-15T23:19:48.539 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-15T23:19:48.569 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-15T23:19:48.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-15T23:19:48.736 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-15T23:19:48.857 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:19:48.889 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:48.960 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:48.982 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:19:49.455 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-15T23:19:49.501 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-15T23:19:49.542 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-15T23:19:49.640 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-15T23:19:49.710 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-15T23:19:49.759 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-15T23:19:49.846 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-15T23:19:49.887 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-15T23:19:50.071 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-15T23:19:50.093 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-15T23:19:50.171 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-15T23:19:50.725 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:50.760 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:50.810 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-15T23:19:50.924 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-15T23:19:51.274 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:51.312 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:51.335 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:51.396 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:51.486 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:51.487 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:19:51.487 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:19:51.487 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:19:51.524 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:19:51.857 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:51.899 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:51.994 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:51.994 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:19:51.994 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:19:51.994 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:19:52.034 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:19:52.145 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-15T23:19:52.241 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-15T23:19:52.269 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-15T23:19:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-15T23:19:52.612 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-15T23:19:52.656 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:52.747 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 101/164 2024-09-15T23:19:52.778 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 102/164 2024-09-15T23:19:52.814 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-15T23:19:53.293 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-15T23:19:53.326 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:53.398 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 105/164 2024-09-15T23:19:53.436 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 106/164 2024-09-15T23:19:56.013 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:56.041 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:56.585 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 107/164 2024-09-15T23:19:56.636 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:56.722 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 108/164 2024-09-15T23:19:56.723 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-15T23:19:56.723 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-15T23:19:56.723 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:19:56.754 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-15T23:20:03.344 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:03.518 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:03.534 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:03.534 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:03.534 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:20:03.534 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:04.007 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-09-15T23:20:04.008 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-09-15T23:20:04.009 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:04.181 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:04.197 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:04.197 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:20:04.197 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:05.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:05.031 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:05.031 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:05.032 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:20:05.032 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:05.032 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:05.032 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:05.273 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:05.301 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:05.302 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:05.302 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:20:05.302 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:05.302 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:05.302 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:05.684 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:05.711 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:05.711 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:05.711 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:20:05.712 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:05.712 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:05.712 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:05.740 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:05.764 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:05.764 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:05.764 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:20:05.764 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:05.765 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:05.765 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:05.871 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:20:05.928 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:20:05.943 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:05.966 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:05.967 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:05.967 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:20:05.967 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:05.967 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:05.967 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:05.983 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:20:06.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:20:06.216 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:20:06.293 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:20:06.383 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:20:06.403 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:06.426 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:06.522 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:20:06.532 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:20:06.572 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:20:06.581 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:20:06.615 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:20:06.636 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:20:06.642 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:20:06.821 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:20:06.870 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:20:06.939 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:20:07.028 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:20:07.064 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:07.091 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:07.122 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:20:07.158 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:20:07.185 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:20:07.204 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:20:07.222 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:07.235 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:20:07.264 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:20:07.718 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:07.746 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:07.777 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:20:07.839 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:20:07.869 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:08.263 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:08.299 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 109/164 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-09-15T23:20:08.706 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-09-15T23:20:08.707 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-09-15T23:20:08.707 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:08.883 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:08.899 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 110/164 2024-09-15T23:20:08.899 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:08.899 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-15T23:20:08.899 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:08.910 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:08.945 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:20:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:20:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:20:09.910 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:09.938 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:10.040 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:10.210 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:20:10.241 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:10.264 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:10.264 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.265 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:20:10.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:10.265 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:10.265 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:10.316 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:10.327 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:10.386 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 111/164 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-15T23:20:10.415 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:10.424 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:20:10.472 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:20:10.645 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:10.669 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 112/164 2024-09-15T23:20:10.669 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.669 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-15T23:20:10.670 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:10.670 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-15T23:20:10.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:10.767 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:20:10.796 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:10.820 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:10.864 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:10.886 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.886 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:20:10.886 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:10.931 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:10.953 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:10.954 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:10.954 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:20:10.954 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:10.954 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:10.954 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 113/164 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-15T23:20:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:11.234 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-15T23:20:11.256 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:11.279 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:11.279 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.280 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:20:11.280 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:11.280 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:11.280 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:11.291 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-15T23:20:11.347 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-15T23:20:11.394 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:20:11.418 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:11.441 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:11.442 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:11.486 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:11.508 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:11.509 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.509 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:20:11.509 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:11.533 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-15T23:20:11.553 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:11.575 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:11.576 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.576 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:20:11.576 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:11.576 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:11.576 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-15T23:20:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-15T23:20:11.755 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-15T23:20:11.888 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:11.893 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:11.910 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:11.939 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-15T23:20:11.971 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-15T23:20:11.998 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-15T23:20:12.479 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:12.506 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 125/164 2024-09-15T23:20:12.537 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 126/164 2024-09-15T23:20:12.600 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 127/164 2024-09-15T23:20:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:13.670 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 128/164 2024-09-15T23:20:13.714 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:14.677 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 129/164 2024-09-15T23:20:14.714 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:14.817 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 130/164 2024-09-15T23:20:14.984 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 131/164 2024-09-15T23:20:15.033 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:15.057 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 132/164 2024-09-15T23:20:15.057 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:15.057 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-15T23:20:15.057 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:15.058 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-15T23:20:15.058 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:15.117 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:15.129 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 133/164 2024-09-15T23:20:15.229 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 134/164 2024-09-15T23:20:15.282 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 135/164 2024-09-15T23:20:15.860 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:20:15.901 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:20:15.942 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:20:15.974 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:20:15.993 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:20:16.179 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:20:16.209 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-15T23:20:16.231 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:20:16.236 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:16.260 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 137/164 2024-09-15T23:20:16.261 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:16.261 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-15T23:20:16.261 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:16.261 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-15T23:20:16.261 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:16.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:20:16.292 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:20:16.304 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:16.327 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-326.g8921c8 138/164 2024-09-15T23:20:16.328 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:16.328 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-15T23:20:16.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:16.346 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:20:16.379 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:16.403 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 139/164 2024-09-15T23:20:16.403 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:16.403 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-15T23:20:16.403 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:16.403 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-15T23:20:16.404 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:16.449 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:20:16.490 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:20:16.531 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:20:16.563 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:20:16.582 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:20:16.705 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:16.729 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 140/164 2024-09-15T23:20:16.729 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-15T23:20:16.729 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-15T23:20:16.729 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:16.729 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-15T23:20:16.730 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:16.754 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:20:16.796 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:20:16.826 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:20:16.856 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:20:16.894 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:20:16.946 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:16.985 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:17.005 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:17.467 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:17.509 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:17.529 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:17.831 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:20:17.923 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:20:17.971 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:20:18.060 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:20:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:20:18.143 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:20:18.177 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:20:18.177 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:18.253 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:18.337 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:18.360 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:20:18.362 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:20:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:18.367 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:18.448 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:20:18.489 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:20:18.547 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:18.547 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:18.572 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:20:18.609 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:20:18.634 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:20:18.640 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:20:18.661 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:18.704 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:18.745 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:18.745 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:18.829 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:18.854 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:20:18.859 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:18.862 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:19.039 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:19.039 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:19.107 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:19.170 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:21.250 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 141/164 2024-09-15T23:20:21.292 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 142/164 2024-09-15T23:20:21.333 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 143/164 2024-09-15T23:20:21.365 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-15T23:20:21.392 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-15T23:20:21.573 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 146/164 2024-09-15T23:20:21.614 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-15T23:20:21.644 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 148/164 2024-09-15T23:20:21.674 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 149/164 2024-09-15T23:20:21.728 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 150/164 2024-09-15T23:20:22.351 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:22.393 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:22.414 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-15T23:20:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 152/164 2024-09-15T23:20:23.339 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-15T23:20:23.380 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-15T23:20:23.460 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-15T23:20:23.509 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-15T23:20:23.534 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-15T23:20:23.561 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-15T23:20:23.561 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:23.653 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-15T23:20:23.654 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:23.762 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-15T23:20:23.787 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-15T23:20:23.793 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:23.793 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:23.972 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-15T23:20:23.972 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:24.057 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-15T23:20:24.127 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:24.233 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:24.233 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:20:24.234 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:20:24.235 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:20:24.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:20:24.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:20:24.236 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:20:24.248 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:20:24.249 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:20:24.250 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:20:24.251 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:20:24.252 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:20:24.253 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:20:24.254 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:20:24.255 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:20:24.256 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:20:24.257 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:20:24.823 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:20:24.824 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:20:24.825 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:20:24.837 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:20:24.838 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:20:24.839 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:20:24.840 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:20:24.841 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:20:24.842 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:20:24.843 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:20:24.844 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:20:24.845 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:20:24.846 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:20:24.847 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:20:27.015 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.016 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.017 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.018 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:20:27.019 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.020 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:20:27.021 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.022 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:20:27.023 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:27.024 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:20:27.025 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:20:27.026 INFO:teuthology.orchestra.run.smithi077.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:20:27.027 INFO:teuthology.orchestra.run.smithi077.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:20:27.028 INFO:teuthology.orchestra.run.smithi077.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:20:27.028 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:20:27.028 INFO:teuthology.orchestra.run.smithi077.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:20:27.028 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:20:27.028 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-15T23:20:27.443 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:27.495 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:27.495 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:20:27.496 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.497 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.498 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.499 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:20:27.500 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:20:27.501 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:20:27.502 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:20:27.503 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:20:27.504 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.505 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:20:27.506 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:20:27.507 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:20:27.508 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:20:27.508 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-15T23:20:27.903 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 1/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 3/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 4/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-326.g8921c8 5/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 6/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 7/164 2024-09-15T23:20:29.780 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 8/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 9/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 10/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 11/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 12/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 13/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 14/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_6 15/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 16/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 17/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 18/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_ 19/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 20/164 2024-09-15T23:20:29.781 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9 21/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x 22/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 23/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 24/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 25/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 26/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 27/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 28/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 29/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.e 30/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noar 31/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.no 32/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-326.g8921 33/164 2024-09-15T23:20:29.782 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9 34/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 35/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el 36/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 37/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 38/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 39/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-15T23:20:29.783 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-15T23:20:29.784 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-15T23:20:29.785 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-15T23:20:29.786 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-15T23:20:29.787 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-15T23:20:29.788 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-15T23:20:29.789 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-15T23:20:29.790 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 149/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 151/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 153/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 155/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 157/164 2024-09-15T23:20:29.791 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-15T23:20:29.792 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 159/164 2024-09-15T23:20:29.792 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-15T23:20:29.792 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-15T23:20:29.792 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-15T23:20:29.792 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-15T23:20:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.1.1-326.g8921c8ef.el9.noarch 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-15T23:20:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-15T23:20:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.16-1.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-15T23:20:32.567 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-15T23:20:32.568 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-15T23:20:32.569 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-15T23:20:32.570 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.571 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-15T23:20:32.572 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.1.1-326.g8921c8ef.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-20.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-15T23:20:32.573 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-15T23:20:32.574 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-15T23:20:32.574 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:20:32.574 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-09-15T23:20:32.978 DEBUG:teuthology.parallel:result is None 2024-09-15T23:20:32.978 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:33.153 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:20:33.180 INFO:teuthology.orchestra.run.smithi077.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.180 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.181 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:20:33.183 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:33.332 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:20:33.359 INFO:teuthology.orchestra.run.smithi155.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.359 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.360 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:20:33.362 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:33.505 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-15T23:20:33.529 INFO:teuthology.orchestra.run.smithi159.stdout:19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.529 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326.g8921c8ef.el9 2024-09-15T23:20:33.529 INFO:teuthology.task.install:The correct ceph version 19.1.1-326.g8921c8ef is installed. 2024-09-15T23:20:33.532 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T23:20:33.532 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:20:33.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:20:33.565 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:20:33.565 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:20:33.598 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:20:33.598 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T23:20:33.626 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T23:20:33.627 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:20:33.627 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:20:33.657 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:20:33.728 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:20:33.728 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:20:33.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:20:33.827 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:20:33.827 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T23:20:33.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T23:20:33.918 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T23:20:33.918 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:20:33.918 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:20:33.947 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:20:34.015 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:20:34.015 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:20:34.044 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:20:34.114 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:20:34.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T23:20:34.139 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T23:20:34.204 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T23:20:34.204 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:20:34.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:20:34.233 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:20:34.303 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:20:34.303 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:20:34.333 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:20:34.403 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:20:34.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T23:20:34.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T23:20:34.493 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-15T23:20:34.597 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-15T23:20:34.597 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:34.597 INFO:tasks.cephadm:Cluster fsid is 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:20:34.598 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-15T23:20:34.598 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.77', 'mon.b': '172.21.15.155', 'mon.c': '172.21.15.159'} 2024-09-15T23:20:34.598 INFO:tasks.cephadm:First mon is mon.a on smithi077 2024-09-15T23:20:34.598 INFO:tasks.cephadm:First mgr is x 2024-09-15T23:20:34.598 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-15T23:20:34.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo hostname $(hostname -s) 2024-09-15T23:20:34.628 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2024-09-15T23:20:34.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-09-15T23:20:34.683 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-15T23:20:34.684 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:34.825 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56081/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-326-g8921c8ef', 'node_name': '172.21.5.31+adami01', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-326.g8921c8ef'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-15 16:06:42.385367', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-15T23:20:34.968 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid, sha1 8921c8ef947807b717db041d85f0761b7914d5fc from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:20:34.970 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T23:20:34.970 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm 2024-09-15T23:20:34.970 DEBUG:teuthology.orchestra.run.smithi077:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:35.360 INFO:teuthology.orchestra.run.smithi077.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:20 /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:35.360 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:35.713 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:20 /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:35.714 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:36.088 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 784481 Sep 15 23:20 /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:36.089 DEBUG:teuthology.orchestra.run.smithi077:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:36.109 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:36.128 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-15T23:20:36.165 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc on all hosts... 2024-09-15T23:20:36.165 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:20:36.168 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:20:36.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc pull 2024-09-15T23:20:37.680 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:20:37.686 INFO:teuthology.orchestra.run.smithi077.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:20:37.797 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:21:12.424 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-15T23:21:12.425 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout: "repo_digests": [ 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:21:26.613 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:21:32.646 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-15T23:21:32.646 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:21:32.646 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee", 2024-09-15T23:21:32.646 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2024-09-15T23:21:32.646 INFO:teuthology.orchestra.run.smithi155.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80" 2024-09-15T23:21:32.647 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-09-15T23:21:32.647 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-15T23:21:32.671 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph 2024-09-15T23:21:32.705 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2024-09-15T23:21:32.733 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-09-15T23:21:32.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /etc/ceph 2024-09-15T23:21:32.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2024-09-15T23:21:32.821 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-09-15T23:21:32.850 INFO:tasks.cephadm:Writing seed config... 2024-09-15T23:21:32.851 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-15T23:21:32.851 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-15T23:21:32.852 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-15T23:21:32.853 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-15T23:21:32.854 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-15T23:21:32.855 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-15T23:21:32.856 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:21:32.856 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-15T23:21:32.873 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1be60238-73b9-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-15T23:21:32.874 DEBUG:teuthology.orchestra.run.smithi077:mon.a> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service 2024-09-15T23:21:32.915 DEBUG:teuthology.orchestra.run.smithi077:mgr.x> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service 2024-09-15T23:21:32.958 INFO:tasks.cephadm:Bootstrapping... 2024-09-15T23:21:32.958 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc -v bootstrap --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.77 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-15T23:21:33.160 INFO:teuthology.orchestra.run.smithi077.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc', '-v', 'bootstrap', '--fsid', '1be60238-73b9-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.77', '--skip-admin-label'] 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi077.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-15T23:21:33.161 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying podman|docker is present... 2024-09-15T23:21:33.185 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 5.2.2 2024-09-15T23:21:33.185 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying lvm2 is present... 2024-09-15T23:21:33.185 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying time synchronization is in place... 2024-09-15T23:21:33.192 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T23:21:33.192 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T23:21:33.198 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T23:21:33.199 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:21:33.205 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-09-15T23:21:33.211 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-09-15T23:21:33.212 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-09-15T23:21:33.212 INFO:teuthology.orchestra.run.smithi077.stdout:Repeating the final host check... 2024-09-15T23:21:33.234 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout 5.2.2 2024-09-15T23:21:33.234 INFO:teuthology.orchestra.run.smithi077.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-15T23:21:33.234 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl is present 2024-09-15T23:21:33.234 INFO:teuthology.orchestra.run.smithi077.stdout:lvcreate is present 2024-09-15T23:21:33.240 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-15T23:21:33.240 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-15T23:21:33.246 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-15T23:21:33.246 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:21:33.253 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout enabled 2024-09-15T23:21:33.259 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout active 2024-09-15T23:21:33.259 INFO:teuthology.orchestra.run.smithi077.stdout:Unit chronyd.service is enabled and running 2024-09-15T23:21:33.259 INFO:teuthology.orchestra.run.smithi077.stdout:Host looks OK 2024-09-15T23:21:33.259 INFO:teuthology.orchestra.run.smithi077.stdout:Cluster fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:33.259 INFO:teuthology.orchestra.run.smithi077.stdout:Acquiring lock 140162081678336 on /run/cephadm/1be60238-73b9-11ef-bceb-c7b262605968.lock 2024-09-15T23:21:33.260 INFO:teuthology.orchestra.run.smithi077.stdout:Lock 140162081678336 acquired on /run/cephadm/1be60238-73b9-11ef-bceb-c7b262605968.lock 2024-09-15T23:21:33.260 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 3300 ... 2024-09-15T23:21:33.260 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying IP 172.21.15.77 port 6789 ... 2024-09-15T23:21:33.260 INFO:teuthology.orchestra.run.smithi077.stdout:Base mon IP(s) is [172.21.15.77:3300, 172.21.15.77:6789], mon addrv is [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-09-15T23:21:33.263 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.77 metric 100 2024-09-15T23:21:33.264 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.77 metric 100 2024-09-15T23:21:33.266 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-15T23:21:33.266 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-15T23:21:33.266 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-15T23:21:33.269 INFO:teuthology.orchestra.run.smithi077.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-15T23:21:33.270 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-09-15T23:21:33.270 INFO:teuthology.orchestra.run.smithi077.stdout:Mon IP `172.21.15.77` is in CIDR network `172.21.0.0/20` 2024-09-15T23:21:33.270 INFO:teuthology.orchestra.run.smithi077.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-15T23:21:33.270 INFO:teuthology.orchestra.run.smithi077.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-15T23:21:33.271 INFO:teuthology.orchestra.run.smithi077.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stdout f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc... 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Getting image source signatures 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:c0574da0c3174f3dc49daa274908f97d06456bd6a3cfab87e94022c1369a83a6 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Copying config sha256:f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee 2024-09-15T23:21:33.681 INFO:teuthology.orchestra.run.smithi077.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-15T23:21:34.619 INFO:teuthology.orchestra.run.smithi077.stdout:ceph: stdout ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T23:21:34.619 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph version: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable) 2024-09-15T23:21:34.619 INFO:teuthology.orchestra.run.smithi077.stdout:Extracting ceph user uid/gid from container image... 2024-09-15T23:21:35.591 INFO:teuthology.orchestra.run.smithi077.stdout:stat: stdout 167 167 2024-09-15T23:21:35.591 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial keys... 2024-09-15T23:21:36.472 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQD/a+dmujiBNxAAb6XGDW7vjdI4rb8xJUgjNw== 2024-09-15T23:21:37.360 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQAAbOdm2VZhLhAAOcwUDEtX4Dmojv6OSbP4+g== 2024-09-15T23:21:38.299 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph-authtool: stdout AQABbOdmvOH4JxAAupNx5tp1+DaazJ+niX8Tvg== 2024-09-15T23:21:38.300 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial monmap... 2024-09-15T23:21:39.214 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:monmaptool for a [v2:172.21.15.77:3300,v1:172.21.15.77:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:setting min_mon_release = quincy 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: set fsid to 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:21:39.215 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mon... 2024-09-15T23:21:47.011 INFO:teuthology.orchestra.run.smithi077.stdout:create mon.a on 2024-09-15T23:21:47.439 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-15T23:21:47.790 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-15T23:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target. 2024-09-15T23:21:48.235 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target. 2024-09-15T23:21:48.759 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a 2024-09-15T23:21:48.759 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-15T23:21:48.925 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target.wants/ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968@.service. 2024-09-15T23:21:49.444 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:21:49.444 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon to start... 2024-09-15T23:21:49.451 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mon... 2024-09-15T23:21:49.572 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:49 smithi077 systemd[1]: Started Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:21:50.408 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout cluster: 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout id: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout services: 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.557716s) 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout data: 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-15T23:21:50.409 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout pgs: 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.873+0000 7f1a6370c640 1 Processor -- start 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a6370c640 1 -- start start 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a6370c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a6370c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c105fc0 con 0x7f1a5c107a80 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a614a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a614a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59920/0 (socket says 172.21.15.77:59920) 2024-09-15T23:21:50.410 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.874+0000 7f1a614a8640 1 -- 172.21.15.77:0/891692210 learned_addr learned my addr 172.21.15.77:0/891692210 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.875+0000 7f1a614a8640 1 -- 172.21.15.77:0/891692210 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c106140 con 0x7f1a5c107a80 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.877+0000 7f1a614a8640 1 --2- 172.21.15.77:0/891692210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009820 tx=0x7f1a4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8569a4cfa31746 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.877+0000 7f1a53fff640 1 -- 172.21.15.77:0/891692210 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4c037070 con 0x7f1a5c107a80 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.877+0000 7f1a53fff640 1 -- 172.21.15.77:0/891692210 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c032440 con 0x7f1a5c107a80 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.877+0000 7f1a53fff640 1 -- 172.21.15.77:0/891692210 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4c032740 con 0x7f1a5c107a80 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- 172.21.15.77:0/891692210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 msgr2=0x7f1a5c107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 --2- 172.21.15.77:0/891692210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009820 tx=0x7f1a4c02a270 comp rx=0 tx=0).stop 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- 172.21.15.77:0/891692210 shutdown_connections 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 --2- 172.21.15.77:0/891692210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c107e80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- 172.21.15.77:0/891692210 >> 172.21.15.77:0/891692210 conn(0x7f1a5c101af0 msgr2=0x7f1a5c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- 172.21.15.77:0/891692210 shutdown_connections 2024-09-15T23:21:50.411 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- 172.21.15.77:0/891692210 wait complete. 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 Processor -- start 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- start start 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.878+0000 7f1a6370c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c1066e0 con 0x7f1a5c107a80 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a614a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a614a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59932/0 (socket says 172.21.15.77:59932) 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a614a8640 1 -- 172.21.15.77:0/4037797353 learned_addr learned my addr 172.21.15.77:0/4037797353 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a614a8640 1 -- 172.21.15.77:0/4037797353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c19a1a0 con 0x7f1a5c107a80 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a614a8640 1 --2- 172.21.15.77:0/4037797353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009820 tx=0x7f1a4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4c041070 con 0x7f1a5c107a80 2024-09-15T23:21:50.412 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a4c03c7a0 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a4c037040 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c19a430 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5c19d120 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1a4c044070 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.879+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1a4c046dd0 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.880+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5c106d30 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.882+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1a4c046450 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.941+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f1a5c19d5d0 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.941+0000 7f1a527fc640 1 -- 172.21.15.77:0/4037797353 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f1a4c046630 con 0x7f1a5c107a80 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 msgr2=0x7f1a5c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 --2- 172.21.15.77:0/4037797353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009820 tx=0x7f1a4c0046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.413 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 shutdown_connections 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 --2- 172.21.15.77:0/4037797353 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1a5c107a80 0x7f1a5c199c60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 >> 172.21.15.77:0/4037797353 conn(0x7f1a5c101af0 msgr2=0x7f1a5c18ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 shutdown_connections 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:49.942+0000 7f1a6370c640 1 -- 172.21.15.77:0/4037797353 wait complete. 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:mon is available 2024-09-15T23:21:50.414 INFO:teuthology.orchestra.run.smithi077.stdout:Assimilating anything we can from ceph.conf... 2024-09-15T23:21:50.521 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T23:21:50.521 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: monmap epoch 1 2024-09-15T23:21:50.521 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:50.521 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: last_changed 2024-09-15T23:21:38.646735+0000 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: min_mon_release 19 (squid) 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: election_strategy: 1 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: fsmap 2024-09-15T23:21:50.522 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T23:21:50.523 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: mgrmap e1: no daemons active 2024-09-15T23:21:50.523 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:50 smithi077 ceph-mon[30592]: from='client.? 172.21.15.77:0/4037797353' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-15T23:21:51.434 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:51.434 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T23:21:51.435 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.830+0000 7efd0d029640 1 Processor -- start 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd0d029640 1 -- start start 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd0d029640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd0d029640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd08106d90 con 0x7efd081063c0 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59940/0 (socket says 172.21.15.77:59940) 2024-09-15T23:21:51.436 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd06d9d640 1 -- 172.21.15.77:0/943898291 learned_addr learned my addr 172.21.15.77:0/943898291 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.831+0000 7efd06d9d640 1 -- 172.21.15.77:0/943898291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd081075c0 con 0x7efd081063c0 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.832+0000 7efd06d9d640 1 --2- 172.21.15.77:0/943898291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009820 tx=0x7efcf002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b451496dbbe6d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.832+0000 7efd05d9b640 1 -- 172.21.15.77:0/943898291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0037070 con 0x7efd081063c0 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.832+0000 7efd05d9b640 1 -- 172.21.15.77:0/943898291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0032440 con 0x7efd081063c0 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.832+0000 7efd05d9b640 1 -- 172.21.15.77:0/943898291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0032740 con 0x7efd081063c0 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 -- 172.21.15.77:0/943898291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 msgr2=0x7efd081067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 --2- 172.21.15.77:0/943898291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009820 tx=0x7efcf002a270 comp rx=0 tx=0).stop 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 -- 172.21.15.77:0/943898291 shutdown_connections 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 --2- 172.21.15.77:0/943898291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd081067c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 -- 172.21.15.77:0/943898291 >> 172.21.15.77:0/943898291 conn(0x7efd08101b90 msgr2=0x7efd08103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 -- 172.21.15.77:0/943898291 shutdown_connections 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 -- 172.21.15.77:0/943898291 wait complete. 2024-09-15T23:21:51.437 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.833+0000 7efd0d029640 1 Processor -- start 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd0d029640 1 -- start start 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd0d029640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd0d029640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efd08107b60 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd06d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59954/0 (socket says 172.21.15.77:59954) 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd06d9d640 1 -- 172.21.15.77:0/1497943654 learned_addr learned my addr 172.21.15.77:0/1497943654 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd06d9d640 1 -- 172.21.15.77:0/1497943654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0819b210 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.834+0000 7efd06d9d640 1 --2- 172.21.15.77:0/1497943654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efcf00090b0 tx=0x7efcf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0041070 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf003c7a0 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0819b4a0 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0037040 con 0x7efd081063c0 2024-09-15T23:21:51.438 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0819e180 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efcf0044070 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.835+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7efcf003d3f0 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.836+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd081081b0 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.838+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7efcf0046450 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.894+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7efd0819f8e0 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.897+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7efcf0046630 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 msgr2=0x7efd0819acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 --2- 172.21.15.77:0/1497943654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7efcf00090b0 tx=0x7efcf00046c0 comp rx=0 tx=0).stop 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efcfffff640 1 -- 172.21.15.77:0/1497943654 <== mon.0 v2:172.21.15.77:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcf0056070 con 0x7efd081063c0 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 shutdown_connections 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 --2- 172.21.15.77:0/1497943654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efd081063c0 0x7efd0819acd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 >> 172.21.15.77:0/1497943654 conn(0x7efd08101b90 msgr2=0x7efd0807b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:51.439 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 shutdown_connections 2024-09-15T23:21:51.440 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:50.898+0000 7efd0d029640 1 -- 172.21.15.77:0/1497943654 wait complete. 2024-09-15T23:21:51.440 INFO:teuthology.orchestra.run.smithi077.stdout:Generating new minimal ceph.conf... 2024-09-15T23:21:51.543 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:51 smithi077 ceph-mon[30592]: from='client.? 172.21.15.77:0/1497943654' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T23:21:51.543 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:51 smithi077 ceph-mon[30592]: from='client.? 172.21.15.77:0/1497943654' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-15T23:21:52.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:52 smithi077 ceph-mon[30592]: from='client.? 172.21.15.77:0/3773494667' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:21:52.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.839+0000 7f488341e640 1 Processor -- start 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f488341e640 1 -- start start 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f488341e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f488341e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f487c105fc0 con 0x7f487c107a80 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f48811ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f48811ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59960/0 (socket says 172.21.15.77:59960) 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f48811ba640 1 -- 172.21.15.77:0/400966754 learned_addr learned my addr 172.21.15.77:0/400966754 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.840+0000 7f48811ba640 1 -- 172.21.15.77:0/400966754 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c106140 con 0x7f487c107a80 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.841+0000 7f48811ba640 1 --2- 172.21.15.77:0/400966754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4878009820 tx=0x7f487802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7a2fb4b5bb7c46a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.841+0000 7f4873fff640 1 -- 172.21.15.77:0/400966754 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878037070 con 0x7f487c107a80 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.841+0000 7f4873fff640 1 -- 172.21.15.77:0/400966754 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4878032900 con 0x7f487c107a80 2024-09-15T23:21:52.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.841+0000 7f4873fff640 1 -- 172.21.15.77:0/400966754 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878030850 con 0x7f487c107a80 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 -- 172.21.15.77:0/400966754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 msgr2=0x7f487c107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 --2- 172.21.15.77:0/400966754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4878009820 tx=0x7f487802a270 comp rx=0 tx=0).stop 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 -- 172.21.15.77:0/400966754 shutdown_connections 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 --2- 172.21.15.77:0/400966754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c107e80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 -- 172.21.15.77:0/400966754 >> 172.21.15.77:0/400966754 conn(0x7f487c101af0 msgr2=0x7f487c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 -- 172.21.15.77:0/400966754 shutdown_connections 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.842+0000 7f488341e640 1 -- 172.21.15.77:0/400966754 wait complete. 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f488341e640 1 Processor -- start 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f488341e640 1 -- start start 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f488341e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f488341e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f487c10a950 con 0x7f487c107a80 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f48811ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:52.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f48811ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59970/0 (socket says 172.21.15.77:59970) 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.843+0000 7f48811ba640 1 -- 172.21.15.77:0/3773494667 learned_addr learned my addr 172.21.15.77:0/3773494667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48811ba640 1 -- 172.21.15.77:0/3773494667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c19bb50 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48811ba640 1 --2- 172.21.15.77:0/3773494667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4878009940 tx=0x7f4878032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878042070 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48780308c0 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c19bde0 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4878037040 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c19ead0 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.844+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4878045070 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.845+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4878047bc0 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.846+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c107f00 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.848+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f48780327b0 con 0x7f487c107a80 2024-09-15T23:21:52.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.912+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f487c19ef40 con 0x7f487c107a80 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.912+0000 7f48727fc640 1 -- 172.21.15.77:0/3773494667 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f487803c800 con 0x7f487c107a80 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 msgr2=0x7f487c19b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 --2- 172.21.15.77:0/3773494667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4878009940 tx=0x7f4878032ce0 comp rx=0 tx=0).stop 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 shutdown_connections 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 --2- 172.21.15.77:0/3773494667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f487c107a80 0x7f487c19b610 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 >> 172.21.15.77:0/3773494667 conn(0x7f487c101af0 msgr2=0x7f487c102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 shutdown_connections 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:51.913+0000 7f488341e640 1 -- 172.21.15.77:0/3773494667 wait complete. 2024-09-15T23:21:52.760 INFO:teuthology.orchestra.run.smithi077.stdout:Restarting the monitor... 2024-09-15T23:21:53.011 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:52 smithi077 systemd[1]: Stopping Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:21:53.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a[30588]: 2024-09-15T23:21:53.009+0000 7f1757f0e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:21:53.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a[30588]: 2024-09-15T23:21:53.009+0000 7f1757f0e640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-15T23:21:53.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 podman[30830]: 2024-09-15 23:21:53.163688599 +0000 UTC m=+0.237084079 container died c70aa3be1dce854aead368bbfa615bf027a1f354873df462e98e37ed6ae44f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T23:21:53.686 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 podman[30830]: 2024-09-15 23:21:53.468271559 +0000 UTC m=+0.541667027 container cleanup c70aa3be1dce854aead368bbfa615bf027a1f354873df462e98e37ed6ae44f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T23:21:53.686 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 bash[30830]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a 2024-09-15T23:21:54.016 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 podman[30842]: 2024-09-15 23:21:53.685608162 +0000 UTC m=+0.520457455 container remove c70aa3be1dce854aead368bbfa615bf027a1f354873df462e98e37ed6ae44f83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T23:21:54.016 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-15T23:21:54.016 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 systemd[1]: Stopped Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:21:54.016 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:53 smithi077 systemd[1]: Starting Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:21:54.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:54 smithi077 podman[30938]: 2024-09-15 23:21:53.918698152 +0000 UTC m=+0.015689699 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T23:21:55.284 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:55 smithi077 podman[30938]: 2024-09-15 23:21:55.029770667 +0000 UTC m=+1.126762207 container create 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:21:56.459 INFO:teuthology.orchestra.run.smithi077.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-15T23:21:56.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 podman[30938]: 2024-09-15 23:21:56.37122669 +0000 UTC m=+2.468218230 container init 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 podman[30938]: 2024-09-15 23:21:56.374446903 +0000 UTC m=+2.471438441 container start 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: pidfile_write: ignore empty --pid-file 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: load: jerasure load: lrc 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: RocksDB version: 7.9.2 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Git sha 0 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: DB SUMMARY 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: DB Session ID: 4LOLGRDVE056UC7VGYUY 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: CURRENT file: CURRENT 2024-09-15T23:21:56.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104234 ; 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.error_if_exists: 0 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.create_if_missing: 0 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.paranoid_checks: 1 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.env: 0x55bd42c4a940 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.info_log: 0x55bd43ae56e0 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T23:21:56.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.statistics: (nil) 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.use_fsync: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_log_file_size: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_fallocate: 1 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.use_direct_reads: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T23:21:56.636 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.db_log_dir: 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.wal_dir: 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.write_buffer_manager: 0x55bd43af4dc0 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T23:21:56.637 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.unordered_write: 0 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.row_cache: None 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.wal_filter: None 2024-09-15T23:21:56.638 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.two_write_queues: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.wal_compression: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.atomic_flush: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.log_readahead_size: 0 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T23:21:56.640 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_background_jobs: 2 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_background_compactions: -1 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_subcompactions: 1 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T23:21:56.641 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_open_files: -1 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_background_flushes: -1 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Compression algorithms supported: 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kZSTD supported: 0 2024-09-15T23:21:56.642 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kXpressCompression supported: 0 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kBZip2Compression supported: 0 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kLZ4Compression supported: 1 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kZlibCompression supported: 1 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: kSnappyCompression supported: 1 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.merge_operator: 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_filter: None 2024-09-15T23:21:56.643 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55bd43ae5320) 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: cache_index_and_filter_blocks: 1 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: pin_top_level_index_and_filter: 1 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_type: 0 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: data_block_index_type: 0 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_shortening: 1 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: checksum: 4 2024-09-15T23:21:56.644 INFO:journalctl@ceph.mon.a.smithi077.stdout: no_block_cache: 0 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache: 0x55bd43ad91f0 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_name: BinnedLRUCache 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_options: 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: capacity : 536870912 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: num_shard_bits : 4 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: strict_capacity_limit : 0 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: high_pri_pool_ratio: 0.000 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_cache_compressed: (nil) 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: persistent_cache: (nil) 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_size: 4096 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_size_deviation: 10 2024-09-15T23:21:56.645 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_restart_interval: 16 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: index_block_restart_interval: 1 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: metadata_block_size: 4096 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: partition_filters: 0 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: use_delta_encoding: 1 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: filter_policy: bloomfilter 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: whole_key_filtering: 1 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: verify_compression: 0 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: read_amp_bytes_per_bit: 0 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: format_version: 5 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: enable_index_compression: 1 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: block_align: 0 2024-09-15T23:21:56.646 INFO:journalctl@ceph.mon.a.smithi077.stdout: max_auto_readahead_size: 262144 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout: prepopulate_block_cache: 0 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout: initial_auto_readahead_size: 8192 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression: NoCompression 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.num_levels: 7 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T23:21:56.647 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:21:56.648 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T23:21:56.649 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T23:21:56.650 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.inplace_update_support: 0 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.bloom_locality: 0 2024-09-15T23:21:56.651 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.max_successive_merges: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.ttl: 2592000 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enable_blob_files: false 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.min_blob_size: 0 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T23:21:56.652 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 37246817-1d3f-4491-9001-10800d333a34 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442516401570, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442516403021, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99459, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97353, "index_size": 298, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14048, "raw_average_key_size": 49, "raw_value_size": 89681, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726442516, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "37246817-1d3f-4491-9001-10800d333a34", "db_session_id": "4LOLGRDVE056UC7VGYUY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442516403121, "job": 1, "event": "recovery_finished"} 2024-09-15T23:21:56.653 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55bd43b06e00 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: DB pointer 0x55bd43c02000 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** DB Stats ** 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:21:56.654 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: L0 2/0 98.99 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: Sum 2/0 98.99 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 106.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** Compaction Stats [default] ** 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 106.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T23:21:56.655 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Cumulative compaction: 0.00 GB write, 21.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Interval compaction: 0.00 GB write, 21.77 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T23:21:56.656 INFO:journalctl@ceph.mon.a.smithi077.stdout: Block cache BinnedLRUCache@0x55bd43ad91f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: starting mon.a rank 0 at public addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] at bind addrs [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???) e1 preinit fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).mds e1 new map 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).mds e1 print_map 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: e1 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: btime 2024-09-15T23:21:49:385354+0000 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: legacy client fscid: -1 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: 2024-09-15T23:21:56.657 INFO:journalctl@ceph.mon.a.smithi077.stdout: No filesystems configured 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 bash[30938]: 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 systemd[1]: Started Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: monmap epoch 1 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: last_changed 2024-09-15T23:21:38.646735+0000 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-15T23:21:56.658 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: election_strategy: 1 2024-09-15T23:21:56.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:21:56.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: fsmap 2024-09-15T23:21:56.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: osdmap e1: 0 total, 0 up, 0 in 2024-09-15T23:21:56.659 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:56 smithi077 ceph-mon[30968]: mgrmap e1: no daemons active 2024-09-15T23:21:57.531 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.929+0000 7fcd2bb23640 1 Processor -- start 2024-09-15T23:21:57.535 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.929+0000 7fcd2bb23640 1 -- start start 2024-09-15T23:21:57.535 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.929+0000 7fcd2bb23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:57.535 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.929+0000 7fcd2bb23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd24107ee0 con 0x7fcd24107510 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.930+0000 7fcd298bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.930+0000 7fcd298bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59984/0 (socket says 172.21.15.77:59984) 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.930+0000 7fcd298bf640 1 -- 172.21.15.77:0/1656864879 learned_addr learned my addr 172.21.15.77:0/1656864879 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.930+0000 7fcd298bf640 1 -- 172.21.15.77:0/1656864879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd241086c0 con 0x7fcd24107510 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.932+0000 7fcd298bf640 1 --2- 172.21.15.77:0/1656864879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009820 tx=0x7fcd2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db5d3176195d47c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.932+0000 7fcd288bd640 1 -- 172.21.15.77:0/1656864879 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20037070 con 0x7fcd24107510 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.932+0000 7fcd288bd640 1 -- 172.21.15.77:0/1656864879 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd20032900 con 0x7fcd24107510 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.932+0000 7fcd288bd640 1 -- 172.21.15.77:0/1656864879 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20030850 con 0x7fcd24107510 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 -- 172.21.15.77:0/1656864879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 msgr2=0x7fcd24107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 --2- 172.21.15.77:0/1656864879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009820 tx=0x7fcd2002a270 comp rx=0 tx=0).stop 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 -- 172.21.15.77:0/1656864879 shutdown_connections 2024-09-15T23:21:57.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 --2- 172.21.15.77:0/1656864879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd24107910 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 -- 172.21.15.77:0/1656864879 >> 172.21.15.77:0/1656864879 conn(0x7fcd24102ce0 msgr2=0x7fcd24105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 -- 172.21.15.77:0/1656864879 shutdown_connections 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 -- 172.21.15.77:0/1656864879 wait complete. 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.933+0000 7fcd2bb23640 1 Processor -- start 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd2bb23640 1 -- start start 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd2bb23640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd2bb23640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2410ba70 con 0x7fcd24107510 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd298bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd298bf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60000/0 (socket says 172.21.15.77:60000) 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd298bf640 1 -- 172.21.15.77:0/326321384 learned_addr learned my addr 172.21.15.77:0/326321384 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd298bf640 1 -- 172.21.15.77:0/326321384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2419ba20 con 0x7fcd24107510 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd298bf640 1 --2- 172.21.15.77:0/326321384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009940 tx=0x7fcd20032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:57.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20042070 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd200308c0 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcd20037040 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.934+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2419bcb0 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.935+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2419e9a0 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.935+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd20045070 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.935+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd20047b70 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.935+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2410bbf0 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.938+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fcd200327b0 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.994+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fcd24107990 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.996+0000 7fcd1affd640 1 -- 172.21.15.77:0/326321384 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fcd2003c760 con 0x7fcd24107510 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 msgr2=0x7fcd2419b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 --2- 172.21.15.77:0/326321384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fcd20009940 tx=0x7fcd20032ce0 comp rx=0 tx=0).stop 2024-09-15T23:21:57.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 shutdown_connections 2024-09-15T23:21:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 --2- 172.21.15.77:0/326321384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd24107510 0x7fcd2419b4e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 >> 172.21.15.77:0/326321384 conn(0x7fcd24102ce0 msgr2=0x7fcd24103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 shutdown_connections 2024-09-15T23:21:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:56.997+0000 7fcd2bb23640 1 -- 172.21.15.77:0/326321384 wait complete. 2024-09-15T23:21:57.539 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-15T23:21:57.561 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:21:57.561 INFO:teuthology.orchestra.run.smithi077.stdout:Creating mgr... 2024-09-15T23:21:57.562 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-15T23:21:57.562 INFO:teuthology.orchestra.run.smithi077.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-15T23:21:57.807 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x 2024-09-15T23:21:57.807 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-15T23:21:57.953 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968.target.wants/ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-1be60238-73b9-11ef-bceb-c7b262605968@.service. 2024-09-15T23:21:58.312 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:57 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/326321384' entity='client.admin' 2024-09-15T23:21:58.514 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:21:58.514 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-15T23:21:58.521 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:21:58.521 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:21:58.521 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-15T23:21:58.521 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to enable service . firewalld.service is not available 2024-09-15T23:21:58.529 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:21:58.530 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-15T23:21:58.537 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:21:58.537 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:21:58.537 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-15T23:21:58.537 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-15T23:21:58.538 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr to start... 2024-09-15T23:21:58.538 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr... 2024-09-15T23:21:58.661 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:58 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:58.574+0000 7f246505b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:21:58.915 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:58 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:58.725+0000 7f246505b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:21:58.915 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:58 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:58.791+0000 7f246505b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:21:59.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:21:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1064148772' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:21:59.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:58 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:58.944+0000 7f246505b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:21:59.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:59.094+0000 7f246505b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:21:59.636 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:21:59.637 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:21:59.638 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:21:59.647 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:21:49:385354+0000", 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:21:59.648 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:21:49.386031+0000", 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:21:59.649 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.989+0000 7fa6b05b0640 1 Processor -- start 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.989+0000 7fa6b05b0640 1 -- start start 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.989+0000 7fa6b05b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.989+0000 7fa6b05b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810a840 con 0x7fa6a8107f10 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.990+0000 7fa6ae34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.990+0000 7fa6ae34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37954/0 (socket says 172.21.15.77:37954) 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.990+0000 7fa6ae34c640 1 -- 172.21.15.77:0/382608529 learned_addr learned my addr 172.21.15.77:0/382608529 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.990+0000 7fa6ae34c640 1 -- 172.21.15.77:0/382608529 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a810a9c0 con 0x7fa6a8107f10 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.990+0000 7fa6ae34c640 1 --2- 172.21.15.77:0/382608529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009820 tx=0x7fa6a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe08ba6965edb5b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6ad34a640 1 -- 172.21.15.77:0/382608529 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a4037070 con 0x7fa6a8107f10 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6ad34a640 1 -- 172.21.15.77:0/382608529 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6a4032900 con 0x7fa6a8107f10 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6ad34a640 1 -- 172.21.15.77:0/382608529 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a4030850 con 0x7fa6a8107f10 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 -- 172.21.15.77:0/382608529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 msgr2=0x7fa6a810a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:59.650 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 --2- 172.21.15.77:0/382608529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4009820 tx=0x7fa6a402a270 comp rx=0 tx=0).stop 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 -- 172.21.15.77:0/382608529 shutdown_connections 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 --2- 172.21.15.77:0/382608529 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a810a300 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 -- 172.21.15.77:0/382608529 >> 172.21.15.77:0/382608529 conn(0x7fa6a8101af0 msgr2=0x7fa6a8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.991+0000 7fa6b05b0640 1 -- 172.21.15.77:0/382608529 shutdown_connections 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6b05b0640 1 -- 172.21.15.77:0/382608529 wait complete. 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6b05b0640 1 Processor -- start 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6b05b0640 1 -- start start 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6b05b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6b05b0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810b9a0 con 0x7fa6a8107f10 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6ae34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6ae34c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37966/0 (socket says 172.21.15.77:37966) 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.992+0000 7fa6ae34c640 1 -- 172.21.15.77:0/1064148772 learned_addr learned my addr 172.21.15.77:0/1064148772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:21:59.651 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa6ae34c640 1 -- 172.21.15.77:0/1064148772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a8107cd0 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa6ae34c640 1 --2- 172.21.15.77:0/1064148772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4032ce0 tx=0x7fa6a4032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a4042070 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a8105ec0 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a8106400 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6a4032900 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa6a4037040 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6a4045070 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.993+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa6a403aa30 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.994+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa68c0052c0 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:58.996+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa6a404c020 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.057+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa68c0055b0 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.058+0000 7fa69f7fe640 1 -- 172.21.15.77:0/1064148772 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fa6a40308c0 con 0x7fa6a8107f10 2024-09-15T23:21:59.652 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 msgr2=0x7fa6a8107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 --2- 172.21.15.77:0/1064148772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa6a4032ce0 tx=0x7fa6a4032d10 comp rx=0 tx=0).stop 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 shutdown_connections 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 --2- 172.21.15.77:0/1064148772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107f10 0x7fa6a8107790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 >> 172.21.15.77:0/1064148772 conn(0x7fa6a8101af0 msgr2=0x7fa6a81026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 shutdown_connections 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:21:59.059+0000 7fa6b05b0640 1 -- 172.21.15.77:0/1064148772 wait complete. 2024-09-15T23:21:59.653 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (1/15)... 2024-09-15T23:21:59.667 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:59.415+0000 7f246505b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:21:59.667 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:59.476+0000 7f246505b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:22:00.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:21:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:21:59.665+0000 7f246505b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:22:00.883 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:00 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:00.547+0000 7f246505b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:22:00.883 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:00 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:00.614+0000 7f246505b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:22:01.581 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.322+0000 7f246505b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:22:01.581 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.436+0000 7f246505b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:22:01.581 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.579+0000 7f246505b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:22:01.865 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.641+0000 7f246505b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:22:01.866 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.797+0000 7f246505b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:22:01.866 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.864+0000 7f246505b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:22:02.126 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:01.925+0000 7f246505b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:22:02.126 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.086+0000 7f246505b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:22:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1529098098' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:22:02.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.152+0000 7f246505b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:22:02.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.223+0000 7f246505b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:22:02.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.311+0000 7f246505b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:22:02.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.371+0000 7f246505b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:22:02.796 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:02 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:02.431+0000 7f246505b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:22:02.808 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:22:02.809 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:22:02.810 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:22:02.811 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:21:49:385354+0000", 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:22:02.812 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:21:49.386031+0000", 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb845987640 1 Processor -- start 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb845987640 1 -- start start 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb845987640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb845987640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb840075920 con 0x7fb840107f70 2024-09-15T23:22:02.813 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb83effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb83effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37980/0 (socket says 172.21.15.77:37980) 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.202+0000 7fb83effd640 1 -- 172.21.15.77:0/2639382129 learned_addr learned my addr 172.21.15.77:0/2639382129 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.203+0000 7fb83effd640 1 -- 172.21.15.77:0/2639382129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84010a8a0 con 0x7fb840107f70 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.203+0000 7fb83effd640 1 --2- 172.21.15.77:0/2639382129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb838009e80 tx=0x7fb83802a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a971c31b31bbf1cd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb83dffb640 1 -- 172.21.15.77:0/2639382129 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb838036070 con 0x7fb840107f70 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb83dffb640 1 -- 172.21.15.77:0/2639382129 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb8380318c0 con 0x7fb840107f70 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb83dffb640 1 -- 172.21.15.77:0/2639382129 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb838007ab0 con 0x7fb840107f70 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 -- 172.21.15.77:0/2639382129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 msgr2=0x7fb84010a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 --2- 172.21.15.77:0/2639382129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fb838009e80 tx=0x7fb83802a7a0 comp rx=0 tx=0).stop 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 -- 172.21.15.77:0/2639382129 shutdown_connections 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 --2- 172.21.15.77:0/2639382129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84010a360 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 -- 172.21.15.77:0/2639382129 >> 172.21.15.77:0/2639382129 conn(0x7fb840101af0 msgr2=0x7fb840103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:02.814 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 -- 172.21.15.77:0/2639382129 shutdown_connections 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.204+0000 7fb845987640 1 -- 172.21.15.77:0/2639382129 wait complete. 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb845987640 1 Processor -- start 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb845987640 1 -- start start 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb845987640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb845987640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb84010b9a0 con 0x7fb840107f70 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb83effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb83effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37996/0 (socket says 172.21.15.77:37996) 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.205+0000 7fb83effd640 1 -- 172.21.15.77:0/1529098098 learned_addr learned my addr 172.21.15.77:0/1529098098 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb83effd640 1 -- 172.21.15.77:0/1529098098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84019bb10 con 0x7fb840107f70 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb83effd640 1 --2- 172.21.15.77:0/1529098098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb838031ca0 tx=0x7fb838031cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb838036050 con 0x7fb840107f70 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb838042070 con 0x7fb840107f70 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84019bda0 con 0x7fb840107f70 2024-09-15T23:22:02.815 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb83803d820 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb84019ea90 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb83803db20 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.206+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb838007e00 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.207+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8401083d0 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.209+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb8380072f0 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.268+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fb84019ef00 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.268+0000 7fb844985640 1 -- 172.21.15.77:0/1529098098 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fb838047460 con 0x7fb840107f70 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 msgr2=0x7fb84019b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 --2- 172.21.15.77:0/1529098098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb838031ca0 tx=0x7fb838031cd0 comp rx=0 tx=0).stop 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 shutdown_connections 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 --2- 172.21.15.77:0/1529098098 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb840107f70 0x7fb84019b5d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:02.816 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 >> 172.21.15.77:0/1529098098 conn(0x7fb840101af0 msgr2=0x7fb8401026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:02.817 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 shutdown_connections 2024-09-15T23:22:02.817 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:02.269+0000 7fb845987640 1 -- 172.21.15.77:0/1529098098 wait complete. 2024-09-15T23:22:02.817 INFO:teuthology.orchestra.run.smithi077.stdout:mgr not available, waiting (2/15)... 2024-09-15T23:22:03.633 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:03.231+0000 7f246505b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:22:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: Activating manager daemon x 2024-09-15T23:22:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: mgrmap e2: x(active, starting, since 0.00298129s) 2024-09-15T23:22:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:22:03.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: Manager daemon x is now available 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' 2024-09-15T23:22:03.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:03 smithi077 ceph-mon[30968]: from='mgr.14100 172.21.15.77:0/3846332631' entity='mgr.x' 2024-09-15T23:22:05.497 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:05 smithi077 ceph-mon[30968]: mgrmap e3: x(active, since 1.00699s) 2024-09-15T23:22:06.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:22:06.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "health": { 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 0 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "a" 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:06.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-15T23:22:06.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-15T23:22:06.110 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-15T23:22:06.110 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-15T23:22:06.110 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-15T23:22:06.110 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:06.111 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "btime": "2024-09-15T23:21:49:385354+0000", 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "restful" 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ], 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:22:06.112 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "modified": "2024-09-15T23:21:49.386031+0000", 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout }, 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01be7b7640 1 Processor -- start 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01be7b7640 1 -- start start 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01be7b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01be7b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01b810a880 con 0x7f01b8107f50 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.113 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38072/0 (socket says 172.21.15.77:38072) 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.243+0000 7f01b7fff640 1 -- 172.21.15.77:0/3804030746 learned_addr learned my addr 172.21.15.77:0/3804030746 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.244+0000 7f01b7fff640 1 -- 172.21.15.77:0/3804030746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b810aa00 con 0x7f01b8107f50 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.244+0000 7f01b7fff640 1 --2- 172.21.15.77:0/3804030746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009820 tx=0x7f01a802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d31f74b62051f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.244+0000 7f01b77fe640 1 -- 172.21.15.77:0/3804030746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8037070 con 0x7f01b8107f50 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.244+0000 7f01b77fe640 1 -- 172.21.15.77:0/3804030746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01a8032900 con 0x7f01b8107f50 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.244+0000 7f01b77fe640 1 -- 172.21.15.77:0/3804030746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8030850 con 0x7f01b8107f50 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 -- 172.21.15.77:0/3804030746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 msgr2=0x7f01b810a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 --2- 172.21.15.77:0/3804030746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009820 tx=0x7f01a802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 -- 172.21.15.77:0/3804030746 shutdown_connections 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 --2- 172.21.15.77:0/3804030746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b810a340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 -- 172.21.15.77:0/3804030746 >> 172.21.15.77:0/3804030746 conn(0x7f01b8101af0 msgr2=0x7f01b8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 -- 172.21.15.77:0/3804030746 shutdown_connections 2024-09-15T23:22:06.114 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.245+0000 7f01be7b7640 1 -- 172.21.15.77:0/3804030746 wait complete. 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01be7b7640 1 Processor -- start 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01be7b7640 1 -- start start 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01be7b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01be7b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01b810b9e0 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01b7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38088/0 (socket says 172.21.15.77:38088) 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.246+0000 7f01b7fff640 1 -- 172.21.15.77:0/958431063 learned_addr learned my addr 172.21.15.77:0/958431063 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01b7fff640 1 -- 172.21.15.77:0/958431063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b8107d10 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01b7fff640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01a8032ce0 tx=0x7f01a8032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8042070 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01a80308c0 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f01a8037040 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b8105f00 con 0x7f01b8107f50 2024-09-15T23:22:06.115 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.247+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b8106440 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.248+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f01a8045070 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.248+0000 7f01b5ffb640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 0x7f01a403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.248+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b81083b0 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.248+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f01a806c1a0 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.248+0000 7f01affff640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 0x7f01a403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.249+0000 7f01affff640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 0x7f01a403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01a00098c0 tx=0x7f01a0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.253+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01a804b170 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.484+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f01b8106be0 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.485+0000 7f01b5ffb640 1 -- 172.21.15.77:0/958431063 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f01a803c780 con 0x7f01b8107f50 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 msgr2=0x7f01a403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 0x7f01a403b670 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f01a00098c0 tx=0x7f01a0006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.116 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 msgr2=0x7f01b81077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f01a8032ce0 tx=0x7f01a8032d10 comp rx=0 tx=0).stop 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 shutdown_connections 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f01a40391b0 0x7f01a403b670 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 --2- 172.21.15.77:0/958431063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01b8107f50 0x7f01b81077d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 >> 172.21.15.77:0/958431063 conn(0x7f01b8101af0 msgr2=0x7f01b81026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 shutdown_connections 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:05.487+0000 7f01be7b7640 1 -- 172.21.15.77:0/958431063 wait complete. 2024-09-15T23:22:06.117 INFO:teuthology.orchestra.run.smithi077.stdout:mgr is available 2024-09-15T23:22:06.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:06 smithi077 ceph-mon[30968]: mgrmap e4: x(active, since 2s) 2024-09-15T23:22:06.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:06 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/958431063' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-15T23:22:07.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [global] 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout fsid = 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.77:3300,v1:172.21.15.77:6789] 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 2024-09-15T23:22:07.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout [osd] 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48f16e4640 1 Processor -- start 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48f16e4640 1 -- start start 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48f16e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48f16e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec106170 con 0x7f48ec1057a0 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38090/0 (socket says 172.21.15.77:38090) 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.464+0000 7f48eaffd640 1 -- 172.21.15.77:0/1696166428 learned_addr learned my addr 172.21.15.77:0/1696166428 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:07.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.465+0000 7f48eaffd640 1 -- 172.21.15.77:0/1696166428 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec108780 con 0x7f48ec1057a0 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.465+0000 7f48eaffd640 1 --2- 172.21.15.77:0/1696166428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009e80 tx=0x7f48dc02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a7b4bdb1f83656 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48e9ffb640 1 -- 172.21.15.77:0/1696166428 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48dc036070 con 0x7f48ec1057a0 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48e9ffb640 1 -- 172.21.15.77:0/1696166428 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48dc0318c0 con 0x7f48ec1057a0 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48e9ffb640 1 -- 172.21.15.77:0/1696166428 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48dc007ab0 con 0x7f48ec1057a0 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 -- 172.21.15.77:0/1696166428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 msgr2=0x7f48ec105ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 --2- 172.21.15.77:0/1696166428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009e80 tx=0x7f48dc02a7a0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 -- 172.21.15.77:0/1696166428 shutdown_connections 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 --2- 172.21.15.77:0/1696166428 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec105ba0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 -- 172.21.15.77:0/1696166428 >> 172.21.15.77:0/1696166428 conn(0x7f48ec1012f0 msgr2=0x7f48ec103730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 -- 172.21.15.77:0/1696166428 shutdown_connections 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.466+0000 7f48f16e4640 1 -- 172.21.15.77:0/1696166428 wait complete. 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48f16e4640 1 Processor -- start 2024-09-15T23:22:07.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48f16e4640 1 -- start start 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48f16e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48f16e4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f48ec10b9b0 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48eaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38092/0 (socket says 172.21.15.77:38092) 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48eaffd640 1 -- 172.21.15.77:0/2176861406 learned_addr learned my addr 172.21.15.77:0/2176861406 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.467+0000 7f48eaffd640 1 -- 172.21.15.77:0/2176861406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ec19ba50 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48eaffd640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f48dc02ad90 tx=0x7f48dc031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48dc036050 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48dc042070 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ec19bce0 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48dc03d7e0 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.468+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ec19e9d0 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f48dc03dae0 con 0x7f48ec1057a0 2024-09-15T23:22:07.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48d3fff640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 0x7f48d403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48ec105c20 con 0x7f48ec1057a0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f48dc007e00 con 0x7f48ec1057a0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48ea7fc640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 0x7f48d403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.469+0000 7f48ea7fc640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 0x7f48d403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48e00098c0 tx=0x7f48e0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.474+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f48dc039de0 con 0x7f48ec1057a0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.643+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f48ec1a01d0 con 0x7f48ec1057a0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.644+0000 7f48d3fff640 1 -- 172.21.15.77:0/2176861406 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f48dc03c9c0 con 0x7f48ec1057a0 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 msgr2=0x7f48d403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 0x7f48d403b620 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48e00098c0 tx=0x7f48e0006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 msgr2=0x7f48ec19b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:07.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f48dc02ad90 tx=0x7f48dc031ca0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 shutdown_connections 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f48d4039160 0x7f48d403b620 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 --2- 172.21.15.77:0/2176861406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f48ec1057a0 0x7f48ec19b510 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 >> 172.21.15.77:0/2176861406 conn(0x7f48ec1012f0 msgr2=0x7f48ec101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 shutdown_connections 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:06.646+0000 7f48f16e4640 1 -- 172.21.15.77:0/2176861406 wait complete. 2024-09-15T23:22:07.241 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling cephadm module... 2024-09-15T23:22:07.537 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:07 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2176861406' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-15T23:22:08.586 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1918953698' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-15T23:22:08.586 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ignoring --setuser ceph since I am not root 2024-09-15T23:22:08.586 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ignoring --setgroup ceph since I am not root 2024-09-15T23:22:08.586 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.378+0000 7f8fd3c63040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:22:08.587 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.434+0000 7f8fd3c63040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:22:08.587 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.584+0000 7f8fd3c63040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:22:08.883 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.652+0000 7f8fd3c63040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:22:08.883 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.798+0000 7f8fd3c63040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:22:08.917 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.616+0000 7f4af7dab640 1 Processor -- start 2024-09-15T23:22:08.917 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.616+0000 7f4af7dab640 1 -- start start 2024-09-15T23:22:08.917 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af7dab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:08.917 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af7dab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4af0105fc0 con 0x7f4af0107a80 2024-09-15T23:22:08.917 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af5b47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af5b47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45094/0 (socket says 172.21.15.77:45094) 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af5b47640 1 -- 172.21.15.77:0/912187701 learned_addr learned my addr 172.21.15.77:0/912187701 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.617+0000 7f4af5b47640 1 -- 172.21.15.77:0/912187701 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af0106140 con 0x7f4af0107a80 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af5b47640 1 --2- 172.21.15.77:0/912187701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009820 tx=0x7f4aec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8cd3457aeff4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af4b45640 1 -- 172.21.15.77:0/912187701 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec037070 con 0x7f4af0107a80 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af4b45640 1 -- 172.21.15.77:0/912187701 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4aec032900 con 0x7f4af0107a80 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af4b45640 1 -- 172.21.15.77:0/912187701 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec030850 con 0x7f4af0107a80 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af7dab640 1 -- 172.21.15.77:0/912187701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 msgr2=0x7f4af0107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:08.918 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.618+0000 7f4af7dab640 1 --2- 172.21.15.77:0/912187701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009820 tx=0x7f4aec02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- 172.21.15.77:0/912187701 shutdown_connections 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 --2- 172.21.15.77:0/912187701 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af0107e80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- 172.21.15.77:0/912187701 >> 172.21.15.77:0/912187701 conn(0x7f4af0101af0 msgr2=0x7f4af0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- 172.21.15.77:0/912187701 shutdown_connections 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- 172.21.15.77:0/912187701 wait complete. 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 Processor -- start 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- start start 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af7dab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4af010a950 con 0x7f4af0107a80 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af5b47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af5b47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45104/0 (socket says 172.21.15.77:45104) 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.619+0000 7f4af5b47640 1 -- 172.21.15.77:0/1918953698 learned_addr learned my addr 172.21.15.77:0/1918953698 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:08.919 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4af5b47640 1 -- 172.21.15.77:0/1918953698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af019aa30 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4af5b47640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009940 tx=0x7f4aec032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec042070 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4aec0308c0 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af019acc0 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4aec037040 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.620+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af019d9b0 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f4aec045070 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4ae6ffd640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 0x7f4adc03b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4aec06c1c0 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af0107f00 con 0x7f4af0107a80 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4af5346640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 0x7f4adc03b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.621+0000 7f4af5346640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 0x7f4adc03b6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098c0 tx=0x7f4ae0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:08.920 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.626+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4aec045360 con 0x7f4af0107a80 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:07.833+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f4af019de10 con 0x7f4af0107a80 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.243+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f4aec02ed90 con 0x7f4af0107a80 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.245+0000 7f4ae6ffd640 1 -- 172.21.15.77:0/1918953698 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f4aec03cca0 con 0x7f4af0107a80 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 msgr2=0x7f4adc03b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 0x7f4adc03b6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4ae00098c0 tx=0x7f4ae0006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 msgr2=0x7f4af019a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009940 tx=0x7f4aec032ce0 comp rx=0 tx=0).stop 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 shutdown_connections 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f4adc039210 0x7f4adc03b6d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 --2- 172.21.15.77:0/1918953698 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4af0107a80 0x7f4af019a4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 >> 172.21.15.77:0/1918953698 conn(0x7f4af0101af0 msgr2=0x7f4af0102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.246+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 shutdown_connections 2024-09-15T23:22:08.921 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:08.247+0000 7f4af7dab640 1 -- 172.21.15.77:0/1918953698 wait complete. 2024-09-15T23:22:09.161 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:08.949+0000 7f8fd3c63040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:22:09.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:09 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1918953698' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-15T23:22:09.519 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:09 smithi077 ceph-mon[30968]: mgrmap e5: x(active, since 5s) 2024-09-15T23:22:09.520 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:09 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:09.268+0000 7f8fd3c63040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:22:09.520 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:09 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:09.333+0000 7f8fd3c63040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:22:09.863 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:09 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:09.519+0000 7f8fd3c63040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:22:10.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:10.098 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.311+0000 7f837435b640 1 Processor -- start 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.311+0000 7f837435b640 1 -- start start 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f837435b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f837435b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f836c07be20 con 0x7f836c107f70 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f83720f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f83720f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45118/0 (socket says 172.21.15.77:45118) 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f83720f7640 1 -- 172.21.15.77:0/693833000 learned_addr learned my addr 172.21.15.77:0/693833000 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:10.099 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.312+0000 7f83720f7640 1 -- 172.21.15.77:0/693833000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c10a8a0 con 0x7f836c107f70 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.313+0000 7f83720f7640 1 --2- 172.21.15.77:0/693833000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8368009820 tx=0x7f836802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6bc16df521667dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f83710f5640 1 -- 172.21.15.77:0/693833000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368037070 con 0x7f836c107f70 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f83710f5640 1 -- 172.21.15.77:0/693833000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8368032900 con 0x7f836c107f70 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f83710f5640 1 -- 172.21.15.77:0/693833000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368030850 con 0x7f836c107f70 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 -- 172.21.15.77:0/693833000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 msgr2=0x7f836c10a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 --2- 172.21.15.77:0/693833000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8368009820 tx=0x7f836802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 -- 172.21.15.77:0/693833000 shutdown_connections 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 --2- 172.21.15.77:0/693833000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c10a360 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 -- 172.21.15.77:0/693833000 >> 172.21.15.77:0/693833000 conn(0x7f836c101b70 msgr2=0x7f836c103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.314+0000 7f837435b640 1 -- 172.21.15.77:0/693833000 shutdown_connections 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f837435b640 1 -- 172.21.15.77:0/693833000 wait complete. 2024-09-15T23:22:10.100 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f837435b640 1 Processor -- start 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f837435b640 1 -- start start 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f837435b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f837435b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f836c10b8e0 con 0x7f836c107f70 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f83720f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f83720f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45126/0 (socket says 172.21.15.77:45126) 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.315+0000 7f83720f7640 1 -- 172.21.15.77:0/2106497971 learned_addr learned my addr 172.21.15.77:0/2106497971 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f83720f7640 1 -- 172.21.15.77:0/2106497971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f836c107d30 con 0x7f836c107f70 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f83720f7640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8368032ce0 tx=0x7f8368032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368042070 con 0x7f836c107f70 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83680308c0 con 0x7f836c107f70 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f836c105f20 con 0x7f836c107f70 2024-09-15T23:22:10.101 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8368037040 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.316+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f836c106460 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f8368045070 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f836c1083d0 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f83637fe640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 0x7f835803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f836806c250 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f83718f6640 1 -- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 msgr2=0x7f835803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.317+0000 7f83718f6640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 0x7f835803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.322+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f836804b170 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.518+0000 7f83718f6640 1 -- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 msgr2=0x7f835803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.518+0000 7f83718f6640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 0x7f835803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.533+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f836c1066e0 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.534+0000 7f83637fe640 1 -- 172.21.15.77:0/2106497971 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f836803cd50 con 0x7f836c107f70 2024-09-15T23:22:10.102 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 msgr2=0x7f835803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 0x7f835803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 msgr2=0x7f836c1077f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8368032ce0 tx=0x7f8368032d10 comp rx=0 tx=0).stop 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 shutdown_connections 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7f83580391b0 0x7f835803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 --2- 172.21.15.77:0/2106497971 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f836c107f70 0x7f836c1077f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 >> 172.21.15.77:0/2106497971 conn(0x7f836c101b70 msgr2=0x7f836c102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 shutdown_connections 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:09.536+0000 7f837435b640 1 -- 172.21.15.77:0/2106497971 wait complete. 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-09-15T23:22:10.103 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 5... 2024-09-15T23:22:10.490 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:10 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2106497971' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T23:22:10.490 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:10 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:10.420+0000 7f8fd3c63040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:22:10.490 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:10 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:10.489+0000 7f8fd3c63040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:22:11.445 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.189+0000 7f8fd3c63040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:22:11.445 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.303+0000 7f8fd3c63040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:22:11.718 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.444+0000 7f8fd3c63040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:22:11.718 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.504+0000 7f8fd3c63040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:22:11.718 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.650+0000 7f8fd3c63040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:22:11.718 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.717+0000 7f8fd3c63040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:22:11.997 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.776+0000 7f8fd3c63040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:22:11.997 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.932+0000 7f8fd3c63040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:22:11.997 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:11.995+0000 7f8fd3c63040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:22:12.259 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:12.061+0000 7f8fd3c63040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:22:12.259 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:12.142+0000 7f8fd3c63040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:22:12.260 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:12.200+0000 7f8fd3c63040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:22:12.260 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:12.258+0000 7f8fd3c63040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:13.031+0000 7f8fd3c63040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: Active manager daemon x restarted 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: Activating manager daemon x 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: osdmap e2: 0 total, 0 up, 0 in 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: mgrmap e6: x(active, starting, since 0.00342583s) 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:22:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: Manager daemon x is now available 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:22:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:13 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:22:14.345 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-mon[30968]: Found migration_current of "None". Setting to last migration. 2024-09-15T23:22:14.345 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:14.346 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:14.346 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-mon[30968]: mgrmap e7: x(active, since 1.00543s) 2024-09-15T23:22:14.605 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:14.605 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe2594f7640 1 Processor -- start 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe2594f7640 1 -- start start 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe2594f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe2594f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe254105fc0 con 0x7fe254107a80 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45134/0 (socket says 172.21.15.77:45134) 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe252ffd640 1 -- 172.21.15.77:0/3072708386 learned_addr learned my addr 172.21.15.77:0/3072708386 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.536+0000 7fe252ffd640 1 -- 172.21.15.77:0/3072708386 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe254106140 con 0x7fe254107a80 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.537+0000 7fe252ffd640 1 --2- 172.21.15.77:0/3072708386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe244009820 tx=0x7fe24402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c04da1034feefab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.537+0000 7fe251ffb640 1 -- 172.21.15.77:0/3072708386 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe244037070 con 0x7fe254107a80 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.537+0000 7fe251ffb640 1 -- 172.21.15.77:0/3072708386 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe244032900 con 0x7fe254107a80 2024-09-15T23:22:14.606 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.537+0000 7fe251ffb640 1 -- 172.21.15.77:0/3072708386 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe244030850 con 0x7fe254107a80 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 -- 172.21.15.77:0/3072708386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 msgr2=0x7fe254107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 --2- 172.21.15.77:0/3072708386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe244009820 tx=0x7fe24402a270 comp rx=0 tx=0).stop 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 -- 172.21.15.77:0/3072708386 shutdown_connections 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 --2- 172.21.15.77:0/3072708386 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254107e80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 -- 172.21.15.77:0/3072708386 >> 172.21.15.77:0/3072708386 conn(0x7fe254101af0 msgr2=0x7fe254103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 -- 172.21.15.77:0/3072708386 shutdown_connections 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.538+0000 7fe2594f7640 1 -- 172.21.15.77:0/3072708386 wait complete. 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe2594f7640 1 Processor -- start 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe2594f7640 1 -- start start 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe2594f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe2594f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe25410a950 con 0x7fe254107a80 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.607 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe252ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45146/0 (socket says 172.21.15.77:45146) 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.539+0000 7fe252ffd640 1 -- 172.21.15.77:0/1254395872 learned_addr learned my addr 172.21.15.77:0/1254395872 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe252ffd640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25419e350 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe252ffd640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe244009940 tx=0x7fe244032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe244042070 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2440308c0 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25419e520 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe244037040 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.540+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25419e8c0 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fe244045070 con 0x7fe254107a80 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe23bfff640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe23c03bd80 con 0x7fe23c0391b0 2024-09-15T23:22:14.608 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe24406c2a0 con 0x7fe254107a80 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe2527fc640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 msgr2=0x7fe23c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.541+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.742+0000 7fe2527fc640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 msgr2=0x7fe23c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:10.742+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:11.143+0000 7fe2527fc640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 msgr2=0x7fe23c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:11.143+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:11.944+0000 7fe2527fc640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 msgr2=0x7fe23c03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/85632469 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:11.944+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:13.034+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7fe24406ae20 con 0x7fe254107a80 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:13.035+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 msgr2=0x7fe23c03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:13.035+0000 7fe23bfff640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.035+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fe24402ad40 con 0x7fe254107a80 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.035+0000 7fe23bfff640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 0x7fe23c03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:14.609 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.035+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe24403ee50 con 0x7fe23c03cae0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.036+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 0x7fe23c03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.036+0000 7fe2527fc640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 0x7fe23c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe248003980 tx=0x7fe248006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.037+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fe24403ee50 con 0x7fe23c03cae0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fe254107f00 con 0x7fe23c03cae0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe23bfff640 1 -- 172.21.15.77:0/1254395872 <== mgr.14118 v2:172.21.15.77:6800/301680494 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fe254107f00 con 0x7fe23c03cae0 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 msgr2=0x7fe23c03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 0x7fe23c03eed0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe248003980 tx=0x7fe248006e10 comp rx=0 tx=0).stop 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 msgr2=0x7fe254075420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe244009940 tx=0x7fe244032ce0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 shutdown_connections 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe23c03cae0 0x7fe23c03eed0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:6800/85632469,v1:172.21.15.77:6801/85632469] conn(0x7fe23c0391b0 0x7fe23c03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 --2- 172.21.15.77:0/1254395872 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe254107a80 0x7fe254075420 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.044+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 >> 172.21.15.77:0/1254395872 conn(0x7fe254101af0 msgr2=0x7fe254102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:14.610 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.045+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 shutdown_connections 2024-09-15T23:22:14.611 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.045+0000 7fe2594f7640 1 -- 172.21.15.77:0/1254395872 wait complete. 2024-09-15T23:22:14.611 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 5 is available 2024-09-15T23:22:14.611 INFO:teuthology.orchestra.run.smithi077.stdout:Setting orchestrator backend to cephadm... 2024-09-15T23:22:14.874 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:14.634+0000 7f8f3afbd640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:23:22:14] ENGINE Error in HTTPServer.serve 2024-09-15T23:22:14.874 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: Traceback (most recent call last): 2024-09-15T23:22:14.874 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:22:14.874 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._connections.run(self.expiration_interval) 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._run(expiration_interval) 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: s = self.context.wrap_socket( 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: return self.sslsocket_class._create( 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self.do_handshake() 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:22:14.875 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._sslobj.do_handshake() 2024-09-15T23:22:14.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:22:14.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:15 smithi077 ceph-mon[30968]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T23:22:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:15 smithi077 ceph-mon[30968]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T23:22:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:15 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd501bca640 1 Processor -- start 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd501bca640 1 -- start start 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd501bca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd501bca640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc106d90 con 0x7fd4fc1063c0 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45204/0 (socket says 172.21.15.77:45204) 2024-09-15T23:22:15.710 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.950+0000 7fd4fb7fe640 1 -- 172.21.15.77:0/3654380438 learned_addr learned my addr 172.21.15.77:0/3654380438 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.951+0000 7fd4fb7fe640 1 -- 172.21.15.77:0/3654380438 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc1075c0 con 0x7fd4fc1063c0 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.951+0000 7fd4fb7fe640 1 --2- 172.21.15.77:0/3654380438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009820 tx=0x7fd4ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3134ae9a2ecef77 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.951+0000 7fd4faffd640 1 -- 172.21.15.77:0/3654380438 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec037070 con 0x7fd4fc1063c0 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.951+0000 7fd4faffd640 1 -- 172.21.15.77:0/3654380438 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4ec032900 con 0x7fd4fc1063c0 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.951+0000 7fd4faffd640 1 -- 172.21.15.77:0/3654380438 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec030850 con 0x7fd4fc1063c0 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 -- 172.21.15.77:0/3654380438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 msgr2=0x7fd4fc1067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 --2- 172.21.15.77:0/3654380438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009820 tx=0x7fd4ec02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 -- 172.21.15.77:0/3654380438 shutdown_connections 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 --2- 172.21.15.77:0/3654380438 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc1067c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 -- 172.21.15.77:0/3654380438 >> 172.21.15.77:0/3654380438 conn(0x7fd4fc101b90 msgr2=0x7fd4fc103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 -- 172.21.15.77:0/3654380438 shutdown_connections 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.952+0000 7fd501bca640 1 -- 172.21.15.77:0/3654380438 wait complete. 2024-09-15T23:22:15.711 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 Processor -- start 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 -- start start 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd4fc10a970 con 0x7fd4fc1063c0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4fb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45220/0 (socket says 172.21.15.77:45220) 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4fb7fe640 1 -- 172.21.15.77:0/3319780659 learned_addr learned my addr 172.21.15.77:0/3319780659 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4fb7fe640 1 -- 172.21.15.77:0/3319780659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4fc19b9d0 con 0x7fd4fc1063c0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4fb7fe640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097f0 tx=0x7fd4ec030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec037040 con 0x7fd4fc1063c0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4fc19bc60 con 0x7fd4fc1063c0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4ec040070 con 0x7fd4fc1063c0 2024-09-15T23:22:15.712 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4ec03a390 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.953+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4fc19e950 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.954+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7fd4ec03a630 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.954+0000 7fd4f97fa640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 0x7fd4e803b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.954+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd4ec06c5a0 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.955+0000 7fd4f3fff640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 0x7fd4e803b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.955+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4fc10aaf0 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.955+0000 7fd4f3fff640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 0x7fd4e803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40098c0 tx=0x7fd4e4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:14.959+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd4ec04a200 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.090+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd4ec0457e0 con 0x7fd4fc1063c0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.141+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fd4fc102de0 con 0x7fd4e80390a0 2024-09-15T23:22:15.713 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.145+0000 7fd4f97fa640 1 -- 172.21.15.77:0/3319780659 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd4fc102de0 con 0x7fd4e80390a0 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 msgr2=0x7fd4e803b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 0x7fd4e803b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40098c0 tx=0x7fd4e4006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 msgr2=0x7fd4fc19b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec0097f0 tx=0x7fd4ec030d80 comp rx=0 tx=0).stop 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 shutdown_connections 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd4e80390a0 0x7fd4e803b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 --2- 172.21.15.77:0/3319780659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd4fc1063c0 0x7fd4fc19b490 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 >> 172.21.15.77:0/3319780659 conn(0x7fd4fc101b90 msgr2=0x7fd4fc1026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 shutdown_connections 2024-09-15T23:22:15.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:15.148+0000 7fd501bca640 1 -- 172.21.15.77:0/3319780659 wait complete. 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:14] ENGINE Bus STARTING 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:14] ENGINE Serving on http://172.21.15.77:8765 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:14] ENGINE Serving on https://172.21.15.77:7150 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:14] ENGINE Bus STARTED 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:14] ENGINE Error in HTTPServer.serve 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout: Traceback (most recent call last): 2024-09-15T23:22:16.260 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._run(expiration_interval) 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: s = self.context.wrap_socket( 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: return self.sslsocket_class._create( 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: self.do_handshake() 2024-09-15T23:22:16.261 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._sslobj.do_handshake() 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: mgrmap e8: x(active, since 2s) 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:16.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:16 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:16.799 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.080+0000 7f4cbff38640 1 Processor -- start 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.080+0000 7f4cbff38640 1 -- start start 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbff38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbff38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb8107ee0 con 0x7f4cb8107510 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbdcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbdcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45226/0 (socket says 172.21.15.77:45226) 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbdcd4640 1 -- 172.21.15.77:0/919570509 learned_addr learned my addr 172.21.15.77:0/919570509 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.081+0000 7f4cbdcd4640 1 -- 172.21.15.77:0/919570509 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb81086c0 con 0x7f4cb8107510 2024-09-15T23:22:16.800 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbdcd4640 1 --2- 172.21.15.77:0/919570509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009820 tx=0x7f4cac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dde279270b1083 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbccd2640 1 -- 172.21.15.77:0/919570509 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cac037070 con 0x7f4cb8107510 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbccd2640 1 -- 172.21.15.77:0/919570509 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cac032900 con 0x7f4cb8107510 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbccd2640 1 -- 172.21.15.77:0/919570509 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cac030850 con 0x7f4cb8107510 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 -- 172.21.15.77:0/919570509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 msgr2=0x7f4cb8107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 --2- 172.21.15.77:0/919570509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009820 tx=0x7f4cac02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 -- 172.21.15.77:0/919570509 shutdown_connections 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 --2- 172.21.15.77:0/919570509 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb8107910 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 -- 172.21.15.77:0/919570509 >> 172.21.15.77:0/919570509 conn(0x7f4cb8102ce0 msgr2=0x7f4cb8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 -- 172.21.15.77:0/919570509 shutdown_connections 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.082+0000 7f4cbff38640 1 -- 172.21.15.77:0/919570509 wait complete. 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbff38640 1 Processor -- start 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbff38640 1 -- start start 2024-09-15T23:22:16.801 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbff38640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbff38640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb810ba70 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbdcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbdcd4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45234/0 (socket says 172.21.15.77:45234) 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbdcd4640 1 -- 172.21.15.77:0/1050181500 learned_addr learned my addr 172.21.15.77:0/1050181500 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.083+0000 7f4cbdcd4640 1 -- 172.21.15.77:0/1050181500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb807e080 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4cbdcd4640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009940 tx=0x7f4cac032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cac042070 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4cac0308c0 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb807c270 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cac037040 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.084+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb807c7b0 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4cac045070 con 0x7f4cb8107510 2024-09-15T23:22:16.802 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb8107990 con 0x7f4cb8107510 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4caaffd640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 0x7f4ca403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4cac06c400 con 0x7f4cb8107510 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4cbd4d3640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 0x7f4ca403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.085+0000 7f4cbd4d3640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 0x7f4ca403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40098c0 tx=0x7f4cb4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.090+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4cac03d430 con 0x7f4cb8107510 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.258+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f4cb8103f30 con 0x7f4ca4039200 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.259+0000 7f4caaffd640 1 -- 172.21.15.77:0/1050181500 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f4cb8103f30 con 0x7f4ca4039200 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 msgr2=0x7f4ca403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 0x7f4ca403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40098c0 tx=0x7f4cb4006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 msgr2=0x7f4cb807db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009940 tx=0x7f4cac032ce0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 shutdown_connections 2024-09-15T23:22:16.803 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f4ca4039200 0x7f4ca403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.804 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 --2- 172.21.15.77:0/1050181500 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cb8107510 0x7f4cb807db40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:16.804 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 >> 172.21.15.77:0/1050181500 conn(0x7f4cb8102ce0 msgr2=0x7f4cb8103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:16.804 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 shutdown_connections 2024-09-15T23:22:16.804 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:16.261+0000 7f4cbff38640 1 -- 172.21.15.77:0/1050181500 wait complete. 2024-09-15T23:22:16.804 INFO:teuthology.orchestra.run.smithi077.stdout:Generating ssh key... 2024-09-15T23:22:17.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-mon[30968]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: Generating public/private rsa key pair. 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: Your identification has been saved in /tmp/tmpp1xcgzbj/key 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: Your public key has been saved in /tmp/tmpp1xcgzbj/key.pub 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: The key fingerprint is: 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: SHA256:mpQE6UcSAO5H5TREw6DvBZirCEKDtgIHJMoBzuvAXRw ceph-1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: The key's randomart image is: 2024-09-15T23:22:17.765 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: +---[RSA 3072]----+ 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |B+.oBE | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |O.= Bo= | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |+%.+ *. | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |*.O +... | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |=* + oo S | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |O o .. o | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: |o. . o | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: | | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: | | 2024-09-15T23:22:17.766 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: +----[SHA256]-----+ 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.195+0000 7f9d90b9a640 1 Processor -- start 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.195+0000 7f9d90b9a640 1 -- start start 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.195+0000 7f9d90b9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.195+0000 7f9d90b9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c107e90 con 0x7f9d8c1074c0 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.196+0000 7f9d8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.196+0000 7f9d8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38682/0 (socket says 172.21.15.77:38682) 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.196+0000 7f9d8a59c640 1 -- 172.21.15.77:0/2027957285 learned_addr learned my addr 172.21.15.77:0/2027957285 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.196+0000 7f9d8a59c640 1 -- 172.21.15.77:0/2027957285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c108670 con 0x7f9d8c1074c0 2024-09-15T23:22:18.048 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d8a59c640 1 --2- 172.21.15.77:0/2027957285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009e80 tx=0x7f9d7c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09065762dac1c88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d8959a640 1 -- 172.21.15.77:0/2027957285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c036070 con 0x7f9d8c1074c0 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d8959a640 1 -- 172.21.15.77:0/2027957285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d7c0318c0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d8959a640 1 -- 172.21.15.77:0/2027957285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c007ab0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2027957285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 msgr2=0x7f9d8c1078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2027957285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c009e80 tx=0x7f9d7c02a7a0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2027957285 shutdown_connections 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2027957285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c1078c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.197+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2027957285 >> 172.21.15.77:0/2027957285 conn(0x7f9d8c102c10 msgr2=0x7f9d8c105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2027957285 shutdown_connections 2024-09-15T23:22:18.049 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2027957285 wait complete. 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 Processor -- start 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 -- start start 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.198+0000 7f9d90b9a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9d8c10ba20 con 0x7f9d8c1074c0 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d8a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38694/0 (socket says 172.21.15.77:38694) 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d8a59c640 1 -- 172.21.15.77:0/2473289805 learned_addr learned my addr 172.21.15.77:0/2473289805 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d8a59c640 1 -- 172.21.15.77:0/2473289805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d8c19ba30 con 0x7f9d8c1074c0 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d8a59c640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02acc0 tx=0x7f9d7c031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.050 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c036050 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d8c19bcc0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d7c037040 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d7c03d8c0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.199+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d8c19e9b0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.200+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f9d7c044020 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.200+0000 7f9d837fe640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 0x7f9d7803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.200+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d8c10bba0 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.200+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9d7c042020 con 0x7f9d8c1074c0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.200+0000 7f9d89d9b640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 0x7f9d7803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:18.051 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.201+0000 7f9d89d9b640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 0x7f9d7803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d740098c0 tx=0x7f9d74006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.205+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9d7c04b020 con 0x7f9d8c1074c0 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.373+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f9d8c103f20 con 0x7f9d780391b0 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.462+0000 7f9d837fe640 1 -- 172.21.15.77:0/2473289805 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9d8c103f20 con 0x7f9d780391b0 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 msgr2=0x7f9d7803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 0x7f9d7803b670 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f9d740098c0 tx=0x7f9d74006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 msgr2=0x7f9d8c19b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c02acc0 tx=0x7f9d7c031ca0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 shutdown_connections 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f9d780391b0 0x7f9d7803b670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 --2- 172.21.15.77:0/2473289805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9d8c1074c0 0x7f9d8c19b4f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 >> 172.21.15.77:0/2473289805 conn(0x7f9d8c102c10 msgr2=0x7f9d8c103810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 shutdown_connections 2024-09-15T23:22:18.052 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:17.464+0000 7f9d90b9a640 1 -- 172.21.15.77:0/2473289805 wait complete. 2024-09-15T23:22:18.672 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:18 smithi077 ceph-mon[30968]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:18.672 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:18 smithi077 ceph-mon[30968]: Generating ssh key... 2024-09-15T23:22:18.672 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:18 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:18.672 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:18 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccfd0b8640 1 Processor -- start 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccfd0b8640 1 -- start start 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccfd0b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccfd0b8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccf8105fc0 con 0x7fccf8107a80 2024-09-15T23:22:19.252 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38704/0 (socket says 172.21.15.77:38704) 2024-09-15T23:22:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccf6d9d640 1 -- 172.21.15.77:0/2133431557 learned_addr learned my addr 172.21.15.77:0/2133431557 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.494+0000 7fccf6d9d640 1 -- 172.21.15.77:0/2133431557 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf8106140 con 0x7fccf8107a80 2024-09-15T23:22:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.495+0000 7fccf6d9d640 1 --2- 172.21.15.77:0/2133431557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009820 tx=0x7fcce802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7876a7538a536a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.253 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.495+0000 7fccf5d9b640 1 -- 172.21.15.77:0/2133431557 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8037070 con 0x7fccf8107a80 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.495+0000 7fccf5d9b640 1 -- 172.21.15.77:0/2133431557 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcce8032900 con 0x7fccf8107a80 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.495+0000 7fccf5d9b640 1 -- 172.21.15.77:0/2133431557 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8030850 con 0x7fccf8107a80 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 -- 172.21.15.77:0/2133431557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 msgr2=0x7fccf8107e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/2133431557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009820 tx=0x7fcce802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 -- 172.21.15.77:0/2133431557 shutdown_connections 2024-09-15T23:22:19.254 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/2133431557 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf8107e80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 -- 172.21.15.77:0/2133431557 >> 172.21.15.77:0/2133431557 conn(0x7fccf8101af0 msgr2=0x7fccf8103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 -- 172.21.15.77:0/2133431557 shutdown_connections 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.496+0000 7fccfd0b8640 1 -- 172.21.15.77:0/2133431557 wait complete. 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccfd0b8640 1 Processor -- start 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccfd0b8640 1 -- start start 2024-09-15T23:22:19.255 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccfd0b8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccfd0b8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fccf810a950 con 0x7fccf8107a80 2024-09-15T23:22:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccf6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38712/0 (socket says 172.21.15.77:38712) 2024-09-15T23:22:19.256 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccf6d9d640 1 -- 172.21.15.77:0/1018775827 learned_addr learned my addr 172.21.15.77:0/1018775827 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccf6d9d640 1 -- 172.21.15.77:0/1018775827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf819bb60 con 0x7fccf8107a80 2024-09-15T23:22:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.497+0000 7fccf6d9d640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcce80097f0 tx=0x7fcce8030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce8037040 con 0x7fccf8107a80 2024-09-15T23:22:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcce8040070 con 0x7fccf8107a80 2024-09-15T23:22:19.257 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf819bdf0 con 0x7fccf8107a80 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fcce803a390 con 0x7fccf8107a80 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf819eae0 con 0x7fccf8107a80 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.498+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fcce803a5e0 con 0x7fccf8107a80 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.499+0000 7fccdffff640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 0x7fcce003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.499+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fcce806c770 con 0x7fccf8107a80 2024-09-15T23:22:19.258 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.499+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf8107f00 con 0x7fccf8107a80 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.499+0000 7fccf659c640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 0x7fcce003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.499+0000 7fccf659c640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 0x7fcce003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccec0098c0 tx=0x7fccec006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.503+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcce803a920 con 0x7fccf8107a80 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.670+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fccf802d900 con 0x7fcce0039200 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.671+0000 7fccdffff640 1 -- 172.21.15.77:0/1018775827 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fccf802d900 con 0x7fcce0039200 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 msgr2=0x7fcce003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 0x7fcce003b6c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fccec0098c0 tx=0x7fccec006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 msgr2=0x7fccf819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:19.259 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcce80097f0 tx=0x7fcce8030d80 comp rx=0 tx=0).stop 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 shutdown_connections 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fcce0039200 0x7fcce003b6c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 --2- 172.21.15.77:0/1018775827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fccf8107a80 0x7fccf819b620 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 >> 172.21.15.77:0/1018775827 conn(0x7fccf8101af0 msgr2=0x7fccf8102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 shutdown_connections 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:18.674+0000 7fccfd0b8640 1 -- 172.21.15.77:0/1018775827 wait complete. 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:22:19.260 INFO:teuthology.orchestra.run.smithi077.stdout:Adding key to root@localhost authorized_keys... 2024-09-15T23:22:19.261 INFO:teuthology.orchestra.run.smithi077.stdout:Adding host smithi077... 2024-09-15T23:22:19.557 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:19 smithi077 ceph-mon[30968]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:20.613 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:20 smithi077 ceph-mon[30968]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:21.556 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:21 smithi077 ceph-mon[30968]: Deploying cephadm binary to smithi077 2024-09-15T23:22:23.596 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Added host 'smithi077' with addr '172.21.15.77' 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.639+0000 7fd680ab6640 1 Processor -- start 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.639+0000 7fd680ab6640 1 -- start start 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd680ab6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd680ab6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10a840 con 0x7fd67c107f10 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38728/0 (socket says 172.21.15.77:38728) 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd67a59c640 1 -- 172.21.15.77:0/390918170 learned_addr learned my addr 172.21.15.77:0/390918170 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.640+0000 7fd67a59c640 1 -- 172.21.15.77:0/390918170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c10a9c0 con 0x7fd67c107f10 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.641+0000 7fd67a59c640 1 --2- 172.21.15.77:0/390918170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009820 tx=0x7fd66c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf94c755c3400b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.597 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.641+0000 7fd67959a640 1 -- 172.21.15.77:0/390918170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c037070 con 0x7fd67c107f10 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.641+0000 7fd67959a640 1 -- 172.21.15.77:0/390918170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd66c032900 con 0x7fd67c107f10 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.641+0000 7fd67959a640 1 -- 172.21.15.77:0/390918170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c030850 con 0x7fd67c107f10 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 -- 172.21.15.77:0/390918170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 msgr2=0x7fd67c10a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 --2- 172.21.15.77:0/390918170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd66c009820 tx=0x7fd66c02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 -- 172.21.15.77:0/390918170 shutdown_connections 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 --2- 172.21.15.77:0/390918170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c10a300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 -- 172.21.15.77:0/390918170 >> 172.21.15.77:0/390918170 conn(0x7fd67c101af0 msgr2=0x7fd67c103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 -- 172.21.15.77:0/390918170 shutdown_connections 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.642+0000 7fd680ab6640 1 -- 172.21.15.77:0/390918170 wait complete. 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd680ab6640 1 Processor -- start 2024-09-15T23:22:23.598 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd680ab6640 1 -- start start 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd680ab6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd680ab6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd67c10b9a0 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd67a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38740/0 (socket says 172.21.15.77:38740) 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd67a59c640 1 -- 172.21.15.77:0/2183381333 learned_addr learned my addr 172.21.15.77:0/2183381333 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd67a59c640 1 -- 172.21.15.77:0/2183381333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd67c107cd0 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd67a59c640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd66c032ce0 tx=0x7fd66c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.643+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c042070 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.644+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd66c0308c0 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.644+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd66c037040 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.644+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd67c105ec0 con 0x7fd67c107f10 2024-09-15T23:22:23.599 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.644+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd67c106400 con 0x7fd67c107f10 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.645+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fd66c045070 con 0x7fd67c107f10 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.645+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd67c108370 con 0x7fd67c107f10 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.645+0000 7fd66b7fe640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 0x7fd66403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.645+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd66c06c450 con 0x7fd67c107f10 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.645+0000 7fd679d9b640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 0x7fd66403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.646+0000 7fd679d9b640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 0x7fd66403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098c0 tx=0x7fd670006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.650+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd66c045360 con 0x7fd67c107f10 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:19.819+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi077", "addr": "172.21.15.77", "target": ["mon-mgr", ""]}) -- 0x7fd67c106b80 con 0x7fd664039200 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.984+0000 7fd66b7fe640 1 -- 172.21.15.77:0/2183381333 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fd67c106b80 con 0x7fd664039200 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 msgr2=0x7fd66403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.600 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 0x7fd66403b6c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098c0 tx=0x7fd670006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 msgr2=0x7fd67c107790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd66c032ce0 tx=0x7fd66c032d10 comp rx=0 tx=0).stop 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 shutdown_connections 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fd664039200 0x7fd66403b6c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 --2- 172.21.15.77:0/2183381333 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd67c107f10 0x7fd67c107790 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 >> 172.21.15.77:0/2183381333 conn(0x7fd67c101af0 msgr2=0x7fd67c1026b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 shutdown_connections 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:22.987+0000 7fd680ab6640 1 -- 172.21.15.77:0/2183381333 wait complete. 2024-09-15T23:22:23.601 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying unmanaged mon service... 2024-09-15T23:22:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:23 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:23 smithi077 ceph-mon[30968]: Added host smithi077 2024-09-15T23:22:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:23 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe272935640 1 Processor -- start 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe272935640 1 -- start start 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe272935640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe272935640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c107ee0 con 0x7fe26c107510 2024-09-15T23:22:24.906 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38750/0 (socket says 172.21.15.77:38750) 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe26bfff640 1 -- 172.21.15.77:0/971994097 learned_addr learned my addr 172.21.15.77:0/971994097 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.961+0000 7fe26bfff640 1 -- 172.21.15.77:0/971994097 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c1086c0 con 0x7fe26c107510 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.962+0000 7fe26bfff640 1 --2- 172.21.15.77:0/971994097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009820 tx=0x7fe25c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=257359eeda5db427 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.962+0000 7fe26b7fe640 1 -- 172.21.15.77:0/971994097 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c037070 con 0x7fe26c107510 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.962+0000 7fe26b7fe640 1 -- 172.21.15.77:0/971994097 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe25c032900 con 0x7fe26c107510 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.962+0000 7fe26b7fe640 1 -- 172.21.15.77:0/971994097 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c030850 con 0x7fe26c107510 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 -- 172.21.15.77:0/971994097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 msgr2=0x7fe26c107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 --2- 172.21.15.77:0/971994097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009820 tx=0x7fe25c02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 -- 172.21.15.77:0/971994097 shutdown_connections 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 --2- 172.21.15.77:0/971994097 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c107910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.907 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 -- 172.21.15.77:0/971994097 >> 172.21.15.77:0/971994097 conn(0x7fe26c102ce0 msgr2=0x7fe26c105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 -- 172.21.15.77:0/971994097 shutdown_connections 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.963+0000 7fe272935640 1 -- 172.21.15.77:0/971994097 wait complete. 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe272935640 1 Processor -- start 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe272935640 1 -- start start 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe272935640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe272935640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe26c10ba70 con 0x7fe26c107510 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe26bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38752/0 (socket says 172.21.15.77:38752) 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe26bfff640 1 -- 172.21.15.77:0/3368412746 learned_addr learned my addr 172.21.15.77:0/3368412746 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe26bfff640 1 -- 172.21.15.77:0/3368412746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c19ba20 con 0x7fe26c107510 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.964+0000 7fe26bfff640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009940 tx=0x7fe25c032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.908 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.965+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c042070 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.965+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe26c19bcb0 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.965+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe25c0308c0 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.965+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe25c037040 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.965+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe26c19e9a0 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.966+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe25c045070 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.966+0000 7fe269ffb640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 0x7fe25803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.966+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe25c06c320 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.966+0000 7fe263fff640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 0x7fe25803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.966+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe26c10bbf0 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.967+0000 7fe263fff640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 0x7fe25803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098c0 tx=0x7fe254006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:23.971+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe25c03cd90 con 0x7fe26c107510 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.161+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe26c103f30 con 0x7fe2580391b0 2024-09-15T23:22:24.909 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.166+0000 7fe269ffb640 1 -- 172.21.15.77:0/3368412746 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe26c103f30 con 0x7fe2580391b0 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 msgr2=0x7fe25803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 0x7fe25803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe2540098c0 tx=0x7fe254006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 msgr2=0x7fe26c19b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009940 tx=0x7fe25c032ce0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 shutdown_connections 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fe2580391b0 0x7fe25803b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 --2- 172.21.15.77:0/3368412746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe26c107510 0x7fe26c19b4e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 >> 172.21.15.77:0/3368412746 conn(0x7fe26c102ce0 msgr2=0x7fe26c103820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.168+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 shutdown_connections 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:24.169+0000 7fe272935640 1 -- 172.21.15.77:0/3368412746 wait complete. 2024-09-15T23:22:24.910 INFO:teuthology.orchestra.run.smithi077.stdout:Deploying unmanaged mgr service... 2024-09-15T23:22:25.460 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:25 smithi077 ceph-mon[30968]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:25.460 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:25 smithi077 ceph-mon[30968]: Saving service mon spec with placement count:5 2024-09-15T23:22:25.460 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:25 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:26.851 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:26 smithi077 ceph-mon[30968]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:26.852 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:26 smithi077 ceph-mon[30968]: Saving service mgr spec with placement count:2 2024-09-15T23:22:26.852 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:26 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:26.852 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:26 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:26.853 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-15T23:22:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.536+0000 7fde7bf3c640 1 Processor -- start 2024-09-15T23:22:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde7bf3c640 1 -- start start 2024-09-15T23:22:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde7bf3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde7bf3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde74107ee0 con 0x7fde74107510 2024-09-15T23:22:26.859 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde79cd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde79cd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38768/0 (socket says 172.21.15.77:38768) 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde79cd8640 1 -- 172.21.15.77:0/3888542827 learned_addr learned my addr 172.21.15.77:0/3888542827 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.537+0000 7fde79cd8640 1 -- 172.21.15.77:0/3888542827 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde741086c0 con 0x7fde74107510 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.538+0000 7fde79cd8640 1 --2- 172.21.15.77:0/3888542827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde68009820 tx=0x7fde6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc3cd0442866636 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.538+0000 7fde78cd6640 1 -- 172.21.15.77:0/3888542827 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde68037070 con 0x7fde74107510 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.538+0000 7fde78cd6640 1 -- 172.21.15.77:0/3888542827 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde68032900 con 0x7fde74107510 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.538+0000 7fde78cd6640 1 -- 172.21.15.77:0/3888542827 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde68030850 con 0x7fde74107510 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 -- 172.21.15.77:0/3888542827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 msgr2=0x7fde74107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/3888542827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fde68009820 tx=0x7fde6802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 -- 172.21.15.77:0/3888542827 shutdown_connections 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/3888542827 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde74107510 0x7fde74107910 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 -- 172.21.15.77:0/3888542827 >> 172.21.15.77:0/3888542827 conn(0x7fde74102ce0 msgr2=0x7fde74105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.860 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 -- 172.21.15.77:0/3888542827 shutdown_connections 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 -- 172.21.15.77:0/3888542827 wait complete. 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.539+0000 7fde7bf3c640 1 Processor -- start 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde7bf3c640 1 -- start start 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde7bf3c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde7bf3c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fde7410ba70 con 0x7fde7407db00 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde79cd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde79cd8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38778/0 (socket says 172.21.15.77:38778) 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde79cd8640 1 -- 172.21.15.77:0/709615613 learned_addr learned my addr 172.21.15.77:0/709615613 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde79cd8640 1 -- 172.21.15.77:0/709615613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde7407df20 con 0x7fde7407db00 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde79cd8640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde68009940 tx=0x7fde68032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde68037050 con 0x7fde7407db00 2024-09-15T23:22:26.861 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde68043070 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde6803e6b0 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.540+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde7407c7b0 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.541+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde7407cc90 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.541+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fde6803c610 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.541+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde7407e0f0 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.542+0000 7fde66ffd640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 0x7fde6003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.542+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fde6806d120 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.542+0000 7fde794d7640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 0x7fde6003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.542+0000 7fde794d7640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 0x7fde6003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde700098c0 tx=0x7fde70006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.546+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fde6804d200 con 0x7fde7407db00 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.730+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fde74104010 con 0x7fde600391b0 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.734+0000 7fde66ffd640 1 -- 172.21.15.77:0/709615613 <== mgr.14118 v2:172.21.15.77:6800/301680494 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fde74104010 con 0x7fde600391b0 2024-09-15T23:22:26.862 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 msgr2=0x7fde6003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 0x7fde6003b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde700098c0 tx=0x7fde70006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 msgr2=0x7fde7407c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde68009940 tx=0x7fde68032ce0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 shutdown_connections 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fde600391b0 0x7fde6003b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 --2- 172.21.15.77:0/709615613 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fde7407db00 0x7fde7407c270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.736+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 >> 172.21.15.77:0/709615613 conn(0x7fde74102ce0 msgr2=0x7fde74103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.737+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 shutdown_connections 2024-09-15T23:22:26.863 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:25.737+0000 7fde7bf3c640 1 -- 172.21.15.77:0/709615613 wait complete. 2024-09-15T23:22:28.210 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:27 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:28.210 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:27 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4005365689' entity='client.admin' 2024-09-15T23:22:28.235 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.294+0000 7f52876ab640 1 Processor -- start 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.294+0000 7f52876ab640 1 -- start start 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.294+0000 7f52876ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.294+0000 7f52876ab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5280106dc0 con 0x7f52801063f0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.295+0000 7f5285447640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.295+0000 7f5285447640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56430/0 (socket says 172.21.15.77:56430) 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.295+0000 7f5285447640 1 -- 172.21.15.77:0/191062821 learned_addr learned my addr 172.21.15.77:0/191062821 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.295+0000 7f5285447640 1 -- 172.21.15.77:0/191062821 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52801075f0 con 0x7f52801063f0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.296+0000 7f5285447640 1 --2- 172.21.15.77:0/191062821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f527c009820 tx=0x7f527c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8f9aec09cadf4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.296+0000 7f5277fff640 1 -- 172.21.15.77:0/191062821 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c037070 con 0x7f52801063f0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.296+0000 7f5277fff640 1 -- 172.21.15.77:0/191062821 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c032920 con 0x7f52801063f0 2024-09-15T23:22:28.236 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.296+0000 7f5277fff640 1 -- 172.21.15.77:0/191062821 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c030810 con 0x7f52801063f0 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 -- 172.21.15.77:0/191062821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 msgr2=0x7f52801067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 --2- 172.21.15.77:0/191062821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f527c009820 tx=0x7f527c02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 -- 172.21.15.77:0/191062821 shutdown_connections 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 --2- 172.21.15.77:0/191062821 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f52801067f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 -- 172.21.15.77:0/191062821 >> 172.21.15.77:0/191062821 conn(0x7f5280101b80 msgr2=0x7f5280103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 -- 172.21.15.77:0/191062821 shutdown_connections 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.297+0000 7f52876ab640 1 -- 172.21.15.77:0/191062821 wait complete. 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.298+0000 7f52876ab640 1 Processor -- start 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.298+0000 7f52876ab640 1 -- start start 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.298+0000 7f52876ab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.298+0000 7f52876ab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f528010a9a0 con 0x7f52801063f0 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f5285447640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f5285447640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56446/0 (socket says 172.21.15.77:56446) 2024-09-15T23:22:28.237 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f5285447640 1 -- 172.21.15.77:0/4005365689 learned_addr learned my addr 172.21.15.77:0/4005365689 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f5285447640 1 -- 172.21.15.77:0/4005365689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528019a950 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f5285447640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f527c0097f0 tx=0x7f527c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c037040 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f527c030cc0 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528019abe0 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f527c03a640 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.299+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528007afa0 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.300+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528010ab20 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.301+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f527c03a8f0 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.301+0000 7f52767fc640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 0x7f526c03d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.301+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f527c06c770 con 0x7f52801063f0 2024-09-15T23:22:28.238 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.301+0000 7f5284c46640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 0x7f526c03d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.301+0000 7f5284c46640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 0x7f526c03d8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f52700098c0 tx=0x7f5270006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.310+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f527c0328c0 con 0x7f52801063f0 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.493+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f528007b5a0 con 0x7f52801063f0 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.495+0000 7f52767fc640 1 -- 172.21.15.77:0/4005365689 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f527c031990 con 0x7f52801063f0 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 msgr2=0x7f526c03d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 0x7f526c03d8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f52700098c0 tx=0x7f5270006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 msgr2=0x7f528019a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f527c0097f0 tx=0x7f527c0327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 shutdown_connections 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f526c03b410 0x7f526c03d8d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 --2- 172.21.15.77:0/4005365689 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52801063f0 0x7f528019a410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 >> 172.21.15.77:0/4005365689 conn(0x7f5280101b80 msgr2=0x7f5280102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:28.239 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 shutdown_connections 2024-09-15T23:22:28.240 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:27.498+0000 7f52876ab640 1 -- 172.21.15.77:0/4005365689 wait complete. 2024-09-15T23:22:29.535 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.634+0000 7effe45f7640 1 Processor -- start 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.634+0000 7effe45f7640 1 -- start start 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.634+0000 7effe45f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.634+0000 7effe45f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7effdc106180 con 0x7effdc1057b0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.635+0000 7effe2393640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.635+0000 7effe2393640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56458/0 (socket says 172.21.15.77:56458) 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.635+0000 7effe2393640 1 -- 172.21.15.77:0/298775465 learned_addr learned my addr 172.21.15.77:0/298775465 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.635+0000 7effe2393640 1 -- 172.21.15.77:0/298775465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc108790 con 0x7effdc1057b0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.635+0000 7effe2393640 1 --2- 172.21.15.77:0/298775465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effd8009820 tx=0x7effd802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5167839e00473fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe1391640 1 -- 172.21.15.77:0/298775465 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd8037070 con 0x7effdc1057b0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe1391640 1 -- 172.21.15.77:0/298775465 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd8032920 con 0x7effdc1057b0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe1391640 1 -- 172.21.15.77:0/298775465 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd8030810 con 0x7effdc1057b0 2024-09-15T23:22:29.536 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 -- 172.21.15.77:0/298775465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 msgr2=0x7effdc105bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 --2- 172.21.15.77:0/298775465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effd8009820 tx=0x7effd802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 -- 172.21.15.77:0/298775465 shutdown_connections 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 --2- 172.21.15.77:0/298775465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc105bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 -- 172.21.15.77:0/298775465 >> 172.21.15.77:0/298775465 conn(0x7effdc101360 msgr2=0x7effdc103780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.636+0000 7effe45f7640 1 -- 172.21.15.77:0/298775465 shutdown_connections 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe45f7640 1 -- 172.21.15.77:0/298775465 wait complete. 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe45f7640 1 Processor -- start 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe45f7640 1 -- start start 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe45f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe45f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7effdc10b9c0 con 0x7effdc1057b0 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe2393640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe2393640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56474/0 (socket says 172.21.15.77:56474) 2024-09-15T23:22:29.537 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.637+0000 7effe2393640 1 -- 172.21.15.77:0/2113306947 learned_addr learned my addr 172.21.15.77:0/2113306947 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effe2393640 1 -- 172.21.15.77:0/2113306947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc19ba80 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effe2393640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effd8030560 tx=0x7effd8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd8037040 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7effd8040070 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc19bd10 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effd803a740 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.638+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc19ea00 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.639+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7effd803b420 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.639+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc105c30 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.639+0000 7effd37fe640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 0x7effc803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.639+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7effd806c850 con 0x7effdc1057b0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.639+0000 7effe1b92640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 0x7effc803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.640+0000 7effe1b92640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 0x7effc803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7effcc0098c0 tx=0x7effcc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:29.538 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.644+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7effd803a9b0 con 0x7effdc1057b0 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.812+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7effdc19ebd0 con 0x7effdc1057b0 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.815+0000 7effd37fe640 1 -- 172.21.15.77:0/2113306947 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7effd802fd10 con 0x7effdc1057b0 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 msgr2=0x7effc803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 0x7effc803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7effcc0098c0 tx=0x7effcc006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 msgr2=0x7effdc19b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effd8030560 tx=0x7effd8032670 comp rx=0 tx=0).stop 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 shutdown_connections 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7effc80391b0 0x7effc803b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 --2- 172.21.15.77:0/2113306947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7effdc1057b0 0x7effdc19b540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 >> 172.21.15.77:0/2113306947 conn(0x7effdc101360 msgr2=0x7effdc101f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 shutdown_connections 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:28.817+0000 7effe45f7640 1 -- 172.21.15.77:0/2113306947 wait complete. 2024-09-15T23:22:29.539 INFO:teuthology.orchestra.run.smithi077.stdout:Enabling the dashboard module... 2024-09-15T23:22:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:29 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2113306947' entity='client.admin' 2024-09-15T23:22:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:29 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:30 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2315909503' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-15T23:22:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:30 smithi077 ceph-mon[30968]: from='mgr.14118 172.21.15.77:0/345716924' entity='mgr.x' 2024-09-15T23:22:31.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ignoring --setuser ceph since I am not root 2024-09-15T23:22:31.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ignoring --setgroup ceph since I am not root 2024-09-15T23:22:31.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:30.969+0000 7f7714883040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:22:31.134 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.026+0000 7f7714883040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:22:31.394 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.178+0000 7f7714883040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:22:31.394 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.244+0000 7f7714883040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:22:31.394 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.393+0000 7f7714883040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.882+0000 7fc9bb6c7640 1 Processor -- start 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9bb6c7640 1 -- start start 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9bb6c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9bb6c7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b407be40 con 0x7fc9b4107f60 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9b9463640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9b9463640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56486/0 (socket says 172.21.15.77:56486) 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9b9463640 1 -- 172.21.15.77:0/3228583387 learned_addr learned my addr 172.21.15.77:0/3228583387 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:31.419 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.883+0000 7fc9b9463640 1 -- 172.21.15.77:0/3228583387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b410a890 con 0x7fc9b4107f60 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.884+0000 7fc9b9463640 1 --2- 172.21.15.77:0/3228583387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009820 tx=0x7fc9b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c345ff36c3d8020b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.884+0000 7fc9abfff640 1 -- 172.21.15.77:0/3228583387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0037070 con 0x7fc9b4107f60 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.884+0000 7fc9abfff640 1 -- 172.21.15.77:0/3228583387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b0032920 con 0x7fc9b4107f60 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.884+0000 7fc9abfff640 1 -- 172.21.15.77:0/3228583387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0030810 con 0x7fc9b4107f60 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/3228583387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 msgr2=0x7fc9b410a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/3228583387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0009820 tx=0x7fc9b002a270 comp rx=0 tx=0).stop 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/3228583387 shutdown_connections 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/3228583387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b410a350 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/3228583387 >> 172.21.15.77:0/3228583387 conn(0x7fc9b4101bc0 msgr2=0x7fc9b4103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/3228583387 shutdown_connections 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/3228583387 wait complete. 2024-09-15T23:22:31.420 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.885+0000 7fc9bb6c7640 1 Processor -- start 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9bb6c7640 1 -- start start 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9bb6c7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9bb6c7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc9b410b910 con 0x7fc9b4107f60 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9b9463640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9b9463640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56500/0 (socket says 172.21.15.77:56500) 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9b9463640 1 -- 172.21.15.77:0/2315909503 learned_addr learned my addr 172.21.15.77:0/2315909503 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9b9463640 1 -- 172.21.15.77:0/2315909503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9b419ba10 con 0x7fc9b4107f60 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9b9463640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00097f0 tx=0x7fc9b00327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0037040 con 0x7fc9b4107f60 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9b419bca0 con 0x7fc9b4107f60 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9b0030cc0 con 0x7fc9b4107f60 2024-09-15T23:22:31.421 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b003a6b0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.886+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9b419e990 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.887+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc9b003b3f0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.887+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9b41083c0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.887+0000 7fc9aa7fc640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 0x7fc9a003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.888+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc9b006c890 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.888+0000 7fc9b8c62640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 0x7fc9a003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.888+0000 7fc9b8c62640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 0x7fc9a003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098c0 tx=0x7fc9a4006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:29.892+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc9b00371e0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.106+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fc9b419eb60 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.818+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fc9b006c1e0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.820+0000 7fc9aa7fc640 1 -- 172.21.15.77:0/2315909503 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fc9b003a8a0 con 0x7fc9b4107f60 2024-09-15T23:22:31.422 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 msgr2=0x7fc9a003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 0x7fc9a003b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc9a40098c0 tx=0x7fc9a4006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 msgr2=0x7fc9b419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00097f0 tx=0x7fc9b00327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 shutdown_connections 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc9a00391b0 0x7fc9a003b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 --2- 172.21.15.77:0/2315909503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc9b4107f60 0x7fc9b419b4d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.821+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 >> 172.21.15.77:0/2315909503 conn(0x7fc9b4101bc0 msgr2=0x7fc9b41027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.822+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 shutdown_connections 2024-09-15T23:22:31.423 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:30.822+0000 7fc9bb6c7640 1 -- 172.21.15.77:0/2315909503 wait complete. 2024-09-15T23:22:31.655 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.539+0000 7f7714883040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:22:31.958 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2315909503' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-15T23:22:31.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-mon[30968]: mgrmap e9: x(active, since 17s) 2024-09-15T23:22:31.959 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.875+0000 7f7714883040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:22:31.959 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:31.957+0000 7f7714883040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:22:32.383 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:32 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:32.152+0000 7f7714883040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:22:32.754 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.842+0000 7f945aa3a640 1 Processor -- start 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f945aa3a640 1 -- start start 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f945aa3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f945aa3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f94540758e0 con 0x7f9454105da0 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f9453fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f9453fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56528/0 (socket says 172.21.15.77:56528) 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f9453fff640 1 -- 172.21.15.77:0/1669019551 learned_addr learned my addr 172.21.15.77:0/1669019551 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:32.755 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.843+0000 7f9453fff640 1 -- 172.21.15.77:0/1669019551 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94541066e0 con 0x7f9454105da0 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.845+0000 7f9453fff640 1 --2- 172.21.15.77:0/1669019551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9444009820 tx=0x7f944402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f87403f531003f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.845+0000 7f9452ffd640 1 -- 172.21.15.77:0/1669019551 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9444037070 con 0x7f9454105da0 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.845+0000 7f9452ffd640 1 -- 172.21.15.77:0/1669019551 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9444032920 con 0x7f9454105da0 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.845+0000 7f9452ffd640 1 -- 172.21.15.77:0/1669019551 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9444030810 con 0x7f9454105da0 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- 172.21.15.77:0/1669019551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 msgr2=0x7f94541061a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1669019551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9444009820 tx=0x7f944402a270 comp rx=0 tx=0).stop 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- 172.21.15.77:0/1669019551 shutdown_connections 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1669019551 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f94541061a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- 172.21.15.77:0/1669019551 >> 172.21.15.77:0/1669019551 conn(0x7f9454101af0 msgr2=0x7f9454103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- 172.21.15.77:0/1669019551 shutdown_connections 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- 172.21.15.77:0/1669019551 wait complete. 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 Processor -- start 2024-09-15T23:22:32.756 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.846+0000 7f945aa3a640 1 -- start start 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f945aa3a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f945aa3a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9454107820 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f9453fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f9453fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56538/0 (socket says 172.21.15.77:56538) 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f9453fff640 1 -- 172.21.15.77:0/1664014995 learned_addr learned my addr 172.21.15.77:0/1664014995 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f9453fff640 1 -- 172.21.15.77:0/1664014995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945419dd00 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.847+0000 7f9453fff640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94440097f0 tx=0x7f94440327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.848+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9444037040 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.848+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9444030cc0 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.848+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945419df90 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.848+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94541a0c80 con 0x7f9454105da0 2024-09-15T23:22:32.757 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.848+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f944403a6b0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f944403a8c0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94400052c0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f94517fa640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 0x7f943c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f944406d8b0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f94537fe640 1 -- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 msgr2=0x7f943c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.849+0000 7f94537fe640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 0x7f943c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:31.854+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f94440371e0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.050+0000 7f94537fe640 1 -- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 msgr2=0x7f943c03b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.050+0000 7f94537fe640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 0x7f943c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.084+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f9440005dc0 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.085+0000 7f94517fa640 1 -- 172.21.15.77:0/1664014995 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f9444031c30 con 0x7f9454105da0 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 msgr2=0x7f943c03b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:22:32.758 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 0x7f943c03b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 msgr2=0x7f945419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94440097f0 tx=0x7f94440327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 shutdown_connections 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7f943c039200 0x7f943c03b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 --2- 172.21.15.77:0/1664014995 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9454105da0 0x7f945419d7c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 >> 172.21.15.77:0/1664014995 conn(0x7f9454101af0 msgr2=0x7f9454194490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 shutdown_connections 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:32.087+0000 7f945aa3a640 1 -- 172.21.15.77:0/1664014995 wait complete. 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for the mgr to restart... 2024-09-15T23:22:32.759 INFO:teuthology.orchestra.run.smithi077.stdout:Waiting for mgr epoch 9... 2024-09-15T23:22:33.128 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:32 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1664014995' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-15T23:22:33.128 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:33.056+0000 7f7714883040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:22:33.382 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:33.127+0000 7f7714883040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:22:34.062 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:33.852+0000 7f7714883040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:22:34.062 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:33.968+0000 7f7714883040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:22:34.322 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.112+0000 7f7714883040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:22:34.323 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.173+0000 7f7714883040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:22:34.323 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.321+0000 7f7714883040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:22:34.605 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.389+0000 7f7714883040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:22:34.605 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.448+0000 7f7714883040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:22:34.605 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.603+0000 7f7714883040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:22:34.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.669+0000 7f7714883040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:22:34.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.734+0000 7f7714883040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:22:34.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.816+0000 7f7714883040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:22:34.876 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.874+0000 7f7714883040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:22:35.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:34.932+0000 7f7714883040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:35.710+0000 7f7714883040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: Active manager daemon x restarted 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: Activating manager daemon x 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: osdmap e3: 0 total, 0 up, 0 in 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: mgrmap e10: x(active, starting, since 0.00321051s) 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:22:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: Manager daemon x is now available 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-15T23:22:36.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout { 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout } 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.126+0000 7fc865939640 1 Processor -- start 2024-09-15T23:22:37.480 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.126+0000 7fc865939640 1 -- start start 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.126+0000 7fc865939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.126+0000 7fc865939640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc8600758a0 con 0x7fc860107ff0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.127+0000 7fc85effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.127+0000 7fc85effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56548/0 (socket says 172.21.15.77:56548) 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.127+0000 7fc85effd640 1 -- 172.21.15.77:0/1256935035 learned_addr learned my addr 172.21.15.77:0/1256935035 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.127+0000 7fc85effd640 1 -- 172.21.15.77:0/1256935035 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86010a920 con 0x7fc860107ff0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.128+0000 7fc85effd640 1 --2- 172.21.15.77:0/1256935035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc850009820 tx=0x7fc85002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b16c99afdc1fbd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.128+0000 7fc85e7fc640 1 -- 172.21.15.77:0/1256935035 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850037070 con 0x7fc860107ff0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.128+0000 7fc85e7fc640 1 -- 172.21.15.77:0/1256935035 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc850032920 con 0x7fc860107ff0 2024-09-15T23:22:37.481 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.128+0000 7fc85e7fc640 1 -- 172.21.15.77:0/1256935035 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850030810 con 0x7fc860107ff0 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 -- 172.21.15.77:0/1256935035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 msgr2=0x7fc86010a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 --2- 172.21.15.77:0/1256935035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc850009820 tx=0x7fc85002a270 comp rx=0 tx=0).stop 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 -- 172.21.15.77:0/1256935035 shutdown_connections 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 --2- 172.21.15.77:0/1256935035 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86010a3e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 -- 172.21.15.77:0/1256935035 >> 172.21.15.77:0/1256935035 conn(0x7fc860101af0 msgr2=0x7fc860103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 -- 172.21.15.77:0/1256935035 shutdown_connections 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.129+0000 7fc865939640 1 -- 172.21.15.77:0/1256935035 wait complete. 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc865939640 1 Processor -- start 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc865939640 1 -- start start 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc865939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:37.482 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc865939640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc86010ba00 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc85effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc85effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56558/0 (socket says 172.21.15.77:56558) 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc85effd640 1 -- 172.21.15.77:0/3935445041 learned_addr learned my addr 172.21.15.77:0/3935445041 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc85effd640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86019bb00 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.130+0000 7fc85effd640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc850030380 tx=0x7fc850032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.131+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc850037040 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.131+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc850040070 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.131+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc85003a7b0 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.131+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86019bd90 con 0x7fc860107ff0 2024-09-15T23:22:37.483 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.131+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86019ea80 con 0x7fc860107ff0 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fc85003b420 con 0x7fc860107ff0 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc864937640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc84c03be30 con 0x7fc84c039260 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc85006c920 con 0x7fc860107ff0 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc857fff640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 msgr2=0x7fc84c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.132+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:22:37.484 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.333+0000 7fc857fff640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 msgr2=0x7fc84c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.333+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.734+0000 7fc857fff640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 msgr2=0x7fc84c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:33.734+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:34.535+0000 7fc857fff640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 msgr2=0x7fc84c03b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.77:6800/301680494 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:34.535+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:35.714+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fc85006b3d0 con 0x7fc860107ff0 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:35.714+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 msgr2=0x7fc84c03b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:35.714+0000 7fc864937640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.715+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fc85003bc00 con 0x7fc860107ff0 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.716+0000 7fc864937640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 0x7fc84c03f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:37.485 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.716+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fc8500067f0 con 0x7fc84c03cd20 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.716+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 0x7fc84c03f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.717+0000 7fc857fff640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 0x7fc84c03f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc848003980 tx=0x7fc8480092b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.717+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fc8500067f0 con 0x7fc84c03cd20 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.724+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fc860108450 con 0x7fc84c03cd20 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.724+0000 7fc864937640 1 -- 172.21.15.77:0/3935445041 <== mgr.14150 v2:172.21.15.77:6800/2029887224 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fc860108450 con 0x7fc84c03cd20 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 msgr2=0x7fc84c03f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 0x7fc84c03f110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc848003980 tx=0x7fc8480092b0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 msgr2=0x7fc86019b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc850030380 tx=0x7fc850032670 comp rx=0 tx=0).stop 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 shutdown_connections 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c03cd20 0x7fc84c03f110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.486 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:6800/301680494,v1:172.21.15.77:6801/301680494] conn(0x7fc84c039260 0x7fc84c03b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 --2- 172.21.15.77:0/3935445041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc860107ff0 0x7fc86019b5c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 >> 172.21.15.77:0/3935445041 conn(0x7fc860101af0 msgr2=0x7fc860102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 shutdown_connections 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:36.725+0000 7fc865939640 1 -- 172.21.15.77:0/3935445041 wait complete. 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:mgr epoch 9 is available 2024-09-15T23:22:37.487 INFO:teuthology.orchestra.run.smithi077.stdout:Generating a dashboard self-signed certificate... 2024-09-15T23:22:37.596 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:37.234+0000 7f767a34c640 -1 log_channel(cephadm) log [ERR] : [15/Sep/2024:23:22:37] ENGINE Error in HTTPServer.serve 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: Traceback (most recent call last): 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._connections.run(self.expiration_interval) 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._run(expiration_interval) 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: s = self.context.wrap_socket( 2024-09-15T23:22:37.597 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: return self.sslsocket_class._create( 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self.do_handshake() 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: self._sslobj.do_handshake() 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:22:37.598 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:22:37.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-mon[30968]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-15T23:22:37.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-mon[30968]: mgrmap e11: x(active, since 1.0061s) 2024-09-15T23:22:37.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-mon[30968]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-15T23:22:37.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.910+0000 7f3f78d8d640 1 Processor -- start 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.910+0000 7f3f78d8d640 1 -- start start 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.910+0000 7f3f78d8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.910+0000 7f3f78d8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f74106d80 con 0x7f3f741063b0 2024-09-15T23:22:38.693 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.911+0000 7f3f7259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.911+0000 7f3f7259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58846/0 (socket says 172.21.15.77:58846) 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.911+0000 7f3f7259c640 1 -- 172.21.15.77:0/968418406 learned_addr learned my addr 172.21.15.77:0/968418406 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.911+0000 7f3f7259c640 1 -- 172.21.15.77:0/968418406 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f741075b0 con 0x7f3f741063b0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f7259c640 1 --2- 172.21.15.77:0/968418406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009820 tx=0x7f3f6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91833a1c36ad80e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f71d9b640 1 -- 172.21.15.77:0/968418406 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f64037070 con 0x7f3f741063b0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f71d9b640 1 -- 172.21.15.77:0/968418406 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f64032920 con 0x7f3f741063b0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f71d9b640 1 -- 172.21.15.77:0/968418406 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f64030810 con 0x7f3f741063b0 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f78d8d640 1 -- 172.21.15.77:0/968418406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 msgr2=0x7f3f741067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/968418406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f64009820 tx=0x7f3f6402a270 comp rx=0 tx=0).stop 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f78d8d640 1 -- 172.21.15.77:0/968418406 shutdown_connections 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/968418406 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f741067b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.912+0000 7f3f78d8d640 1 -- 172.21.15.77:0/968418406 >> 172.21.15.77:0/968418406 conn(0x7f3f74101bc0 msgr2=0x7f3f74103fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 -- 172.21.15.77:0/968418406 shutdown_connections 2024-09-15T23:22:38.694 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 -- 172.21.15.77:0/968418406 wait complete. 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 Processor -- start 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 -- start start 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.913+0000 7f3f78d8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7410a960 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f7259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f7259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58856/0 (socket says 172.21.15.77:58856) 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f7259c640 1 -- 172.21.15.77:0/3046022025 learned_addr learned my addr 172.21.15.77:0/3046022025 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f7259c640 1 -- 172.21.15.77:0/3046022025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7419dc30 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f7259c640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097f0 tx=0x7f3f640327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f64037040 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f7419dec0 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f64030cc0 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f6403a640 con 0x7f3f741063b0 2024-09-15T23:22:38.695 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.914+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f741a0bb0 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.915+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f3f6403a940 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.915+0000 7f3f6b7fe640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 0x7f3f6003b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.915+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f7410aae0 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.915+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3f6406c890 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.916+0000 7f3f6bfff640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 0x7f3f6003b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.916+0000 7f3f6bfff640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 0x7f3f6003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0098c0 tx=0x7f3f5c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.920+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f6403ba40 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:37.993+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f3f64044920 con 0x7f3f741063b0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.101+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f3f7402da30 con 0x7f3f600390f0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.148+0000 7f3f6b7fe640 1 -- 172.21.15.77:0/3046022025 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f3f7402da30 con 0x7f3f600390f0 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 msgr2=0x7f3f6003b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:38.696 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 0x7f3f6003b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0098c0 tx=0x7f3f5c006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 msgr2=0x7f3f7419d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3f640097f0 tx=0x7f3f640327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 shutdown_connections 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3f600390f0 0x7f3f6003b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 --2- 172.21.15.77:0/3046022025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f741063b0 0x7f3f7419d6f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 >> 172.21.15.77:0/3046022025 conn(0x7f3f74101bc0 msgr2=0x7f3f74102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 shutdown_connections 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:38.151+0000 7f3f78d8d640 1 -- 172.21.15.77:0/3046022025 wait complete. 2024-09-15T23:22:38.697 INFO:teuthology.orchestra.run.smithi077.stdout:Creating initial admin user... 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:37] ENGINE Bus STARTING 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:37] ENGINE Serving on http://172.21.15.77:8765 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:37] ENGINE Serving on https://172.21.15.77:7150 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:37] ENGINE Bus STARTED 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: [15/Sep/2024:23:22:37] ENGINE Error in HTTPServer.serve 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout: Traceback (most recent call last): 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._connections.run(self.expiration_interval) 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-15T23:22:38.883 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._run(expiration_interval) 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: s = self.context.wrap_socket( 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: return self.sslsocket_class._create( 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: self.do_handshake() 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: self._sslobj.do_handshake() 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-15T23:22:38.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: mgrmap e12: x(active, since 2s) 2024-09-15T23:22:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:38.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:39.911 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:39 smithi077 ceph-mon[30968]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:40.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Dc2WFAWkq4ClJHbUQyCK8ucGNSkwZO5yAlFuqRAqjlSYbxxrHbmQa", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726442560, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-15T23:22:40.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6ae7ad640 1 Processor -- start 2024-09-15T23:22:40.714 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6ae7ad640 1 -- start start 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6ae7ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6ae7ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a8107ee0 con 0x7fa6a8107510 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58860/0 (socket says 172.21.15.77:58860) 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.715+0000 7fa6a7fff640 1 -- 172.21.15.77:0/3372963637 learned_addr learned my addr 172.21.15.77:0/3372963637 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.716+0000 7fa6a7fff640 1 -- 172.21.15.77:0/3372963637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a81086c0 con 0x7fa6a8107510 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.716+0000 7fa6a7fff640 1 --2- 172.21.15.77:0/3372963637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa698009820 tx=0x7fa69802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6fcb0d0d3a103b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.718+0000 7fa6a77fe640 1 -- 172.21.15.77:0/3372963637 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698037070 con 0x7fa6a8107510 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.718+0000 7fa6a77fe640 1 -- 172.21.15.77:0/3372963637 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa698032920 con 0x7fa6a8107510 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.718+0000 7fa6a77fe640 1 -- 172.21.15.77:0/3372963637 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698030810 con 0x7fa6a8107510 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/3372963637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 msgr2=0x7fa6a8107910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/3372963637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa698009820 tx=0x7fa69802a270 comp rx=0 tx=0).stop 2024-09-15T23:22:40.715 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/3372963637 shutdown_connections 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/3372963637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a8107910 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/3372963637 >> 172.21.15.77:0/3372963637 conn(0x7fa6a8102ce0 msgr2=0x7fa6a8105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/3372963637 shutdown_connections 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.719+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/3372963637 wait complete. 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6ae7ad640 1 Processor -- start 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6ae7ad640 1 -- start start 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6ae7ad640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6ae7ad640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6a810ba70 con 0x7fa6a8107510 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6a7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58870/0 (socket says 172.21.15.77:58870) 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6a7fff640 1 -- 172.21.15.77:0/822455996 learned_addr learned my addr 172.21.15.77:0/822455996 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6a7fff640 1 -- 172.21.15.77:0/822455996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6a819ba20 con 0x7fa6a8107510 2024-09-15T23:22:40.716 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.720+0000 7fa6a7fff640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6980097f0 tx=0x7fa6980327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.721+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698037040 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.721+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6a819bcb0 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.721+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa698030cc0 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.721+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa69803a640 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.721+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6a819e9a0 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa69803a940 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6a810bbf0 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa6a5ffb640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 0x7fa69403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa69806c980 con 0x7fa6a8107510 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa69ffff640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 0x7fa69403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.722+0000 7fa69ffff640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 0x7fa69403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6900098c0 tx=0x7fa690006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:40.717 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.726+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa69803ba40 con 0x7fa6a8107510 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:39.910+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fa6a819eb70 con 0x7fa694039200 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.134+0000 7fa6a5ffb640 1 -- 172.21.15.77:0/822455996 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fa6a819eb70 con 0x7fa694039200 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 msgr2=0x7fa69403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 0x7fa69403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa6900098c0 tx=0x7fa690006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 msgr2=0x7fa6a819b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa6980097f0 tx=0x7fa6980327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 shutdown_connections 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa694039200 0x7fa69403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 --2- 172.21.15.77:0/822455996 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6a8107510 0x7fa6a819b4e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 >> 172.21.15.77:0/822455996 conn(0x7fa6a8102ce0 msgr2=0x7fa6a8103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 shutdown_connections 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:40.136+0000 7fa6ae7ad640 1 -- 172.21.15.77:0/822455996 wait complete. 2024-09-15T23:22:40.718 INFO:teuthology.orchestra.run.smithi077.stdout:Fetching dashboard port number... 2024-09-15T23:22:41.360 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:41 smithi077 ceph-mon[30968]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:41.361 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:41 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:41.990 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stdout 8443 2024-09-15T23:22:41.990 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.180+0000 7ff41f5ce640 1 Processor -- start 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41f5ce640 1 -- start start 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41f5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41f5ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff41807c810 con 0x7ff41807de20 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41d36a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41d36a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58872/0 (socket says 172.21.15.77:58872) 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41d36a640 1 -- 172.21.15.77:0/3175597606 learned_addr learned my addr 172.21.15.77:0/3175597606 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.181+0000 7ff41d36a640 1 -- 172.21.15.77:0/3175597606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41807c990 con 0x7ff41807de20 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.182+0000 7ff41d36a640 1 --2- 172.21.15.77:0/3175597606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff410009820 tx=0x7ff41002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596bc7248010a05f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.182+0000 7ff417fff640 1 -- 172.21.15.77:0/3175597606 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410037070 con 0x7ff41807de20 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.182+0000 7ff417fff640 1 -- 172.21.15.77:0/3175597606 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410032920 con 0x7ff41807de20 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.182+0000 7ff417fff640 1 -- 172.21.15.77:0/3175597606 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410030890 con 0x7ff41807de20 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- 172.21.15.77:0/3175597606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 msgr2=0x7ff41807c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:41.991 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/3175597606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff410009820 tx=0x7ff41002a300 comp rx=0 tx=0).stop 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- 172.21.15.77:0/3175597606 shutdown_connections 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/3175597606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41807c2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- 172.21.15.77:0/3175597606 >> 172.21.15.77:0/3175597606 conn(0x7ff418102ce0 msgr2=0x7ff418105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- 172.21.15.77:0/3175597606 shutdown_connections 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- 172.21.15.77:0/3175597606 wait complete. 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 Processor -- start 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.183+0000 7ff41f5ce640 1 -- start start 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41f5ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41f5ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff41810db20 con 0x7ff41807de20 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41d36a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41d36a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58880/0 (socket says 172.21.15.77:58880) 2024-09-15T23:22:41.992 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41d36a640 1 -- 172.21.15.77:0/2049062172 learned_addr learned my addr 172.21.15.77:0/2049062172 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41d36a640 1 -- 172.21.15.77:0/2049062172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41819dc20 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41d36a640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4100305a0 tx=0x7ff410030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410037040 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff410040070 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41819deb0 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff41003a390 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.184+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4181a0ba0 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.185+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff41003b430 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.185+0000 7ff4167fc640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 0x7ff40003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.185+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff41006c730 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.185+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff41807c350 con 0x7ff41807de20 2024-09-15T23:22:41.993 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.185+0000 7ff41cb69640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 0x7ff40003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.186+0000 7ff41cb69640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 0x7ff40003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00ad30 tx=0x7ff40c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.190+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff41003a690 con 0x7ff41807de20 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.359+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7ff4181a10d0 con 0x7ff41807de20 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.360+0000 7ff4167fc640 1 -- 172.21.15.77:0/2049062172 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7ff41003b770 con 0x7ff41807de20 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.362+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 msgr2=0x7ff40003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.362+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 0x7ff40003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff40c00ad30 tx=0x7ff40c0093f0 comp rx=0 tx=0).stop 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.362+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 msgr2=0x7ff41819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.362+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff4100305a0 tx=0x7ff410030d70 comp rx=0 tx=0).stop 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 shutdown_connections 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff400039200 0x7ff40003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 --2- 172.21.15.77:0/2049062172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff41807de20 0x7ff41819d6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 >> 172.21.15.77:0/2049062172 conn(0x7ff418102ce0 msgr2=0x7ff418103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:41.994 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 shutdown_connections 2024-09-15T23:22:41.995 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:41.363+0000 7ff41f5ce640 1 -- 172.21.15.77:0/2049062172 wait complete. 2024-09-15T23:22:41.996 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-15T23:22:41.996 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout disabled 2024-09-15T23:22:42.003 INFO:teuthology.orchestra.run.smithi077.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-15T23:22:42.003 INFO:teuthology.orchestra.run.smithi077.stdout:systemctl: stdout inactive 2024-09-15T23:22:42.003 INFO:teuthology.orchestra.run.smithi077.stdout:firewalld.service is not enabled 2024-09-15T23:22:42.003 INFO:teuthology.orchestra.run.smithi077.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-15T23:22:42.004 INFO:teuthology.orchestra.run.smithi077.stdout:Ceph Dashboard is now available at: 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout: URL: https://smithi077.front.sepia.ceph.com:8443/ 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout: User: admin 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout: Password: ihyd8fvqt8 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:42.005 INFO:teuthology.orchestra.run.smithi077.stdout:Saving cluster configuration to /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config directory 2024-09-15T23:22:42.236 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2049062172' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-15T23:22:43.222 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:43 smithi077 ceph-mon[30968]: mgrmap e13: x(active, since 6s) 2024-09-15T23:22:43.222 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:43 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1015319816' entity='client.admin' 2024-09-15T23:22:43.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfe13bd640 1 Processor -- start 2024-09-15T23:22:43.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfe13bd640 1 -- start start 2024-09-15T23:22:43.229 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfe13bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfe13bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc07c7f0 con 0x7fdfdc07de00 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfdaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfdaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58882/0 (socket says 172.21.15.77:58882) 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfdaffd640 1 -- 172.21.15.77:0/1846891957 learned_addr learned my addr 172.21.15.77:0/1846891957 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.403+0000 7fdfdaffd640 1 -- 172.21.15.77:0/1846891957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc07c970 con 0x7fdfdc07de00 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.404+0000 7fdfdaffd640 1 --2- 172.21.15.77:0/1846891957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009820 tx=0x7fdfcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c474807de770b6c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.404+0000 7fdfda7fc640 1 -- 172.21.15.77:0/1846891957 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc037070 con 0x7fdfdc07de00 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.404+0000 7fdfda7fc640 1 -- 172.21.15.77:0/1846891957 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfcc032920 con 0x7fdfdc07de00 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.404+0000 7fdfda7fc640 1 -- 172.21.15.77:0/1846891957 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc030810 con 0x7fdfdc07de00 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1846891957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 msgr2=0x7fdfdc07c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1846891957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009820 tx=0x7fdfcc02a270 comp rx=0 tx=0).stop 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1846891957 shutdown_connections 2024-09-15T23:22:43.230 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1846891957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc07c2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1846891957 >> 172.21.15.77:0/1846891957 conn(0x7fdfdc102ce0 msgr2=0x7fdfdc105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1846891957 shutdown_connections 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1846891957 wait complete. 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 Processor -- start 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.405+0000 7fdfe13bd640 1 -- start start 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfe13bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfe13bd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdfdc10db40 con 0x7fdfdc07de00 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfdaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfdaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58890/0 (socket says 172.21.15.77:58890) 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfdaffd640 1 -- 172.21.15.77:0/1015319816 learned_addr learned my addr 172.21.15.77:0/1015319816 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfdaffd640 1 -- 172.21.15.77:0/1015319816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfdc19dc10 con 0x7fdfdc07de00 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfdaffd640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0097f0 tx=0x7fdfcc0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:43.231 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc037040 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfcc030cc0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfdc19dea0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfcc03a6b0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.406+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfdc1a0b90 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.407+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdfcc03a8a0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.407+0000 7fdfd8ff9640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 0x7fdfc803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.407+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdfcc06ca00 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.407+0000 7fdfd3fff640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 0x7fdfc803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.408+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc07c330 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.408+0000 7fdfd3fff640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 0x7fdfc803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40098c0 tx=0x7fdfc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.412+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdfcc02fd40 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.668+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fdfdc1a0fc0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.670+0000 7fdfd8ff9640 1 -- 172.21.15.77:0/1015319816 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fdfcc0448d0 con 0x7fdfdc07de00 2024-09-15T23:22:43.232 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 msgr2=0x7fdfc803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 0x7fdfc803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40098c0 tx=0x7fdfc4006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 msgr2=0x7fdfdc19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc0097f0 tx=0x7fdfcc0327b0 comp rx=0 tx=0).stop 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 shutdown_connections 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdfc80392a0 0x7fdfc803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 --2- 172.21.15.77:0/1015319816 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdfdc07de00 0x7fdfdc19d6d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 >> 172.21.15.77:0/1015319816 conn(0x7fdfdc102ce0 msgr2=0x7fdfdc103870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 shutdown_connections 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:/usr/bin/ceph: stderr 2024-09-15T23:22:42.672+0000 7fdfe13bd640 1 -- 172.21.15.77:0/1015319816 wait complete. 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:22:43.233 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout:Or, if you are only running a single cluster on this host: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: ceph telemetry on 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout:For more information see: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:43.234 INFO:teuthology.orchestra.run.smithi077.stdout:Bootstrap complete. 2024-09-15T23:22:43.272 INFO:tasks.cephadm:Fetching config... 2024-09-15T23:22:43.272 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:22:43.272 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-15T23:22:43.289 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-15T23:22:43.289 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:22:43.289 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-15T23:22:43.344 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-15T23:22:43.345 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:22:43.345 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-15T23:22:43.409 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-15T23:22:43.410 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:22:43.410 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-15T23:22:43.465 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-15T23:22:43.466 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:22:43.552 INFO:teuthology.orchestra.run.smithi077.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:43.564 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:22:43.605 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:43.618 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-15T23:22:43.661 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCndLDcEuHJ5Pkd9cV+jLpyD5OWSqXigb8128DfXEmv8lNT0nvTfnYv10v4nhwK43GVw873Phk9SFpADPCcFi6PYmLuWRxltf+JnZAKNZsvRcmgOhhpbFwhBoq2SCNyXBiVt11nwPcIFadagHKe7PlHG3dQ1C/8DLWwYrbp8/TYjy7bhSMjOdOim56cK0oC+2igpZykgbUcwD5P0PRtnEkF/O2GT8JibFF0LSExj4WPHuqoCZImuCTKsPZ2aA0KFihsJiTpxMaTL6/4aNSnK0laS6Qkdk10gp88WkRJ+DFrbHjf/vzWopt3w9LPYfLUnObEirh90x+OYRGRiqTpYnhmp4swlGGQ4i7V6Qg7XLItDw4n4SHizu396mBOVCKszIQZayXKzXGTd4m5+pDiRWmA7I+a43eRO4LCCnlWs19Zfqp2CSzN9ZmXRayG95w5j5I15P2U5C5wCtZXqZvtX1vYvyNiAlrXJi2OIPuhgtwmrKw3W7Ldli6cv4ybB4WlQbM= ceph-1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:22:43.674 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-15T23:22:43.920 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:44.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 -- 172.21.15.77:0/3253049510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 msgr2=0x7f24f4104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:44.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 --2- 172.21.15.77:0/3253049510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4104490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009c20 tx=0x7f24ec02aa90 comp rx=0 tx=0).stop 2024-09-15T23:22:44.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 -- 172.21.15.77:0/3253049510 shutdown_connections 2024-09-15T23:22:44.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 --2- 172.21.15.77:0/3253049510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4104490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:44.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 -- 172.21.15.77:0/3253049510 >> 172.21.15.77:0/3253049510 conn(0x7f24f40fbc80 msgr2=0x7f24f40fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:44.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 -- 172.21.15.77:0/3253049510 shutdown_connections 2024-09-15T23:22:44.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.376+0000 7f24f882d640 1 -- 172.21.15.77:0/3253049510 wait complete. 2024-09-15T23:22:44.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f882d640 1 Processor -- start 2024-09-15T23:22:44.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f882d640 1 -- start start 2024-09-15T23:22:44.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f882d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:44.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f882d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41076b0 con 0x7f24f41020a0 2024-09-15T23:22:44.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58902/0 (socket says 172.21.15.77:58902) 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f259c640 1 -- 172.21.15.77:0/1735781883 learned_addr learned my addr 172.21.15.77:0/1735781883 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.377+0000 7f24f259c640 1 -- 172.21.15.77:0/1735781883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f4197240 con 0x7f24f41020a0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24f259c640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006010 tx=0x7f24ec02e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec047070 con 0x7f24f41020a0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f4197530 con 0x7f24f41020a0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24ec003e50 con 0x7f24f41020a0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24ec033050 con 0x7f24f41020a0 2024-09-15T23:22:44.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.378+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f419a1b0 con 0x7f24f41020a0 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.379+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f24ec04a070 con 0x7f24f41020a0 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.379+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f4107e30 con 0x7f24f41020a0 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.379+0000 7f24eb7fe640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 0x7f24e003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.379+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f24ec03e030 con 0x7f24f41020a0 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.379+0000 7f24f1d9b640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 0x7f24e003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:44.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.380+0000 7f24f1d9b640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 0x7f24e003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0098c0 tx=0x7f24dc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:44.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.387+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24ec0373b0 con 0x7f24f41020a0 2024-09-15T23:22:44.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.561+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f24f402d940 con 0x7f24f41020a0 2024-09-15T23:22:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.564+0000 7f24eb7fe640 1 -- 172.21.15.77:0/1735781883 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f24ec0492c0 con 0x7f24f41020a0 2024-09-15T23:22:44.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 msgr2=0x7f24e003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 0x7f24e003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0098c0 tx=0x7f24dc006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 msgr2=0x7f24f4196d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f24ec006010 tx=0x7f24ec02e3c0 comp rx=0 tx=0).stop 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 shutdown_connections 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24e00392a0 0x7f24e003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 --2- 172.21.15.77:0/1735781883 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24f41020a0 0x7f24f4196d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 >> 172.21.15.77:0/1735781883 conn(0x7f24f40fbc80 msgr2=0x7f24f40fc6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 shutdown_connections 2024-09-15T23:22:44.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:44.566+0000 7f24f882d640 1 -- 172.21.15.77:0/1735781883 wait complete. 2024-09-15T23:22:45.567 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-15T23:22:45.568 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-15T23:22:45.717 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:45 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1735781883' entity='client.admin' 2024-09-15T23:22:46.156 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 -- 172.21.15.77:0/2148647850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 msgr2=0x7f3d201019e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 --2- 172.21.15.77:0/2148647850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d201019e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009880 tx=0x7f3d1002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 -- 172.21.15.77:0/2148647850 shutdown_connections 2024-09-15T23:22:46.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 --2- 172.21.15.77:0/2148647850 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d201019e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 -- 172.21.15.77:0/2148647850 >> 172.21.15.77:0/2148647850 conn(0x7f3d200fcd70 msgr2=0x7f3d200ff1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 -- 172.21.15.77:0/2148647850 shutdown_connections 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.637+0000 7f3d26378640 1 -- 172.21.15.77:0/2148647850 wait complete. 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d26378640 1 Processor -- start 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d26378640 1 -- start start 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d26378640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d26378640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201076f0 con 0x7f3d201015e0 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58916/0 (socket says 172.21.15.77:58916) 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d1ffff640 1 -- 172.21.15.77:0/868530257 learned_addr learned my addr 172.21.15.77:0/868530257 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.638+0000 7f3d1ffff640 1 -- 172.21.15.77:0/868530257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d201972a0 con 0x7f3d201015e0 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d1ffff640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d10004f60 tx=0x7f3d100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:46.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d1003f070 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3d10004cc0 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d20197530 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3d10035030 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.639+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d2019a220 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.640+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3d10042070 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.640+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d20107e70 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.640+0000 7f3d1d7fa640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 0x7f3d0803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.640+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3d1006d110 con 0x7f3d201015e0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.640+0000 7f3d1f7fe640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 0x7f3d0803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.641+0000 7f3d1f7fe640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 0x7f3d0803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d140098c0 tx=0x7f3d14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:46.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.645+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3d100433b0 con 0x7f3d201015e0 2024-09-15T23:22:46.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.820+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3d2002d830 con 0x7f3d080392a0 2024-09-15T23:22:46.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.823+0000 7f3d1d7fa640 1 -- 172.21.15.77:0/868530257 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d2002d830 con 0x7f3d080392a0 2024-09-15T23:22:46.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 msgr2=0x7f3d0803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 0x7f3d0803b760 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3d140098c0 tx=0x7f3d14006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 msgr2=0x7f3d20196d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d10004f60 tx=0x7f3d100048f0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 shutdown_connections 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3d080392a0 0x7f3d0803b760 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 --2- 172.21.15.77:0/868530257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3d201015e0 0x7f3d20196d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 >> 172.21.15.77:0/868530257 conn(0x7f3d200fcd70 msgr2=0x7f3d200fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 shutdown_connections 2024-09-15T23:22:46.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:46.825+0000 7f3d26378640 1 -- 172.21.15.77:0/868530257 wait complete. 2024-09-15T23:22:48.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:48.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:48.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:48.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:48.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi077", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:22:48.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:48.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:48.118 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2024-09-15T23:22:48.119 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:22:48.119 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2024-09-15T23:22:48.139 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:22:48.139 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:22:48.197 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2024-09-15T23:22:48.198 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch host add smithi155 2024-09-15T23:22:48.450 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:48.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.848+0000 7f1b3125b640 1 -- 172.21.15.77:0/2217197618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 msgr2=0x7f1b2c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:48.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.848+0000 7f1b3125b640 1 --2- 172.21.15.77:0/2217197618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c106940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009880 tx=0x7f1b1c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 -- 172.21.15.77:0/2217197618 shutdown_connections 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 --2- 172.21.15.77:0/2217197618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c106940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 -- 172.21.15.77:0/2217197618 >> 172.21.15.77:0/2217197618 conn(0x7f1b2c0fc1b0 msgr2=0x7f1b2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 -- 172.21.15.77:0/2217197618 shutdown_connections 2024-09-15T23:22:48.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 -- 172.21.15.77:0/2217197618 wait complete. 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 Processor -- start 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.849+0000 7f1b3125b640 1 -- start start 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b3125b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b3125b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2c10ab90 con 0x7f1b2c106560 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b2ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b2ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55950/0 (socket says 172.21.15.77:55950) 2024-09-15T23:22:48.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b2ad9d640 1 -- 172.21.15.77:0/4167139820 learned_addr learned my addr 172.21.15.77:0/4167139820 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:48.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b2ad9d640 1 -- 172.21.15.77:0/4167139820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2c198500 con 0x7f1b2c106560 2024-09-15T23:22:48.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b2ad9d640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009230 tx=0x7f1b1c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c03f070 con 0x7f1b2c106560 2024-09-15T23:22:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b1c03bc80 con 0x7f1b2c106560 2024-09-15T23:22:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2c198790 con 0x7f1b2c106560 2024-09-15T23:22:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b1c035030 con 0x7f1b2c106560 2024-09-15T23:22:48.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.850+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2c198bf0 con 0x7f1b2c106560 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.851+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b2c101bd0 con 0x7f1b2c106560 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.852+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1b1c042070 con 0x7f1b2c106560 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.852+0000 7f1b28d99640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 0x7f1b1803b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.852+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1b1c06d040 con 0x7f1b2c106560 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.852+0000 7f1b23fff640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 0x7f1b1803b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:48.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.853+0000 7f1b23fff640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 0x7f1b1803b810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b140098c0 tx=0x7f1b14006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:48.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:48.856+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b1c0314c0 con 0x7f1b2c106560 2024-09-15T23:22:49.027 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:49.026+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}) -- 0x7f1b2c1069c0 con 0x7f1b18039350 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: Updating smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:49.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:50.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:49 smithi077 ceph-mon[30968]: Updating smithi077:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:22:50.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:49 smithi077 ceph-mon[30968]: Updating smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:22:51.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:50 smithi077 ceph-mon[30968]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:52.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:51 smithi077 ceph-mon[30968]: Deploying cephadm binary to smithi155 2024-09-15T23:22:52.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.162+0000 7f1b28d99640 1 -- 172.21.15.77:0/4167139820 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f1b2c1069c0 con 0x7f1b18039350 2024-09-15T23:22:52.163 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi155' with addr '172.21.15.155' 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 msgr2=0x7f1b1803b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 0x7f1b1803b810 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b140098c0 tx=0x7f1b14006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 msgr2=0x7f1b2c197fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009230 tx=0x7f1b1c003d40 comp rx=0 tx=0).stop 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 shutdown_connections 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b18039350 0x7f1b1803b810 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.166 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 --2- 172.21.15.77:0/4167139820 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b2c106560 0x7f1b2c197fc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:52.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.164+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 >> 172.21.15.77:0/4167139820 conn(0x7f1b2c0fc1b0 msgr2=0x7f1b2c0fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:52.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.165+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 shutdown_connections 2024-09-15T23:22:52.167 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:52.165+0000 7f1b3125b640 1 -- 172.21.15.77:0/4167139820 wait complete. 2024-09-15T23:22:52.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T23:22:52.988 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:53 smithi077 ceph-mon[30968]: Added host smithi155 2024-09-15T23:22:53.366 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:53.367 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 -- 172.21.15.77:0/1173949179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 msgr2=0x7f939c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 --2- 172.21.15.77:0/1173949179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c107a40 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9390009880 tx=0x7f939002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 -- 172.21.15.77:0/1173949179 shutdown_connections 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 --2- 172.21.15.77:0/1173949179 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c107a40 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 -- 172.21.15.77:0/1173949179 >> 172.21.15.77:0/1173949179 conn(0x7f939c0fd290 msgr2=0x7f939c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 -- 172.21.15.77:0/1173949179 shutdown_connections 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.443+0000 7f93a2b14640 1 -- 172.21.15.77:0/1173949179 wait complete. 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a2b14640 1 Processor -- start 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a2b14640 1 -- start start 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a2b14640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a2b14640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f939c10bc90 con 0x7f939c107660 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a08b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a08b0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55966/0 (socket says 172.21.15.77:55966) 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a08b0640 1 -- 172.21.15.77:0/750872992 learned_addr learned my addr 172.21.15.77:0/750872992 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a08b0640 1 -- 172.21.15.77:0/750872992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c0763e0 con 0x7f939c107660 2024-09-15T23:22:53.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a08b0640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9390009230 tx=0x7f9390003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f939003f070 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f939003bc80 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.444+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c074a30 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.445+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9390035030 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.445+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c074ef0 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.445+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9390042070 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.446+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c102cd0 con 0x7f939c107660 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.446+0000 7f9399ffb640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 0x7f938c03b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:53.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.446+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f939006d1b0 con 0x7f939c107660 2024-09-15T23:22:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.446+0000 7f939bfff640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 0x7f938c03b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:53.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.446+0000 7f939bfff640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 0x7f938c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93880098c0 tx=0x7f9388006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:53.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.450+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f93900314c0 con 0x7f939c107660 2024-09-15T23:22:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.622+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f939c075a20 con 0x7f938c039300 2024-09-15T23:22:53.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.623+0000 7f9399ffb640 1 -- 172.21.15.77:0/750872992 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f939c075a20 con 0x7f938c039300 2024-09-15T23:22:53.624 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:53.625 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2024-09-15T23:22:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 msgr2=0x7f938c03b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 0x7f938c03b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f93880098c0 tx=0x7f9388006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 msgr2=0x7f939c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9390009230 tx=0x7f9390003d40 comp rx=0 tx=0).stop 2024-09-15T23:22:53.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 shutdown_connections 2024-09-15T23:22:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f938c039300 0x7f938c03b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 --2- 172.21.15.77:0/750872992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f939c107660 0x7f939c0744f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.625+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 >> 172.21.15.77:0/750872992 conn(0x7f939c0fd290 msgr2=0x7f939c0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.626+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 shutdown_connections 2024-09-15T23:22:53.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:53.626+0000 7f93a2b14640 1 -- 172.21.15.77:0/750872992 wait complete. 2024-09-15T23:22:54.231 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi159 2024-09-15T23:22:54.231 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:22:54.231 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.conf 2024-09-15T23:22:54.250 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:22:54.250 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:22:54.308 INFO:tasks.cephadm:Adding host smithi159 to orchestrator... 2024-09-15T23:22:54.308 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch host add smithi159 2024-09-15T23:22:54.547 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:54.774 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:54.774 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:54 smithi077 ceph-mon[30968]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.945+0000 7f42a3475640 1 -- 172.21.15.77:0/867326960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 msgr2=0x7f429c106920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.945+0000 7f42a3475640 1 --2- 172.21.15.77:0/867326960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c106920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4298009810 tx=0x7f429802a540 comp rx=0 tx=0).stop 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.945+0000 7f42a3475640 1 -- 172.21.15.77:0/867326960 shutdown_connections 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.945+0000 7f42a3475640 1 --2- 172.21.15.77:0/867326960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c106920 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.945+0000 7f42a3475640 1 -- 172.21.15.77:0/867326960 >> 172.21.15.77:0/867326960 conn(0x7f429c077310 msgr2=0x7f429c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 -- 172.21.15.77:0/867326960 shutdown_connections 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 -- 172.21.15.77:0/867326960 wait complete. 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 Processor -- start 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 -- start start 2024-09-15T23:22:54.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a3475640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f429c10ab70 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a1211640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a1211640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:55978/0 (socket says 172.21.15.77:55978) 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.946+0000 7f42a1211640 1 -- 172.21.15.77:0/1128731935 learned_addr learned my addr 172.21.15.77:0/1128731935 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42a1211640 1 -- 172.21.15.77:0/1128731935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429c199800 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42a1211640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42980045e0 tx=0x7f4298004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4298030e70 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f42980318e0 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f429c199a90 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42980049c0 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.947+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f429c19db90 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.948+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4298039040 con 0x7f429c106540 2024-09-15T23:22:54.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.948+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429c101bb0 con 0x7f429c106540 2024-09-15T23:22:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.948+0000 7f42927fc640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 0x7f428803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.948+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f429806d660 con 0x7f429c106540 2024-09-15T23:22:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.948+0000 7f42a0a10640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 0x7f428803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.949+0000 7f42a0a10640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 0x7f428803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f428c0098c0 tx=0x7f428c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:54.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:54.953+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4298040030 con 0x7f429c106540 2024-09-15T23:22:55.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:55.121+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}) -- 0x7f429c19a620 con 0x7f42880392a0 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:22:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:22:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:57 smithi077 ceph-mon[30968]: Deploying cephadm binary to smithi159 2024-09-15T23:22:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:57 smithi077 ceph-mon[30968]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-15T23:22:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:57 smithi077 ceph-mon[30968]: Updating smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:22:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:57 smithi077 ceph-mon[30968]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:22:58.300 INFO:teuthology.orchestra.run.smithi077.stdout:Added host 'smithi159' with addr '172.21.15.159' 2024-09-15T23:22:58.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.298+0000 7f42927fc640 1 -- 172.21.15.77:0/1128731935 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f429c19a620 con 0x7f42880392a0 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 msgr2=0x7f428803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 0x7f428803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f428c0098c0 tx=0x7f428c006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 msgr2=0x7f429c1992c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f42980045e0 tx=0x7f4298004610 comp rx=0 tx=0).stop 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 shutdown_connections 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42880392a0 0x7f428803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 --2- 172.21.15.77:0/1128731935 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f429c106540 0x7f429c1992c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:58.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 >> 172.21.15.77:0/1128731935 conn(0x7f429c077310 msgr2=0x7f429c0ff3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:58.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 shutdown_connections 2024-09-15T23:22:58.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:58.301+0000 7f42a3475640 1 -- 172.21.15.77:0/1128731935 wait complete. 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: Updating smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:58.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:22:58.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:22:58.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-15T23:22:59.162 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 -- 172.21.15.77:0/2428044171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 msgr2=0x7f4500107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 --2- 172.21.15.77:0/2428044171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500107a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009880 tx=0x7f44f002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 -- 172.21.15.77:0/2428044171 shutdown_connections 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 --2- 172.21.15.77:0/2428044171 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500107a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 -- 172.21.15.77:0/2428044171 >> 172.21.15.77:0/2428044171 conn(0x7f45000fd270 msgr2=0x7f45000ff690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 -- 172.21.15.77:0/2428044171 shutdown_connections 2024-09-15T23:22:59.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.581+0000 7f4504f3f640 1 -- 172.21.15.77:0/2428044171 wait complete. 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.582+0000 7f4504f3f640 1 Processor -- start 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f4504f3f640 1 -- start start 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f4504f3f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f4504f3f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f450010bc90 con 0x7f4500107660 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f44fe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f44fe59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59934/0 (socket says 172.21.15.77:59934) 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f44fe59c640 1 -- 172.21.15.77:0/3481106879 learned_addr learned my addr 172.21.15.77:0/3481106879 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:22:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f44fe59c640 1 -- 172.21.15.77:0/3481106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4500197670 con 0x7f4500107660 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.583+0000 7f44fe59c640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009230 tx=0x7f44f0003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.584+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44f003f070 con 0x7f4500107660 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.584+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4500197900 con 0x7f4500107660 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.584+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f44f003bc80 con 0x7f4500107660 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.584+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44f0035030 con 0x7f4500107660 2024-09-15T23:22:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.584+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f450019ba00 con 0x7f4500107660 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f44f0042070 con 0x7f4500107660 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4500102cd0 con 0x7f4500107660 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f44f7fff640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 0x7f44ec03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f44f006cdc0 con 0x7f4500107660 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f44f5d9b640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 0x7f44ec03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:22:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.585+0000 7f44f5d9b640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 0x7f44ec03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44e80098c0 tx=0x7f44e8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:22:59.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.589+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f44f00314c0 con 0x7f4500107660 2024-09-15T23:22:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.772+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4500107ac0 con 0x7f44ec0392a0 2024-09-15T23:22:59.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.773+0000 7f44f7fff640 1 -- 172.21.15.77:0/3481106879 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f4500107ac0 con 0x7f44ec0392a0 2024-09-15T23:22:59.774 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:22:59.774 INFO:teuthology.orchestra.run.smithi077.stdout:[{"addr": "172.21.15.77", "hostname": "smithi077", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}, {"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}] 2024-09-15T23:22:59.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 msgr2=0x7f44ec03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 0x7f44ec03b760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f44e80098c0 tx=0x7f44e8006db0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 msgr2=0x7f4500197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009230 tx=0x7f44f0003d40 comp rx=0 tx=0).stop 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 shutdown_connections 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44ec0392a0 0x7f44ec03b760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 --2- 172.21.15.77:0/3481106879 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4500107660 0x7f4500197130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 >> 172.21.15.77:0/3481106879 conn(0x7f45000fd270 msgr2=0x7f45000fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 shutdown_connections 2024-09-15T23:22:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:22:59.775+0000 7f4504f3f640 1 -- 172.21.15.77:0/3481106879 wait complete. 2024-09-15T23:23:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:59 smithi077 ceph-mon[30968]: Added host smithi159 2024-09-15T23:23:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:22:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:00.338 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-15T23:23:00.338 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-15T23:23:00.579 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:23:00.978 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:00 smithi077 ceph-mon[30968]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:00.978 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:00 smithi077 ceph-mon[30968]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 -- 172.21.15.77:0/2691011549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 msgr2=0x7f4d1c106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 --2- 172.21.15.77:0/2691011549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c106940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009880 tx=0x7f4d1802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 -- 172.21.15.77:0/2691011549 shutdown_connections 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 --2- 172.21.15.77:0/2691011549 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c106940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 -- 172.21.15.77:0/2691011549 >> 172.21.15.77:0/2691011549 conn(0x7f4d1c0fc1b0 msgr2=0x7f4d1c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 -- 172.21.15.77:0/2691011549 shutdown_connections 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.057+0000 7f4d24175640 1 -- 172.21.15.77:0/2691011549 wait complete. 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d24175640 1 Processor -- start 2024-09-15T23:23:01.062 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d24175640 1 -- start start 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d24175640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d24175640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c10ab90 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d21f11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d21f11640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:59938/0 (socket says 172.21.15.77:59938) 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.058+0000 7f4d21f11640 1 -- 172.21.15.77:0/3269947838 learned_addr learned my addr 172.21.15.77:0/3269947838 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d21f11640 1 -- 172.21.15.77:0/3269947838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c198490 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d21f11640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009230 tx=0x7f4d18003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d1803f070 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d1803bc80 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c198720 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d18035030 con 0x7f4d1c106560 2024-09-15T23:23:01.063 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.059+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c198b80 con 0x7f4d1c106560 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.060+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4d18042070 con 0x7f4d1c106560 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.060+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c101bd0 con 0x7f4d1c106560 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.060+0000 7f4d12ffd640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 0x7f4d0803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.060+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4d1806cca0 con 0x7f4d1c106560 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.060+0000 7f4d21710640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 0x7f4d0803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:01.064 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.061+0000 7f4d21710640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 0x7f4d0803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098c0 tx=0x7f4d0c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:01.065 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.065+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4d18042360 con 0x7f4d1c106560 2024-09-15T23:23:01.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.234+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f4d1c1069c0 con 0x7f4d1c106560 2024-09-15T23:23:01.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.884+0000 7f4d12ffd640 1 -- 172.21.15.77:0/3269947838 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f4d18031e20 con 0x7f4d1c106560 2024-09-15T23:23:01.885 INFO:teuthology.orchestra.run.smithi077.stderr:adjusted tunables profile to default 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 msgr2=0x7f4d0803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 0x7f4d0803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098c0 tx=0x7f4d0c006db0 comp rx=0 tx=0).stop 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 msgr2=0x7f4d1c197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4d18009230 tx=0x7f4d18003d40 comp rx=0 tx=0).stop 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 shutdown_connections 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4d080392a0 0x7f4d0803b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 --2- 172.21.15.77:0/3269947838 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4d1c106560 0x7f4d1c197f50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 >> 172.21.15.77:0/3269947838 conn(0x7f4d1c0fc1b0 msgr2=0x7f4d1c0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.886+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 shutdown_connections 2024-09-15T23:23:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:01.887+0000 7f4d24175640 1 -- 172.21.15.77:0/3269947838 wait complete. 2024-09-15T23:23:02.191 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:01 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:23:02.440 INFO:tasks.cephadm:Adding mon.a on smithi077 2024-09-15T23:23:02.440 INFO:tasks.cephadm:Adding mon.b on smithi155 2024-09-15T23:23:02.440 INFO:tasks.cephadm:Adding mon.c on smithi159 2024-09-15T23:23:02.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c' 2024-09-15T23:23:02.763 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T23:23:02.810 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 -- 172.21.15.159:0/1655686162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 msgr2=0x7f5bb8104580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 --2- 172.21.15.159:0/1655686162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8104580 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009880 tx=0x7f5bb002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 -- 172.21.15.159:0/1655686162 shutdown_connections 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 --2- 172.21.15.159:0/1655686162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8104580 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 -- 172.21.15.159:0/1655686162 >> 172.21.15.159:0/1655686162 conn(0x7f5bb80fbcd0 msgr2=0x7f5bb80fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:03.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 -- 172.21.15.159:0/1655686162 shutdown_connections 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.276+0000 7f5bc038d640 1 -- 172.21.15.159:0/1655686162 wait complete. 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bc038d640 1 Processor -- start 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bc038d640 1 -- start start 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bc038d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bc038d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb81076d0 con 0x7f5bb8102190 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bbe129640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bbe129640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.159:48306/0 (socket says 172.21.15.159:48306) 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bbe129640 1 -- 172.21.15.159:0/3345324584 learned_addr learned my addr 172.21.15.159:0/3345324584 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bbe129640 1 -- 172.21.15.159:0/3345324584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb8101f50 con 0x7f5bb8102190 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.277+0000 7f5bbe129640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0004f60 tx=0x7f5bb00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.278+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb003f070 con 0x7f5bb8102190 2024-09-15T23:23:03.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.278+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5bb0003ad0 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.278+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb8100140 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.278+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bb0035030 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.278+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb8100680 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.279+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5bb0042070 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.279+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb8107e50 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.279+0000 7f5bb77fe640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 0x7f5ba003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.279+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f5bb006d1a0 con 0x7f5bb8102190 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.279+0000 7f5bbd928640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 0x7f5ba003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.280+0000 7f5bbd928640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 0x7f5ba003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00ad30 tx=0x7f5bac0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:03.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.284+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5bb0039350 con 0x7f5bb8102190 2024-09-15T23:23:03.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:03.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:23:03.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:03.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:03.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:02 smithi077 ceph-mon[30968]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:03.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.468+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}) -- 0x7f5bb8190250 con 0x7f5ba00392a0 2024-09-15T23:23:03.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.474+0000 7f5bb77fe640 1 -- 172.21.15.159:0/3345324584 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f5bb8190250 con 0x7f5ba00392a0 2024-09-15T23:23:03.475 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mon update... 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.476+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 msgr2=0x7f5ba003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.476+0000 7f5bc038d640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 0x7f5ba003b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00ad30 tx=0x7f5bac0093f0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.476+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 msgr2=0x7f5bb8101a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.476+0000 7f5bc038d640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0004f60 tx=0x7f5bb00048f0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 shutdown_connections 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5ba00392a0 0x7f5ba003b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 --2- 172.21.15.159:0/3345324584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5bb8102190 0x7f5bb8101a10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 >> 172.21.15.159:0/3345324584 conn(0x7f5bb80fbcd0 msgr2=0x7f5bb80fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 shutdown_connections 2024-09-15T23:23:03.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:03.477+0000 7f5bc038d640 1 -- 172.21.15.159:0/3345324584 wait complete. 2024-09-15T23:23:04.106 DEBUG:teuthology.orchestra.run.smithi155:mon.b> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.b.service 2024-09-15T23:23:04.109 DEBUG:teuthology.orchestra.run.smithi159:mon.c> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.c.service 2024-09-15T23:23:04.112 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:23:04.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:23:04.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:23:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: Saving service mon spec with placement smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c;count:3 2024-09-15T23:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:23:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:04.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:04.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:04.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:04 smithi077 ceph-mon[30968]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:04.388 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:04.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 -- 172.21.15.159:0/1359750147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 msgr2=0x7f7848107960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 --2- 172.21.15.159:0/1359750147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f7848107960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f783c009880 tx=0x7f783c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 -- 172.21.15.159:0/1359750147 shutdown_connections 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 --2- 172.21.15.159:0/1359750147 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f7848107960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 -- 172.21.15.159:0/1359750147 >> 172.21.15.159:0/1359750147 conn(0x7f7848078260 msgr2=0x7f78480ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 -- 172.21.15.159:0/1359750147 shutdown_connections 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.812+0000 7f784df9d640 1 -- 172.21.15.159:0/1359750147 wait complete. 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.813+0000 7f784df9d640 1 Processor -- start 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.813+0000 7f784df9d640 1 -- start start 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.813+0000 7f784df9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.813+0000 7f784df9d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f784810bbb0 con 0x7f7848107580 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.813+0000 7f784cf9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:04.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f784cf9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.159:48324/0 (socket says 172.21.15.159:48324) 2024-09-15T23:23:04.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f784cf9b640 1 -- 172.21.15.159:0/800207323 learned_addr learned my addr 172.21.15.159:0/800207323 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:04.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f784cf9b640 1 -- 172.21.15.159:0/800207323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78480763e0 con 0x7f7848107580 2024-09-15T23:23:04.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f784cf9b640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:04.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c03f070 con 0x7f7848107580 2024-09-15T23:23:04.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7848074a30 con 0x7f7848107580 2024-09-15T23:23:04.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f783c03bc80 con 0x7f7848107580 2024-09-15T23:23:04.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.814+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f783c035030 con 0x7f7848107580 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.815+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7848074ef0 con 0x7f7848107580 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f783c042070 con 0x7f7848107580 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7848102ae0 con 0x7f7848107580 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f7845ffb640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 0x7f783803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f783c06d9e0 con 0x7f7848107580 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f7847fff640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 0x7f783803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:04.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.816+0000 7f7847fff640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 0x7f783803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78340098c0 tx=0x7f7834006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:04.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:04.821+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f783c031dd0 con 0x7f7848107580 2024-09-15T23:23:05.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.069+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7848075a20 con 0x7f7848107580 2024-09-15T23:23:05.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.070+0000 7f7845ffb640 1 -- 172.21.15.159:0/800207323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f783c03a890 con 0x7f7848107580 2024-09-15T23:23:05.071 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:23:05.071 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","modified":"2024-09-15T23:21:38.646735Z","created":"2024-09-15T23:21:38.646735Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T23:23:05.071 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 msgr2=0x7f783803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 0x7f783803b7c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f78340098c0 tx=0x7f7834006db0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 msgr2=0x7f78480744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f783c009230 tx=0x7f783c003d40 comp rx=0 tx=0).stop 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 shutdown_connections 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7838039300 0x7f783803b7c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 --2- 172.21.15.159:0/800207323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7848107580 0x7f78480744f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:05.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 >> 172.21.15.159:0/800207323 conn(0x7f7848078260 msgr2=0x7f78480fe9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:05.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 shutdown_connections 2024-09-15T23:23:05.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:05.072+0000 7f784df9d640 1 -- 172.21.15.159:0/800207323 wait complete. 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: Deploying daemon mon.c on smithi159 2024-09-15T23:23:05.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:05 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/800207323' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:06 smithi077 ceph-mon[30968]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:07.334 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:23:07.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:23:07.705 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:23:08.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 -- 172.21.15.159:0/1655476173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 msgr2=0x7f4468107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 --2- 172.21.15.159:0/1655476173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f4468107a40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4458009880 tx=0x7f445802a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 -- 172.21.15.159:0/1655476173 shutdown_connections 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 --2- 172.21.15.159:0/1655476173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f4468107a40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 -- 172.21.15.159:0/1655476173 >> 172.21.15.159:0/1655476173 conn(0x7f44680fd320 msgr2=0x7f44680ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 -- 172.21.15.159:0/1655476173 shutdown_connections 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 -- 172.21.15.159:0/1655476173 wait complete. 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.317+0000 7f446d8a9640 1 Processor -- start 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f446d8a9640 1 -- start start 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f446d8a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:08.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f446d8a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f446810bd20 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f4466ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f4466ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.159:48352/0 (socket says 172.21.15.159:48352) 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.318+0000 7f4466ffd640 1 -- 172.21.15.159:0/3071848042 learned_addr learned my addr 172.21.15.159:0/3071848042 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f4466ffd640 1 -- 172.21.15.159:0/3071848042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44680763e0 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f4466ffd640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4458009230 tx=0x7f4458003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f445803f070 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f445803bc80 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4468074a90 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4458035030 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.319+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4468074f50 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.320+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f4458042070 con 0x7f4468107660 2024-09-15T23:23:08.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.320+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468102da0 con 0x7f4468107660 2024-09-15T23:23:08.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.320+0000 7f446c8a7640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 0x7f445003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:08.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.320+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f445806d0c0 con 0x7f4468107660 2024-09-15T23:23:08.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.320+0000 7f44667fc640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 0x7f445003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:08.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.321+0000 7f44667fc640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 0x7f445003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f445c0098c0 tx=0x7f445c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:08.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.325+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4458031e20 con 0x7f4468107660 2024-09-15T23:23:08.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.575+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4468075a20 con 0x7f4468107660 2024-09-15T23:23:08.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.575+0000 7f446c8a7640 1 -- 172.21.15.159:0/3071848042 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f44580372d0 con 0x7f4468107660 2024-09-15T23:23:08.578 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 1 2024-09-15T23:23:08.578 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:23:08.578 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":1,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","modified":"2024-09-15T23:21:38.646735Z","created":"2024-09-15T23:21:38.646735Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-15T23:23:08.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 msgr2=0x7f445003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 0x7f445003b760 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f445c0098c0 tx=0x7f445c006db0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 msgr2=0x7f44680744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4458009230 tx=0x7f4458003d40 comp rx=0 tx=0).stop 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 shutdown_connections 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f44500392a0 0x7f445003b760 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 --2- 172.21.15.159:0/3071848042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4468107660 0x7f44680744f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 >> 172.21.15.159:0/3071848042 conn(0x7f44680fd320 msgr2=0x7f4468105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 shutdown_connections 2024-09-15T23:23:08.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:08.578+0000 7f446d8a9640 1 -- 172.21.15.159:0/3071848042 wait complete. 2024-09-15T23:23:08.873 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:08 smithi159 systemd[1]: Starting Ceph mon.c for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:23:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:08 smithi077 ceph-mon[30968]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/3071848042' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:09.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 podman[35453]: 2024-09-15 23:23:09.245233481 +0000 UTC m=+0.015740330 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:23:09.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 podman[35453]: 2024-09-15 23:23:09.365061719 +0000 UTC m=+0.135568598 container create 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T23:23:09.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 podman[35453]: 2024-09-15 23:23:09.575815333 +0000 UTC m=+0.346322169 container init 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T23:23:09.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 podman[35453]: 2024-09-15 23:23:09.578971 +0000 UTC m=+0.349477837 container start 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T23:23:09.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: set uid:gid to 167:167 (ceph:ceph) 2024-09-15T23:23:09.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable), process ceph-mon, pid 2 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pidfile_write: ignore empty --pid-file 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: load: jerasure load: lrc 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: RocksDB version: 7.9.2 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Git sha 0 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Compile date 2024-09-15 15:04:35 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: DB SUMMARY 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: DB Session ID: NI2N9CCQTN6A3Y3P6ROW 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: CURRENT file: CURRENT 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: IDENTITY file: IDENTITY 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-15T23:23:09.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.error_if_exists: 0 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.create_if_missing: 0 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.paranoid_checks: 1 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.env: 0x5579cb325940 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.fs: PosixFileSystem 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.info_log: 0x5579cdafd6e0 2024-09-15T23:23:09.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_file_opening_threads: 16 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.statistics: (nil) 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.use_fsync: 0 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_log_file_size: 0 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.keep_log_file_num: 1000 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.recycle_log_file_num: 0 2024-09-15T23:23:09.969 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_fallocate: 1 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_mmap_reads: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_mmap_writes: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.use_direct_reads: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.create_missing_column_families: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.db_log_dir: 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.wal_dir: 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-15T23:23:09.970 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-15T23:23:09.971 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.advise_random_on_open: 1 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.db_write_buffer_size: 0 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.write_buffer_manager: 0x5579cdb0cdc0 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.rate_limiter: (nil) 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.wal_recovery_mode: 2 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enable_thread_tracking: 0 2024-09-15T23:23:09.972 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enable_pipelined_write: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.unordered_write: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.row_cache: None 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.wal_filter: None 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_ingest_behind: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.two_write_queues: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.manual_wal_flush: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.wal_compression: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.atomic_flush: 0 2024-09-15T23:23:09.973 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.log_readahead_size: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.best_efforts_recovery: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.allow_data_in_errors: 0 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.db_host_id: __hostname__ 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_background_jobs: 2 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_background_compactions: -1 2024-09-15T23:23:09.974 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_subcompactions: 1 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_total_wal_size: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_open_files: -1 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bytes_per_sync: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_readahead_size: 0 2024-09-15T23:23:09.975 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_background_flushes: -1 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Compression algorithms supported: 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kZSTD supported: 0 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kXpressCompression supported: 0 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kBZip2Compression supported: 0 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kLZ4Compression supported: 1 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kZlibCompression supported: 1 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kLZ4HCCompression supported: 1 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: kSnappyCompression supported: 1 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-15T23:23:09.976 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.merge_operator: 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_filter: None 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_filter_factory: None 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.sst_partitioner_factory: None 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5579cdafd320) 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-09-15T23:23:09.977 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_type: 0 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_index_type: 0 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_shortening: 1 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: checksum: 4 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: no_block_cache: 0 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache: 0x5579cdaf11f0 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_options: 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: capacity : 536870912 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_shard_bits : 4 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: strict_capacity_limit : 0 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-09-15T23:23:09.978 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_cache_compressed: (nil) 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: persistent_cache: (nil) 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size: 4096 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_size_deviation: 10 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_restart_interval: 16 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: index_block_restart_interval: 1 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: metadata_block_size: 4096 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: partition_filters: 0 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: use_delta_encoding: 1 2024-09-15T23:23:09.979 INFO:journalctl@ceph.mon.c.smithi159.stdout: filter_policy: bloomfilter 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: whole_key_filtering: 1 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: verify_compression: 0 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: format_version: 5 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_index_compression: 1 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: block_align: 0 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: max_auto_readahead_size: 262144 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: prepopulate_block_cache: 0 2024-09-15T23:23:09.980 INFO:journalctl@ceph.mon.c.smithi159.stdout: initial_auto_readahead_size: 8192 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.write_buffer_size: 33554432 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_write_buffer_number: 2 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression: NoCompression 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression: Disabled 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.prefix_extractor: nullptr 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-15T23:23:09.981 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.num_levels: 7 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:23:09.982 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.level: 32767 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.strategy: 0 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.enabled: false 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.target_file_size_base: 67108864 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-15T23:23:09.983 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-15T23:23:09.984 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.arena_block_size: 1048576 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.disable_auto_compactions: 0 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-15T23:23:09.985 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.inplace_update_support: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.bloom_locality: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.max_successive_merges: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.paranoid_file_checks: 0 2024-09-15T23:23:09.986 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.force_consistency_checks: 1 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.report_bg_io_stats: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.ttl: 2592000 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enable_blob_files: false 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.min_blob_size: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_file_size: 268435456 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-15T23:23:09.987 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.blob_file_starting_level: 0 2024-09-15T23:23:09.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-15T23:23:09.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-15T23:23:09.988 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 12b9e3d6-8828-4098-9690-a503090951e1 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442589605919, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442589606335, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726442589, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "12b9e3d6-8828-4098-9690-a503090951e1", "db_session_id": "NI2N9CCQTN6A3Y3P6ROW", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726442589606432, "job": 1, "event": "recovery_finished"} 2024-09-15T23:23:09.989 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5579cdb1ee00 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: DB pointer 0x5579cdc1a000 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** DB Stats ** 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-15T23:23:09.990 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** Compaction Stats [default] ** 2024-09-15T23:23:09.991 INFO:journalctl@ceph.mon.c.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-15T23:23:09.992 INFO:journalctl@ceph.mon.c.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache BinnedLRUCache@0x5579cdaf11f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.993 INFO:journalctl@ceph.mon.c.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: using public_addr v2:172.21.15.159:0/0 -> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: starting mon.c rank -1 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(???) e0 preinit fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).mds e1 new map 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout: e1 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout: btime 2024-09-15T23:21:49:385354+0000 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:23:09.994 INFO:journalctl@ceph.mon.c.smithi159.stdout: legacy client fscid: -1 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout: 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout: No filesystems configured 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Added host smithi159 2024-09-15T23:23:09.995 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:23:09.996 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:09.997 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Saving service mon spec with placement smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c;count:3 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.998 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:09.999 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: Deploying daemon mon.c on smithi159 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/800207323' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:10.000 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:10.001 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/3071848042' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:10.001 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 ceph-mon[35472]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T23:23:10.001 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 bash[35453]: 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 2024-09-15T23:23:10.001 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:09 smithi159 systemd[1]: Started Ceph mon.c for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:23:10.135 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:23:10.136 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:23:10.384 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:23:14.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:14.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: mon.a calling monitor election 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: mon.c calling monitor election 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: monmap epoch 2 2024-09-15T23:23:14.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: last_changed 2024-09-15T23:23:09.631737+0000 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: min_mon_release 19 (squid) 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: election_strategy: 1 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: fsmap 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: mgrmap e13: x(active, since 38s) 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: overall HEALTH_OK 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:14.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:14.968 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:14.968 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:14.968 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: mon.a calling monitor election 2024-09-15T23:23:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: mon.c calling monitor election 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: monmap epoch 2 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: last_changed 2024-09-15T23:23:09.631737+0000 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-15T23:23:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: election_strategy: 1 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: fsmap 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: mgrmap e13: x(active, since 38s) 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: overall HEALTH_OK 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:15.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:15.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 -- 172.21.15.159:0/734734516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f504c003530 msgr2=0x7f504c0059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 --2- 172.21.15.159:0/734734516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f504c003530 0x7f504c0059c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5064102b00 tx=0x7f505802c490 comp rx=0 tx=0).stop 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 -- 172.21.15.159:0/734734516 shutdown_connections 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 --2- 172.21.15.159:0/734734516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f504c003530 0x7f504c0059c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 -- 172.21.15.159:0/734734516 >> 172.21.15.159:0/734734516 conn(0x7f50640fd330 msgr2=0x7f50640ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 -- 172.21.15.159:0/734734516 shutdown_connections 2024-09-15T23:23:15.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.190+0000 7f5068adc640 1 -- 172.21.15.159:0/734734516 wait complete. 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 Processor -- start 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 -- start start 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 0x7f506419bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5064109790 con 0x7f50641977f0 2024-09-15T23:23:15.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.192+0000 7f5068adc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5064109610 con 0x7f504c003530 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33364/0 (socket says 172.21.15.159:33364) 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 -- 172.21.15.159:0/1910280981 learned_addr learned my addr 172.21.15.159:0/1910280981 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f5061d9b640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 0x7f506419bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 -- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 msgr2=0x7f50641972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 -- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 msgr2=0x7f50641972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f506259c640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f5061d9b640 1 -- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 msgr2=0x7f50641972b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f5061d9b640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f5061d9b640 1 -- 172.21.15.159:0/1910280981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5064197e10 con 0x7f50641977f0 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.193+0000 7f5061d9b640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 0x7f506419bb80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f505400b3d0 tx=0x7f505400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:15.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.194+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5054011630 con 0x7f50641977f0 2024-09-15T23:23:15.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.194+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5054011cb0 con 0x7f50641977f0 2024-09-15T23:23:15.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.194+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f506419c0c0 con 0x7f50641977f0 2024-09-15T23:23:15.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.194+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f5054010df0 con 0x7f50641977f0 2024-09-15T23:23:15.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.194+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f506419c600 con 0x7f50641977f0 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.195+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f5054018020 con 0x7f50641977f0 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.195+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5064102db0 con 0x7f50641977f0 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.195+0000 7f50537fe640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 0x7f504403b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.195+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f505404bf80 con 0x7f50641977f0 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.195+0000 7f506259c640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 0x7f504403b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:15.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.196+0000 7f506259c640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 0x7f504403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5058012c10 tx=0x7f50580323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:15.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.200+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f505401f020 con 0x7f50641977f0 2024-09-15T23:23:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.433+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f5064190fa0 con 0x7f50641977f0 2024-09-15T23:23:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.433+0000 7f50537fe640 1 -- 172.21.15.159:0/1910280981 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f5054018310 con 0x7f50641977f0 2024-09-15T23:23:15.434 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:23:15.435 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","modified":"2024-09-15T23:23:09.631737Z","created":"2024-09-15T23:21:38.646735Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:23:15.435 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.435+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 msgr2=0x7f504403b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.435+0000 7f5068adc640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 0x7f504403b550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5058012c10 tx=0x7f50580323a0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 msgr2=0x7f506419bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 0x7f506419bb80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f505400b3d0 tx=0x7f505400b890 comp rx=0 tx=0).stop 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 shutdown_connections 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5044039090 0x7f504403b550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f50641977f0 0x7f506419bb80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 --2- 172.21.15.159:0/1910280981 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f504c003530 0x7f50641972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 >> 172.21.15.159:0/1910280981 conn(0x7f50640fd330 msgr2=0x7f50640ff260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 shutdown_connections 2024-09-15T23:23:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:15.436+0000 7f5068adc640 1 -- 172.21.15.159:0/1910280981 wait complete. 2024-09-15T23:23:15.702 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:15 smithi159 ceph-mon[35472]: Deploying daemon mon.b on smithi155 2024-09-15T23:23:15.702 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:15 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/1910280981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:16.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:15 smithi077 ceph-mon[30968]: Deploying daemon mon.b on smithi155 2024-09-15T23:23:16.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:15 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/1910280981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:16 smithi159 ceph-mon[35472]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:17.086 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:23:17.087 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:23:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:16 smithi077 ceph-mon[30968]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:17.426 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:23:17.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 -- 172.21.15.159:0/761549738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8107660 msgr2=0x7f7bc8107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 --2- 172.21.15.159:0/761549738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8107660 0x7f7bc8107a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009880 tx=0x7f7bb002a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 -- 172.21.15.159:0/761549738 shutdown_connections 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 --2- 172.21.15.159:0/761549738 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8107660 0x7f7bc8107a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 -- 172.21.15.159:0/761549738 >> 172.21.15.159:0/761549738 conn(0x7f7bc80fd320 msgr2=0x7f7bc80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 -- 172.21.15.159:0/761549738 shutdown_connections 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.864+0000 7f7bcd947640 1 -- 172.21.15.159:0/761549738 wait complete. 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 Processor -- start 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 -- start start 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 0x7f7bc819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc810bd20 con 0x7f7bc8197900 2024-09-15T23:23:17.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bcd947640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc810bba0 con 0x7f7bc8107660 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bc6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33376/0 (socket says 172.21.15.159:33376) 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bc67fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 0x7f7bc819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.865+0000 7f7bc6ffd640 1 -- 172.21.15.159:0/1750098908 learned_addr learned my addr 172.21.15.159:0/1750098908 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc6ffd640 1 -- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 msgr2=0x7f7bc81973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc6ffd640 1 -- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 msgr2=0x7f7bc81973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc6ffd640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc6ffd640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc67fc640 1 -- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 msgr2=0x7f7bc81973c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc67fc640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc67fc640 1 -- 172.21.15.159:0/1750098908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc8197f20 con 0x7f7bc8197900 2024-09-15T23:23:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bc67fc640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 0x7f7bc819bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b3d0 tx=0x7f7bb800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7bb8011630 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bb8011cb0 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f7bb8010df0 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc819c1d0 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.866+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc819c710 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.867+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7bb8018020 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.867+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc8102da0 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.867+0000 7f7bcc945640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 0x7f7bb403b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.867+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7bb804bfb0 con 0x7f7bc8197900 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.868+0000 7f7bc6ffd640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 0x7f7bb403b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.868+0000 7f7bc6ffd640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 0x7f7bb403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00096c0 tx=0x7f7bb0005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:17.873+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7bb801f020 con 0x7f7bc8197900 2024-09-15T23:23:18.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.104+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7bc819ca20 con 0x7f7bc8197900 2024-09-15T23:23:18.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.105+0000 7f7bcc945640 1 -- 172.21.15.159:0/1750098908 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f7bb8017500 con 0x7f7bc8197900 2024-09-15T23:23:18.106 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:23:18.106 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","modified":"2024-09-15T23:23:09.631737Z","created":"2024-09-15T23:21:38.646735Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:23:18.106 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 2 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 msgr2=0x7f7bb403b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 0x7f7bb403b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00096c0 tx=0x7f7bb0005a40 comp rx=0 tx=0).stop 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 msgr2=0x7f7bc819bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 0x7f7bc819bc90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800b3d0 tx=0x7f7bb800b890 comp rx=0 tx=0).stop 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 shutdown_connections 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7bb4039040 0x7f7bb403b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7bc8197900 0x7f7bc819bc90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 --2- 172.21.15.159:0/1750098908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bc8107660 0x7f7bc81973c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 >> 172.21.15.159:0/1750098908 conn(0x7f7bc80fd320 msgr2=0x7f7bc80fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 shutdown_connections 2024-09-15T23:23:18.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:18.107+0000 7f7bcd947640 1 -- 172.21.15.159:0/1750098908 wait complete. 2024-09-15T23:23:18.427 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-15T23:23:18.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-15T23:23:18.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-15T23:23:18.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-15T23:23:18.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Added host smithi159 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3269947838' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Saving service mon spec with placement smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c;count:3 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Reconfiguring mon.a (unknown last config time)... 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:18.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Deploying daemon mon.c on smithi159 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/800207323' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.869 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/3071848042' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.a calling monitor election 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.c calling monitor election 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.870 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: monmap epoch 2 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: last_changed 2024-09-15T23:23:09.631737+0000 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: min_mon_release 19 (squid) 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: election_strategy: 1 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: fsmap 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:18.871 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mgrmap e13: x(active, since 38s) 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: overall HEALTH_OK 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: Deploying daemon mon.b on smithi155 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/1910280981' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 ceph-mon[35631]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 bash[35612]: e914e615484968cb278d5083754f1482df3eaeaef9e3c958a001d1b8e59309f6 2024-09-15T23:23:18.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:18 smithi155 systemd[1]: Started Ceph mon.b for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:23:19.751 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-15T23:23:19.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-15T23:23:20.005 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 -- 172.21.15.159:0/1909503840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 msgr2=0x7f6da00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1909503840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6da00059c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6db81016c0 tx=0x7f6da802c150 comp rx=0 tx=0).stop 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 -- 172.21.15.159:0/1909503840 shutdown_connections 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1909503840 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6da00059c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 -- 172.21.15.159:0/1909503840 >> 172.21.15.159:0/1909503840 conn(0x7f6db80fc280 msgr2=0x7f6db80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 -- 172.21.15.159:0/1909503840 shutdown_connections 2024-09-15T23:23:23.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.596+0000 7f6dbd181640 1 -- 172.21.15.159:0/1909503840 wait complete. 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.597+0000 7f6dbd181640 1 Processor -- start 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.597+0000 7f6dbd181640 1 -- start start 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6db8199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:23.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8108680 con 0x7f6da0003530 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8108500 con 0x7f6db8199a60 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6dbd181640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6db8108800 con 0x7f6db819e330 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53682/0 (socket says 172.21.15.159:53682) 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 -- 172.21.15.159:0/1502808960 learned_addr learned my addr 172.21.15.159:0/1502808960 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6db8199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db659c640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 msgr2=0x7f6db819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 msgr2=0x7f6db819e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db759e640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db659c640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 msgr2=0x7f6db819ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-15T23:23:23.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db659c640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 msgr2=0x7f6db819ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db659c640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db659c640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 msgr2=0x7f6db819e7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 msgr2=0x7f6db819ddf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.598+0000 7f6db6d9d640 1 -- 172.21.15.159:0/1502808960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db81a60a0 con 0x7f6da0003530 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.599+0000 7f6db6d9d640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6db8199520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6da8036000 tx=0x7f6da802cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.599+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8032040 con 0x7f6da0003530 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.599+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6da8043070 con 0x7f6da0003530 2024-09-15T23:23:23.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.599+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db81a6270 con 0x7f6da0003530 2024-09-15T23:23:23.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.600+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da803e420 con 0x7f6da0003530 2024-09-15T23:23:23.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.600+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db81a67d0 con 0x7f6da0003530 2024-09-15T23:23:23.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.600+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f6da803e6a0 con 0x7f6da0003530 2024-09-15T23:23:23.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.600+0000 7f6d9ffff640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 0x7f6da403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:23.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.600+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6da8004ba0 con 0x7f6da0003530 2024-09-15T23:23:23.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.601+0000 7f6db659c640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 0x7f6da403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:23.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.601+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db8109770 con 0x7f6da0003530 2024-09-15T23:23:23.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.601+0000 7f6db659c640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 0x7f6da403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6dac006fd0 tx=0x7f6dac008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:23.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.606+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6da8047e10 con 0x7f6da0003530 2024-09-15T23:23:23.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.854+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6db802d7c0 con 0x7f6da0003530 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: mon.a calling monitor election 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: mon.c calling monitor election 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.856 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: monmap epoch 3 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: min_mon_release 19 (squid) 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: election_strategy: 1 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:23.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: fsmap 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: mgrmap e13: x(active, since 47s) 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: overall HEALTH_OK 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.858 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.854+0000 7f6d9ffff640 1 -- 172.21.15.159:0/1502808960 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f6da8045860 con 0x7f6da0003530 2024-09-15T23:23:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:23:23.859 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":3,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","modified":"2024-09-15T23:23:18.431987Z","created":"2024-09-15T23:21:38.646735Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:3300","nonce":0},{"type":"v1","addr":"172.21.15.77:6789","nonce":0}]},"addr":"172.21.15.77:6789/0","public_addr":"172.21.15.77:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-15T23:23:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:dumped monmap epoch 3 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 msgr2=0x7f6da403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 0x7f6da403bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6dac006fd0 tx=0x7f6dac008040 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 msgr2=0x7f6db8199520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6db8199520 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6da8036000 tx=0x7f6da802cef0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 shutdown_connections 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6da4039730 0x7f6da403bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6db819e330 0x7f6db819e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6db8199a60 0x7f6db819ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 --2- 172.21.15.159:0/1502808960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6da0003530 0x7f6db8199520 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 >> 172.21.15.159:0/1502808960 conn(0x7f6db80fc280 msgr2=0x7f6db8109d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 shutdown_connections 2024-09-15T23:23:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:23.857+0000 7f6dbd181640 1 -- 172.21.15.159:0/1502808960 wait complete. 2024-09-15T23:23:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: mon.a calling monitor election 2024-09-15T23:23:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: mon.c calling monitor election 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: monmap epoch 3 2024-09-15T23:23:23.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: election_strategy: 1 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: fsmap 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: mgrmap e13: x(active, since 47s) 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: overall HEALTH_OK 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.885 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:23.886 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:24.531 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-15T23:23:24.531 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-15T23:23:24.783 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:23:24.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:24.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:24 smithi159 ceph-mon[35472]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:24.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/1502808960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:24.840 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:24 smithi077 ceph-mon[30968]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/1502808960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 -- 172.21.15.77:0/3695143282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94106650 msgr2=0x7fab94106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 --2- 172.21.15.77:0/3695143282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94106650 0x7fab94106a30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fab84009880 tx=0x7fab8402a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 -- 172.21.15.77:0/3695143282 shutdown_connections 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 --2- 172.21.15.77:0/3695143282 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94106650 0x7fab94106a30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 -- 172.21.15.77:0/3695143282 >> 172.21.15.77:0/3695143282 conn(0x7fab940fc280 msgr2=0x7fab940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 -- 172.21.15.77:0/3695143282 shutdown_connections 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.211+0000 7fab98ad3640 1 -- 172.21.15.77:0/3695143282 wait complete. 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.212+0000 7fab98ad3640 1 Processor -- start 2024-09-15T23:23:25.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.212+0000 7fab98ad3640 1 -- start start 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab94106650 0x7fab941963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9419b1f0 0x7fab9419b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fab9410ac30 con 0x7fab94196920 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fab9410aab0 con 0x7fab94106650 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab98ad3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab9410adb0 con 0x7fab9419b1f0 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40942/0 (socket says 172.21.15.77:40942) 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 -- 172.21.15.77:0/1280693323 learned_addr learned my addr 172.21.15.77:0/1280693323 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab92d9d640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9419b1f0 0x7fab9419b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 -- 172.21.15.77:0/1280693323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9419b1f0 msgr2=0x7fab9419b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9419b1f0 0x7fab9419b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 -- 172.21.15.77:0/1280693323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab94106650 msgr2=0x7fab941963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab94106650 0x7fab941963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 -- 172.21.15.77:0/1280693323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab941a2f60 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8bfff640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b520 tx=0x7fab7c00b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c004230 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fab7c0043d0 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.213+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c003d60 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.214+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab941a3190 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.214+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab941a36d0 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fab7c00e070 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab94106ab0 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab8b7fe640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 0x7fab8003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fab7c04c000 con 0x7fab94196920 2024-09-15T23:23:25.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab9259c640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 0x7fab8003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:25.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.215+0000 7fab9259c640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 0x7fab8003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab84009880 tx=0x7fab84000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:25.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.220+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fab7c014020 con 0x7fab94196920 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.449+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fab941a3b50 con 0x7fab94196920 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.449+0000 7fab8b7fe640 1 -- 172.21.15.77:0/1280693323 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7fab7c010d70 con 0x7fab94196920 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:# minimal ceph.conf for 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:25.451 INFO:teuthology.orchestra.run.smithi077.stdout: mon_host = [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 msgr2=0x7fab8003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 0x7fab8003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fab84009880 tx=0x7fab84000bc0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 msgr2=0x7fab9419acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab7c00b520 tx=0x7fab7c00b9e0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 shutdown_connections 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fab80039730 0x7fab8003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab9419b1f0 0x7fab9419b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fab94196920 0x7fab9419acb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.451+0000 7fab98ad3640 1 --2- 172.21.15.77:0/1280693323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fab94106650 0x7fab941963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.452+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 >> 172.21.15.77:0/1280693323 conn(0x7fab940fc280 msgr2=0x7fab940fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:25.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.452+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 shutdown_connections 2024-09-15T23:23:25.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:25.452+0000 7fab98ad3640 1 -- 172.21.15.77:0/1280693323 wait complete. 2024-09-15T23:23:25.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:23:25.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: mon.a calling monitor election 2024-09-15T23:23:25.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: mon.c calling monitor election 2024-09-15T23:23:25.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: monmap epoch 3 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:25.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: min_mon_release 19 (squid) 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: election_strategy: 1 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: fsmap 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: mgrmap e13: x(active, since 47s) 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: overall HEALTH_OK 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:25.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:25.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:25.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/1502808960' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-15T23:23:25.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:26.141 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-15T23:23:26.141 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:23:26.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:23:26.171 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:23:26.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:26.236 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:23:26.236 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:23:26.264 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:23:26.264 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:26.330 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:23:26.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-09-15T23:23:26.357 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:23:26.357 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mon.b calling monitor election 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mon.b calling monitor election 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mon.a calling monitor election 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mon.c calling monitor election 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:23:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: monmap epoch 3 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: min_mon_release 19 (squid) 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: election_strategy: 1 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: fsmap 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: mgrmap e13: x(active, since 49s) 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: overall HEALTH_OK 2024-09-15T23:23:26.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1280693323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Reconfiguring mon.a (monmap changed)... 2024-09-15T23:23:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.386 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:26 smithi077 ceph-mon[30968]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:26.424 INFO:tasks.cephadm:Adding mgr.x on smithi077 2024-09-15T23:23:26.424 INFO:tasks.cephadm:Adding mgr.y on smithi155 2024-09-15T23:23:26.424 INFO:tasks.cephadm:Adding mgr.z on smithi159 2024-09-15T23:23:26.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi077=x;smithi155=y;smithi159=z' 2024-09-15T23:23:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mon.b calling monitor election 2024-09-15T23:23:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-15T23:23:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-15T23:23:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mon.b calling monitor election 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mon.a calling monitor election 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mon.c calling monitor election 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: monmap epoch 3 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: min_mon_release 19 (squid) 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: election_strategy: 1 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:26.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: fsmap 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: mgrmap e13: x(active, since 49s) 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: overall HEALTH_OK 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1280693323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.616 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Reconfiguring mon.a (monmap changed)... 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:26 smithi155 ceph-mon[35631]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:26.701 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:23:26.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mon.b calling monitor election 2024-09-15T23:23:26.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi077:/etc/ceph/ceph.conf 2024-09-15T23:23:26.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi159:/etc/ceph/ceph.conf 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mon.b calling monitor election 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mon.a calling monitor election 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mon.c calling monitor election 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: monmap epoch 3 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: last_changed 2024-09-15T23:23:18.431987+0000 2024-09-15T23:23:26.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: created 2024-09-15T23:21:38.646735+0000 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: min_mon_release 19 (squid) 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: election_strategy: 1 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: 0: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.a 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: 1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.c 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: fsmap 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: osdmap e4: 0 total, 0 up, 0 in 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: mgrmap e13: x(active, since 49s) 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: overall HEALTH_OK 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1280693323' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Updating smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-15T23:23:26.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Reconfiguring mon.a (monmap changed)... 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:26.718 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:26 smithi159 ceph-mon[35472]: Reconfiguring daemon mon.a on smithi077 2024-09-15T23:23:27.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 -- 172.21.15.159:0/1960705825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c102180 msgr2=0x7fe72c104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:27.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1960705825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c102180 0x7fe72c104570 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009880 tx=0x7fe71c02a5d0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 -- 172.21.15.159:0/1960705825 shutdown_connections 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1960705825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c102180 0x7fe72c104570 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 -- 172.21.15.159:0/1960705825 >> 172.21.15.159:0/1960705825 conn(0x7fe72c0fbda0 msgr2=0x7fe72c0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 -- 172.21.15.159:0/1960705825 shutdown_connections 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.133+0000 7fe7325ac640 1 -- 172.21.15.159:0/1960705825 wait complete. 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 Processor -- start 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 -- start start 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:27.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72c1974e0 0x7fe72c19c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c197960 0x7fe72c19eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c107790 con 0x7fe72c197960 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c107610 con 0x7fe72c1974e0 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe7325ac640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe72c107910 con 0x7fe72c102180 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe72bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe72bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53686/0 (socket says 172.21.15.159:53686) 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe72bfff640 1 -- 172.21.15.159:0/1778879967 learned_addr learned my addr 172.21.15.159:0/1778879967 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.134+0000 7fe730b49640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c197960 0x7fe72c19eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:27.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72b7fe640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72c1974e0 0x7fe72c19c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 -- 172.21.15.159:0/1778879967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72c1974e0 msgr2=0x7fe72c19c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72c1974e0 0x7fe72c19c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 -- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c197960 msgr2=0x7fe72c19eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c197960 0x7fe72c19eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 -- 172.21.15.159:0/1778879967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72c19f3a0 con 0x7fe72c102180 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe72bfff640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe71c031610 tx=0x7fe71c032d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c03f030 con 0x7fe72c102180 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72c19f630 con 0x7fe72c102180 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe71c003ce0 con 0x7fe72c102180 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c035070 con 0x7fe72c102180 2024-09-15T23:23:27.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.135+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe72c19fc40 con 0x7fe72c102180 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.136+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe71c042030 con 0x7fe72c102180 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.136+0000 7fe7297fa640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 0x7fe71403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.136+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe71c06dd20 con 0x7fe72c102180 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.136+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72c190550 con 0x7fe72c102180 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.136+0000 7fe72b7fe640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 0x7fe71403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.137+0000 7fe72b7fe640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 0x7fe71403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe72c1984c0 tx=0x7fe720008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:27.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.141+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fe71c03a8e0 con 0x7fe72c102180 2024-09-15T23:23:27.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.321+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi155=y;smithi159=z", "target": ["mon-mgr", ""]}) -- 0x7fe72c062630 con 0x7fe714039730 2024-09-15T23:23:27.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.326+0000 7fe7297fa640 1 -- 172.21.15.159:0/1778879967 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe72c062630 con 0x7fe714039730 2024-09-15T23:23:27.327 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mgr update... 2024-09-15T23:23:27.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 msgr2=0x7fe71403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:27.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 0x7fe71403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe72c1984c0 tx=0x7fe720008040 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 msgr2=0x7fe72c196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fe71c031610 tx=0x7fe71c032d50 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 shutdown_connections 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe714039730 0x7fe71403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe72c197960 0x7fe72c19eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe72c1974e0 0x7fe72c19c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 --2- 172.21.15.159:0/1778879967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe72c102180 0x7fe72c196fa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 >> 172.21.15.159:0/1778879967 conn(0x7fe72c0fbda0 msgr2=0x7fe72c0fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 shutdown_connections 2024-09-15T23:23:27.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:23:27.328+0000 7fe7325ac640 1 -- 172.21.15.159:0/1778879967 wait complete. 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:27.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:27.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.612 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:27.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:27.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:23:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:27.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:27.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:27.951 DEBUG:teuthology.orchestra.run.smithi155:mgr.y> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.y.service 2024-09-15T23:23:27.954 DEBUG:teuthology.orchestra.run.smithi159:mgr.z> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.z.service 2024-09-15T23:23:27.956 INFO:tasks.cephadm:Deploying OSDs... 2024-09-15T23:23:27.957 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:23:27.957 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:23:27.976 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:23:27.976 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-15T23:23:28.035 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:23:28.035 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 23:22:46.423983421 +0000 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 23:18:13.246354534 +0000 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 23:18:13.246354534 +0000 2024-09-15T23:23:28.036 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 23:18:13.246354534 +0000 2024-09-15T23:23:28.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:23:28.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T23:23:28.104 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T23:23:28.104 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000230839 s, 2.2 MB/s 2024-09-15T23:23:28.105 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:23:28.164 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 23:22:46.456982736 +0000 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 23:18:13.572347625 +0000 2024-09-15T23:23:28.223 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 23:18:13.572347625 +0000 2024-09-15T23:23:28.224 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 23:18:13.572347625 +0000 2024-09-15T23:23:28.224 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:23:28.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T23:23:28.289 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T23:23:28.289 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000212031 s, 2.4 MB/s 2024-09-15T23:23:28.290 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:23:28.348 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: Reconfiguring daemon mon.b on smithi155 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi155=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: Saving service mgr spec with placement smithi077=x;smithi155=y;smithi159=z;count:3 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:28.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:28 smithi077 ceph-mon[30968]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:28.398 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:23:28.398 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-15T23:23:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.398 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 23:22:46.489982051 +0000 2024-09-15T23:23:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 23:18:13.896340760 +0000 2024-09-15T23:23:28.399 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 23:18:13.896340760 +0000 2024-09-15T23:23:28.399 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 23:18:13.896340760 +0000 2024-09-15T23:23:28.399 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:23:28.463 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T23:23:28.463 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T23:23:28.463 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000205807 s, 2.5 MB/s 2024-09-15T23:23:28.465 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:23:28.522 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-15T23:23:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:23:28.578 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-15T23:23:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.578 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 23:22:46.521981387 +0000 2024-09-15T23:23:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 23:18:14.240333470 +0000 2024-09-15T23:23:28.579 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 23:18:14.240333470 +0000 2024-09-15T23:23:28.579 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 23:18:14.240333470 +0000 2024-09-15T23:23:28.579 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: Reconfiguring daemon mon.b on smithi155 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi155=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: Saving service mgr spec with placement smithi077=x;smithi155=y;smithi159=z;count:3 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:28.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:28 smithi155 ceph-mon[35631]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-15T23:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-15T23:23:28.643 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000211322 s, 2.4 MB/s 2024-09-15T23:23:28.644 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:23:28.702 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-15T23:23:28.702 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: Reconfiguring mon.b (monmap changed)... 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: Reconfiguring daemon mon.b on smithi155 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi077=x;smithi155=y;smithi159=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: Saving service mgr spec with placement smithi077=x;smithi155=y;smithi159=z;count:3 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:28.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:28 smithi159 ceph-mon[35472]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:28.719 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:23:28.719 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-15T23:23:28.774 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:23:28.774 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.774 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-15T23:23:28.774 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.775 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.775 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-15 23:23:17.891853339 +0000 2024-09-15T23:23:28.775 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-15 23:18:30.689873271 +0000 2024-09-15T23:23:28.775 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-15 23:18:30.689873271 +0000 2024-09-15T23:23:28.775 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-15 23:18:30.689873271 +0000 2024-09-15T23:23:28.775 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:23:28.839 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-15T23:23:28.839 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-15T23:23:28.839 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000285053 s, 1.8 MB/s 2024-09-15T23:23:28.840 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:23:28.897 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-15 23:23:17.891853339 +0000 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-15 23:18:31.023866796 +0000 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-15 23:18:31.023866796 +0000 2024-09-15T23:23:28.953 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-15 23:18:31.023866796 +0000 2024-09-15T23:23:28.954 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:23:29.015 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-15T23:23:29.016 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-15T23:23:29.016 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000248586 s, 2.1 MB/s 2024-09-15T23:23:29.017 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:23:29.074 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-15T23:23:29.129 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-15 23:23:17.891853339 +0000 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-15 23:18:31.376859952 +0000 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-15 23:18:31.376859952 +0000 2024-09-15T23:23:29.130 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-15 23:18:31.376859952 +0000 2024-09-15T23:23:29.130 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:23:29.193 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-15T23:23:29.193 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-15T23:23:29.193 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000192185 s, 2.7 MB/s 2024-09-15T23:23:29.194 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:23:29.251 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-15 23:23:17.892853320 +0000 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-15 23:18:31.698853709 +0000 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-15 23:18:31.698853709 +0000 2024-09-15T23:23:29.307 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-15 23:18:31.698853709 +0000 2024-09-15T23:23:29.308 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:23:29.369 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-15T23:23:29.370 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-15T23:23:29.370 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000192164 s, 2.7 MB/s 2024-09-15T23:23:29.371 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:23:29.428 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-15T23:23:29.428 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T23:23:29.444 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T23:23:29.444 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-15T23:23:29.500 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T23:23:29.500 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:29.500 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-09-15T23:23:29.500 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:29.500 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:29.501 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-15 23:23:08.722670684 +0000 2024-09-15T23:23:29.501 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-15 23:18:30.496302839 +0000 2024-09-15T23:23:29.501 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-15 23:18:30.496302839 +0000 2024-09-15T23:23:29.501 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-15 23:18:30.496302839 +0000 2024-09-15T23:23:29.501 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T23:23:29.565 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-15T23:23:29.566 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-15T23:23:29.566 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000272789 s, 1.9 MB/s 2024-09-15T23:23:29.567 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T23:23:29.623 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-15 23:23:08.723670665 +0000 2024-09-15T23:23:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-15 23:18:30.824296568 +0000 2024-09-15T23:23:29.679 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-15 23:18:30.824296568 +0000 2024-09-15T23:23:29.679 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-15 23:18:30.824296568 +0000 2024-09-15T23:23:29.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T23:23:29.742 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-15T23:23:29.742 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-15T23:23:29.742 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000210127 s, 2.4 MB/s 2024-09-15T23:23:29.744 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T23:23:29.801 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-15 23:23:08.723670665 +0000 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-15 23:18:31.150290334 +0000 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-15 23:18:31.150290334 +0000 2024-09-15T23:23:29.857 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-15 23:18:31.150290334 +0000 2024-09-15T23:23:29.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:29.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:29 smithi155 ceph-mon[35631]: Reconfiguring daemon mon.c on smithi159 2024-09-15T23:23:29.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:29 smithi077 ceph-mon[30968]: Reconfiguring daemon mon.c on smithi159 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: Reconfiguring mon.c (monmap changed)... 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:29.918 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:29 smithi159 ceph-mon[35472]: Reconfiguring daemon mon.c on smithi159 2024-09-15T23:23:29.920 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-15T23:23:29.921 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-15T23:23:29.921 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000169152 s, 3.0 MB/s 2024-09-15T23:23:29.922 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T23:23:29.979 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-15T23:23:30.035 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-15 23:23:08.723670665 +0000 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-15 23:18:31.480284025 +0000 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-15 23:18:31.480284025 +0000 2024-09-15T23:23:30.036 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-09-15 23:18:31.480284025 +0000 2024-09-15T23:23:30.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T23:23:30.100 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-15T23:23:30.100 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-15T23:23:30.100 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000196861 s, 2.6 MB/s 2024-09-15T23:23:30.101 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T23:23:30.159 INFO:tasks.cephadm:Deploying osd.0 on smithi077 with /dev/vg_nvme/lv_4... 2024-09-15T23:23:30.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:23:30.409 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:30.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:30.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:30.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:30.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:30 smithi159 ceph-mon[35472]: Deploying daemon mgr.z on smithi159 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:31.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:31.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:31.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:31.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:30 smithi155 ceph-mon[35631]: Deploying daemon mgr.z on smithi159 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:30 smithi077 ceph-mon[30968]: Deploying daemon mgr.z on smithi159 2024-09-15T23:23:31.715 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 systemd[1]: Starting Ceph mgr.z for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 podman[37264]: 2024-09-15 23:23:31.658240116 +0000 UTC m=+0.015963336 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 podman[37264]: 2024-09-15 23:23:31.761583294 +0000 UTC m=+0.119306556 container create 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 podman[37264]: 2024-09-15 23:23:31.965276028 +0000 UTC m=+0.322999248 container init 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, RELEASE=squid-8921c8e, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 podman[37264]: 2024-09-15 23:23:31.968687277 +0000 UTC m=+0.326410498 container start 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:31 smithi159 ceph-mgr[37284]: -- 172.21.15.159:0/3594504888 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597aaf490e0 con 0x5597aaf27400 2024-09-15T23:23:32.041 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 bash[37264]: 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c 2024-09-15T23:23:32.299 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 systemd[1]: Started Ceph mgr.z for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:23:32.299 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.091+0000 7ff0b984b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:23:32.299 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.150+0000 7ff0b984b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:23:32.299 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.298+0000 7ff0b984b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:23:32.639 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:23:32.648 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.364+0000 7ff0b984b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:23:32.648 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.510+0000 7ff0b984b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:23:32.649 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.647+0000 7ff0b984b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:23:32.663 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_4 2024-09-15T23:23:32.907 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:33.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:33.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:33.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- 172.21.15.77:0/2744560537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800100b10 msgr2=0x7fb800100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 --2- 172.21.15.77:0/2744560537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800100b10 0x7fb800100f10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009900 tx=0x7fb7f402a410 comp rx=0 tx=0).stop 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- 172.21.15.77:0/2744560537 shutdown_connections 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 --2- 172.21.15.77:0/2744560537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8001026d0 0x7fb800108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 --2- 172.21.15.77:0/2744560537 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb800101d10 0x7fb800102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 --2- 172.21.15.77:0/2744560537 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800100b10 0x7fb800100f10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:33.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- 172.21.15.77:0/2744560537 >> 172.21.15.77:0/2744560537 conn(0x7fb8000fc2a0 msgr2=0x7fb8000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- 172.21.15.77:0/2744560537 shutdown_connections 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- 172.21.15.77:0/2744560537 wait complete. 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 Processor -- start 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.327+0000 7fb806d92640 1 -- start start 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb800100b10 0x7fb800197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 0x7fb80019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c860 con 0x7fb800101d10 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c6e0 con 0x7fb8001026d0 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb806d92640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb80010c9e0 con 0x7fb800100b10 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47776/0 (socket says 172.21.15.77:47776) 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb804b2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb800100b10 0x7fb800197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:33.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 -- 172.21.15.77:0/1094311669 learned_addr learned my addr 172.21.15.77:0/1094311669 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 -- 172.21.15.77:0/1094311669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb800100b10 msgr2=0x7fb800197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb800100b10 0x7fb800197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb80532f640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 0x7fb80019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 -- 172.21.15.77:0/1094311669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 msgr2=0x7fb80019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 0x7fb80019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 -- 172.21.15.77:0/1094311669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80019fb80 con 0x7fb800101d10 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb80532f640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 0x7fb80019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fffff640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00b4a0 tx=0x7fb7ec00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec014070 con 0x7fb800101d10 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.328+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7ec010af0 con 0x7fb800101d10 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.329+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80019fe70 con 0x7fb800101d10 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.329+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec017d10 con 0x7fb800101d10 2024-09-15T23:23:33.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.329+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8001a03a0 con 0x7fb800101d10 2024-09-15T23:23:33.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fb7ec017070 con 0x7fb800101d10 2024-09-15T23:23:33.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb7fdffb640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 0x7fb7f003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:33.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb7ec04bb20 con 0x7fb800101d10 2024-09-15T23:23:33.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8001a0630 con 0x7fb800101d10 2024-09-15T23:23:33.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb804b2e640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 0x7fb7f003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:33.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.330+0000 7fb804b2e640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 0x7fb7f003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402aa00 tx=0x7fb7f40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:33.336 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.335+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb7ec020300 con 0x7fb800101d10 2024-09-15T23:23:33.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:32.965+0000 7ff0b984b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:23:33.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:33.026+0000 7ff0b984b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:23:33.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:33.210+0000 7ff0b984b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:23:33.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:33.513+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fb80006aea0 con 0x7fb7f0039500 2024-09-15T23:23:34.086 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:33 smithi155 ceph-mon[35631]: Deploying daemon mgr.y on smithi155 2024-09-15T23:23:34.086 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:34.086 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:34.086 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.087 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:33 smithi155 systemd[1]: Starting Ceph mgr.y for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:23:34.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:33 smithi077 ceph-mon[30968]: Deploying daemon mgr.y on smithi155 2024-09-15T23:23:34.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:34.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:34.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-mon[35472]: Deploying daemon mgr.y on smithi155 2024-09-15T23:23:34.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:34.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:34.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:34.357 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 podman[36979]: 2024-09-15 23:23:34.085505362 +0000 UTC m=+0.106081476 container create 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e) 2024-09-15T23:23:34.357 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 podman[36979]: 2024-09-15 23:23:33.995387446 +0000 UTC m=+0.015963557 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:23:34.357 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 podman[36979]: 2024-09-15 23:23:34.328659308 +0000 UTC m=+0.349235434 container init 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-15T23:23:34.357 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 podman[36979]: 2024-09-15 23:23:34.331409457 +0000 UTC m=+0.351985577 container start 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:23:34.464 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:34.097+0000 7ff0b984b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:23:34.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:34.165+0000 7ff0b984b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:23:34.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mgr[36997]: -- 172.21.15.155:0/3972728895 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561f9d8090e0 con 0x561f9d7e6800 2024-09-15T23:23:34.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 bash[36979]: 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc 2024-09-15T23:23:34.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 systemd[1]: Started Ceph mgr.y for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:23:34.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:34.460+0000 7f1b0b67a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T23:23:34.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:34.520+0000 7f1b0b67a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T23:23:35.063 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:34.677+0000 7f1b0b67a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:34.746+0000 7f1b0b67a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:34.909+0000 7f1b0b67a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:23:35.064 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:35.062+0000 7f1b0b67a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T23:23:35.099 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:35.099 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:35.100 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.100 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.100 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.100 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.100 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:35.170 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:34.925+0000 7ff0b984b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:23:35.171 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.047+0000 7ff0b984b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:23:35.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.192+0000 7ff0b984b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:23:35.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.257+0000 7ff0b984b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:23:35.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.413+0000 7ff0b984b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:23:35.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:35.384+0000 7f1b0b67a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T23:23:35.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:35.447+0000 7f1b0b67a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T23:23:35.785 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.484+0000 7ff0b984b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:23:35.785 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.544+0000 7ff0b984b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:23:35.785 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.715+0000 7ff0b984b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:23:35.785 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.784+0000 7ff0b984b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:23:36.049 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.851+0000 7ff0b984b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:23:36.049 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.932+0000 7ff0b984b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:23:36.049 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:35.990+0000 7ff0b984b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:23:36.049 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:36.048+0000 7ff0b984b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:23:36.114 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:35.642+0000 7f1b0b67a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:36.532+0000 7f1b0b67a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:36.599+0000 7f1b0b67a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]': finished 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: Reconfiguring daemon mgr.x on smithi077 2024-09-15T23:23:36.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:36 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3668615315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]: dispatch 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]': finished 2024-09-15T23:23:36.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: Reconfiguring daemon mgr.x on smithi077 2024-09-15T23:23:36.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:36 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3668615315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:23:36.965 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z[37280]: 2024-09-15T23:23:36.834+0000 7ff0b984b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:23:36.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]: dispatch 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3429963220' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af"}]': finished 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: Reconfiguring mgr.x (unknown last config time)... 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: osdmap e5: 1 total, 0 up, 1 in 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:36.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-15T23:23:36.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:36.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: Reconfiguring daemon mgr.x on smithi077 2024-09-15T23:23:36.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:36 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3668615315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:23:37.570 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.313+0000 7f1b0b67a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-15T23:23:37.570 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.428+0000 7f1b0b67a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T23:23:37.570 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.569+0000 7f1b0b67a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T23:23:37.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:37.691+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7fb7ec00d300 con 0x7fb800101d10 2024-09-15T23:23:37.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-mon[35631]: Standby manager daemon z started 2024-09-15T23:23:37.850 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.630+0000 7f1b0b67a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.781+0000 7f1b0b67a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-15T23:23:37.851 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.849+0000 7f1b0b67a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T23:23:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:37 smithi159 ceph-mon[35472]: Standby manager daemon z started 2024-09-15T23:23:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:37 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:23:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:37 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:37 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:23:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:37 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:38.114 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:37.910+0000 7f1b0b67a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T23:23:38.114 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.067+0000 7f1b0b67a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T23:23:38.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:37 smithi077 ceph-mon[30968]: Standby manager daemon z started 2024-09-15T23:23:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:37 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-15T23:23:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:37 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:37 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-15T23:23:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:37 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.159:0/3687665975' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:38.399 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.131+0000 7f1b0b67a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T23:23:38.399 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.197+0000 7f1b0b67a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T23:23:38.399 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.279+0000 7f1b0b67a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T23:23:38.399 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.338+0000 7f1b0b67a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T23:23:38.399 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:38.398+0000 7f1b0b67a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T23:23:38.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:38 smithi159 ceph-mon[35472]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T23:23:38.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:38 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:23:38.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:38 smithi159 ceph-mon[35472]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-mon[35631]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T23:23:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:23:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:38 smithi155 ceph-mon[35631]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:38 smithi077 ceph-mon[30968]: mgrmap e14: x(active, since 61s), standbys: z 2024-09-15T23:23:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-15T23:23:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:38 smithi077 ceph-mon[30968]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:39.614 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y[36993]: 2024-09-15T23:23:39.183+0000 7f1b0b67a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T23:23:39.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:39.705+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mon.0 v2:172.21.15.77:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fb7ec010d10 con 0x7fb800101d10 2024-09-15T23:23:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:39 smithi159 ceph-mon[35472]: Standby manager daemon y started 2024-09-15T23:23:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:39 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:23:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:39 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:39 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:23:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:39 smithi159 ceph-mon[35472]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-mon[35631]: Standby manager daemon y started 2024-09-15T23:23:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:23:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:23:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:39 smithi155 ceph-mon[35631]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:40.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:39 smithi077 ceph-mon[30968]: Standby manager daemon y started 2024-09-15T23:23:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:39 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-15T23:23:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:39 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-15T23:23:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:39 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-15T23:23:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:39 smithi077 ceph-mon[30968]: from='mgr.? 172.21.15.155:0/2552891385' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-15T23:23:40.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:40 smithi077 ceph-mon[30968]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T23:23:40.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:23:40.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:40 smithi077 ceph-mon[30968]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:40 smithi159 ceph-mon[35472]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T23:23:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:23:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:40 smithi159 ceph-mon[35472]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:40 smithi155 ceph-mon[35631]: mgrmap e15: x(active, since 63s), standbys: z, y 2024-09-15T23:23:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-15T23:23:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:40 smithi155 ceph-mon[35631]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:42.947 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:42 smithi077 ceph-mon[30968]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:42.948 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:42.948 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:42.948 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:42 smithi155 ceph-mon[35631]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:42 smithi159 ceph-mon[35472]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:23:45.102 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:23:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-15T23:23:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:46.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:45 smithi077 ceph-mon[30968]: Deploying daemon osd.0 on smithi077 2024-09-15T23:23:46.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:45 smithi155 ceph-mon[35631]: Deploying daemon osd.0 on smithi077 2024-09-15T23:23:46.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:45 smithi159 ceph-mon[35472]: Deploying daemon osd.0 on smithi077 2024-09-15T23:23:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:46 smithi155 ceph-mon[35631]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:47.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:46 smithi077 ceph-mon[30968]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:46 smithi159 ceph-mon[35472]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:49.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:48 smithi155 ceph-mon[35631]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:48 smithi077 ceph-mon[30968]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:48 smithi159 ceph-mon[35472]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:50 smithi155 ceph-mon[35631]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:51.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:50 smithi077 ceph-mon[30968]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:51.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:50 smithi159 ceph-mon[35472]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:52 smithi155 ceph-mon[35631]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:53.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:52 smithi077 ceph-mon[30968]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:53.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:52 smithi159 ceph-mon[35472]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:54.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:54 smithi155 ceph-mon[35631]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:54.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:54 smithi077 ceph-mon[30968]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:54 smithi159 ceph-mon[35472]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:55.159 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 0 on host 'smithi077' 2024-09-15T23:23:55.160 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.158+0000 7fb7fdffb640 1 -- 172.21.15.77:0/1094311669 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb80006aea0 con 0x7fb7f0039500 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 msgr2=0x7fb7f003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 0x7fb7f003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7f402aa00 tx=0x7fb7f40315b0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 msgr2=0x7fb800198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00b4a0 tx=0x7fb7ec00b960 comp rx=0 tx=0).stop 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 shutdown_connections 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb7f0039500 0x7fb7f003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb8001026d0 0x7fb80019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb800101d10 0x7fb800198490 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 --2- 172.21.15.77:0/1094311669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb800100b10 0x7fb800197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 >> 172.21.15.77:0/1094311669 conn(0x7fb8000fc2a0 msgr2=0x7fb80006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 shutdown_connections 2024-09-15T23:23:55.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:23:55.161+0000 7fb806d92640 1 -- 172.21.15.77:0/1094311669 wait complete. 2024-09-15T23:23:55.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:55.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:55.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:23:55.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:55.784 DEBUG:teuthology.orchestra.run.smithi077:osd.0> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.0.service 2024-09-15T23:23:55.787 INFO:tasks.cephadm:Deploying osd.1 on smithi155 with /dev/vg_nvme/lv_4... 2024-09-15T23:23:55.787 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:23:56.029 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:23:56.278 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:56 smithi077 ceph-mon[30968]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:56.464 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:56 smithi159 ceph-mon[35472]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:56.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:56 smithi155 ceph-mon[35631]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:57.358 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:57 smithi155 ceph-mon[35631]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:23:57.430 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:57 smithi077 ceph-mon[30968]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:23:57.430 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:23:57 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:23:57.248+0000 7f281f474640 -1 osd.0 0 log_to_monitors true 2024-09-15T23:23:57.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:57 smithi159 ceph-mon[35472]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-15T23:23:58.420 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:23:58.420 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:23:58.420 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:23:58.420 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:58.420 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:58.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:23:58.421 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:58 smithi155 ceph-mon[35631]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:23:58.423 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:23:58.449 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:23:58.616 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:58 smithi077 ceph-mon[30968]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:23:58.704 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:23:58.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-15T23:23:58.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: osdmap e6: 1 total, 0 up, 1 in 2024-09-15T23:23:58.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:23:58.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:58.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:23:58.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:23:58.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:58 smithi159 ceph-mon[35472]: osdmap e7: 1 total, 0 up, 1 in 2024-09-15T23:23:59.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 -- 172.21.15.155:0/126820249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 msgr2=0x7fbc20102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.118 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 --2- 172.21.15.155:0/126820249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20102150 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009900 tx=0x7fbc1c02a410 comp rx=0 tx=0).stop 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 -- 172.21.15.155:0/126820249 shutdown_connections 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 --2- 172.21.15.155:0/126820249 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc20108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 --2- 172.21.15.155:0/126820249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20102150 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 --2- 172.21.15.155:0/126820249 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 0x7fbc20100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 -- 172.21.15.155:0/126820249 >> 172.21.15.155:0/126820249 conn(0x7fbc200fc280 msgr2=0x7fbc200fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:23:59.119 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 -- 172.21.15.155:0/126820249 shutdown_connections 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.114+0000 7fbc27f74640 1 -- 172.21.15.155:0/126820249 wait complete. 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 Processor -- start 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 -- start start 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 0x7fbc20197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc2019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.120 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010c730 con 0x7fbc20100ad0 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010c5b0 con 0x7fbc20101cd0 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc27f74640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc2010c8b0 con 0x7fbc20102690 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:59794/0 (socket says 172.21.15.155:59794) 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 -- 172.21.15.155:0/1230223396 learned_addr learned my addr 172.21.15.155:0/1230223396 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc25d10640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 0x7fbc20197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.121 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc26511640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc2019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 -- 172.21.15.155:0/1230223396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 msgr2=0x7fbc2019f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc2019f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 -- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 msgr2=0x7fbc20197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 0x7fbc20197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.115+0000 7fbc2550f640 1 -- 172.21.15.155:0/1230223396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2019fb30 con 0x7fbc20101cd0 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc26511640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc2019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc2550f640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009230 tx=0x7fbc1c031b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.122 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c03f030 con 0x7fbc20101cd0 2024-09-15T23:23:59.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1c003ad0 con 0x7fbc20101cd0 2024-09-15T23:23:59.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c035070 con 0x7fbc20101cd0 2024-09-15T23:23:59.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc2019fdc0 con 0x7fbc20101cd0 2024-09-15T23:23:59.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.116+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc201a01f0 con 0x7fbc20101cd0 2024-09-15T23:23:59.123 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.117+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc201a0420 con 0x7fbc20101cd0 2024-09-15T23:23:59.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.118+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fbc1c042030 con 0x7fbc20101cd0 2024-09-15T23:23:59.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.119+0000 7fbc16ffd640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 0x7fbc0c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:23:59.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.119+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fbc1c0ee2d0 con 0x7fbc20101cd0 2024-09-15T23:23:59.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.119+0000 7fbc25d10640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 0x7fbc0c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:23:59.125 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.120+0000 7fbc25d10640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 0x7fbc0c0a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc100095f0 tx=0x7fbc10005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:23:59.128 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.127+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbc1c0bcb80 con 0x7fbc20101cd0 2024-09-15T23:23:59.310 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:23:59.309+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fbc200fd090 con 0x7fbc0c0a31e0 2024-09-15T23:23:59.377 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:23:59.000+0000 7f281b3f7640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T23:23:59.377 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:23:59.006+0000 7f2813217640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi077 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:59.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:23:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi077 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.708 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' 2024-09-15T23:23:59.709 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.709 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:59.709 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:59.709 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:23:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi077 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi077 to 17088M 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:23:59.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923]' entity='osd.0' 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:23:59.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:23:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] boot 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:24:00.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:24:00.710 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:24:00.710 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:24:00.711 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:00.711 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:24:00.711 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] boot 2024-09-15T23:24:00.711 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:24:00.711 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: osd.0 [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] boot 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: osdmap e8: 1 total, 1 up, 1 in 2024-09-15T23:24:00.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-15T23:24:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:24:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/2269318254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]': finished 2024-09-15T23:24:02.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:24:02.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:02.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:02 smithi155 ceph-mon[35631]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/2269318254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]': finished 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:24:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:02.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:02 smithi077 ceph-mon[30968]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: osdmap e9: 1 total, 1 up, 1 in 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/2269318254' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]: dispatch 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0c74b13c-72a8-46ce-8a2d-e59a12ca72e0"}]': finished 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: osdmap e10: 2 total, 1 up, 2 in 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:02 smithi159 ceph-mon[35472]: pgmap v43: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:03 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/4030798016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:03.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:03 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/4030798016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:03.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:03 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/4030798016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:04.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:04 smithi155 ceph-mon[35631]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:04.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:04 smithi077 ceph-mon[30968]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:04.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:04 smithi159 ceph-mon[35472]: pgmap v44: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:06.970 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:06 smithi155 ceph-mon[35631]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:06 smithi077 ceph-mon[30968]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:06 smithi159 ceph-mon[35472]: pgmap v45: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:08 smithi155 ceph-mon[35631]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:08 smithi077 ceph-mon[30968]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:08 smithi159 ceph-mon[35472]: pgmap v46: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:10 smithi155 ceph-mon[35631]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:24:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:10 smithi155 ceph-mon[35631]: Deploying daemon osd.1 on smithi155 2024-09-15T23:24:11.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:10 smithi077 ceph-mon[30968]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:24:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:10 smithi077 ceph-mon[30968]: Deploying daemon osd.1 on smithi155 2024-09-15T23:24:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:10 smithi159 ceph-mon[35472]: pgmap v47: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-15T23:24:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:10 smithi159 ceph-mon[35472]: Deploying daemon osd.1 on smithi155 2024-09-15T23:24:13.106 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:12 smithi155 ceph-mon[35631]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:13.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:12 smithi077 ceph-mon[30968]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:12 smithi159 ceph-mon[35472]: pgmap v48: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:15.006 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:14 smithi155 ceph-mon[35631]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:14 smithi077 ceph-mon[30968]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:15.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:14 smithi159 ceph-mon[35472]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:16 smithi155 ceph-mon[35631]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:16 smithi077 ceph-mon[30968]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:16 smithi159 ceph-mon[35472]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:19.763 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.761+0000 7fbc16ffd640 1 -- 172.21.15.155:0/1230223396 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbc200fd090 con 0x7fbc0c0a31e0 2024-09-15T23:24:19.764 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 1 on host 'smithi155' 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 msgr2=0x7fbc0c0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 0x7fbc0c0a56a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc100095f0 tx=0x7fbc10005f90 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 msgr2=0x7fbc20198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c009230 tx=0x7fbc1c031b60 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 shutdown_connections 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbc0c0a31e0 0x7fbc0c0a56a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc20102690 0x7fbc2019f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc20101cd0 0x7fbc20198440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 --2- 172.21.15.155:0/1230223396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbc20100ad0 0x7fbc20197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:19.766 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 >> 172.21.15.155:0/1230223396 conn(0x7fbc200fc280 msgr2=0x7fbc200fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 shutdown_connections 2024-09-15T23:24:19.767 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:24:19.764+0000 7fbc27f74640 1 -- 172.21.15.155:0/1230223396 wait complete. 2024-09-15T23:24:20.044 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:19 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:20.044 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:19 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.044 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:19 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:19 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:19 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:19 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:19 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:19 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:19 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:20.315 DEBUG:teuthology.orchestra.run.smithi155:osd.1> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.1.service 2024-09-15T23:24:20.318 INFO:tasks.cephadm:Deploying osd.2 on smithi159 with /dev/vg_nvme/lv_4... 2024-09-15T23:24:20.318 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-15T23:24:20.570 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:20.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:20 smithi155 ceph-mon[35631]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:20.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:20 smithi159 ceph-mon[35472]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:20 smithi077 ceph-mon[30968]: pgmap v52: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:22.365 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:22 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:24:22.018+0000 7f9dc11bc640 -1 osd.1 0 log_to_monitors true 2024-09-15T23:24:23.008 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:24:23.036 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-09-15T23:24:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:22 smithi155 ceph-mon[35631]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:22 smithi155 ceph-mon[35631]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:22 smithi155 ceph-mon[35631]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:22 smithi077 ceph-mon[30968]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:23.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:22 smithi077 ceph-mon[30968]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:22 smithi077 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:22 smithi159 ceph-mon[35472]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:22 smithi159 ceph-mon[35472]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:22 smithi159 ceph-mon[35472]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-15T23:24:23.289 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:24:23.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 -- 172.21.15.159:0/3412529990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 msgr2=0x7f6230103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:23.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 --2- 172.21.15.159:0/3412529990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230103330 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f622c009930 tx=0x7f622c02a420 comp rx=0 tx=0).stop 2024-09-15T23:24:23.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 -- 172.21.15.159:0/3412529990 shutdown_connections 2024-09-15T23:24:23.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 --2- 172.21.15.159:0/3412529990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6230103870 0x7f623010a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:23.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 --2- 172.21.15.159:0/3412529990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230103330 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 --2- 172.21.15.159:0/3412529990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62300ffed0 0x7f62301002d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 -- 172.21.15.159:0/3412529990 >> 172.21.15.159:0/3412529990 conn(0x7f62300fba40 msgr2=0x7f62300fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 -- 172.21.15.159:0/3412529990 shutdown_connections 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 -- 172.21.15.159:0/3412529990 wait complete. 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.773+0000 7f6238386640 1 Processor -- start 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 -- start start 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62300ffed0 0x7f6230197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6230103870 0x7f623019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f623010d8b0 con 0x7f6230103870 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f623010d730 con 0x7f62300ffed0 2024-09-15T23:24:23.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6238386640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f623010da30 con 0x7f6230102eb0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48936/0 (socket says 172.21.15.159:48936) 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 -- 172.21.15.159:0/654824161 learned_addr learned my addr 172.21.15.159:0/654824161 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6236122640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62300ffed0 0x7f6230197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6236923640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6230103870 0x7f623019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 -- 172.21.15.159:0/654824161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62300ffed0 msgr2=0x7f6230197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62300ffed0 0x7f6230197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 -- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6230103870 msgr2=0x7f623019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6230103870 0x7f623019f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 -- 172.21.15.159:0/654824161 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f623019fb60 con 0x7f6230102eb0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.774+0000 7f6235921640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f622c009a50 tx=0x7f622c0042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:23.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.775+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c03f030 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.775+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f622c003ce0 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.775+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f623019fdf0 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.775+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f622c035070 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.775+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62301a0270 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.776+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6230109080 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.777+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f622c042030 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.777+0000 7f62237fe640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 0x7f621c0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.777+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1903+0+0 (secure 0 0 0) 0x7f622c0ee4a0 con 0x7f6230102eb0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.778+0000 7f6236122640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 0x7f621c0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:23.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.778+0000 7f6236122640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 0x7f621c0a56a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f623006a590 tx=0x7f6224005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:23.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.782+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f622c0bcbb0 con 0x7f6230102eb0 2024-09-15T23:24:23.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:23.958+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6230062630 con 0x7f621c0a31e0 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:23.960 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:23.961 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:23 smithi159 ceph-mon[35472]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:24:24.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:24:23.817+0000 7f9dbd13f640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T23:24:24.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:24:23.821+0000 7f9db8f67640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:24:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:24:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:24:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:23 smithi155 ceph-mon[35631]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: osdmap e11: 2 total, 1 up, 2 in 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:24.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:24.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:23 smithi077 ceph-mon[30968]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi155 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi155 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:25.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:25.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:25.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi155 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: osdmap e12: 2 total, 1 up, 2 in 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] boot 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:24:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] boot 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:24:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:25 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: from='client.24166 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: osd.1 [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] boot 2024-09-15T23:24:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: osdmap e13: 2 total, 2 up, 2 in 2024-09-15T23:24:26.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:25 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/2910722761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]': finished 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:26.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:26 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/2184169869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/2910722761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]': finished 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:26 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/2184169869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: osdmap e14: 2 total, 2 up, 2 in 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/2910722761' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]: dispatch 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d6d28da-532b-4afd-ba6b-116531ce058a"}]': finished 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: osdmap e15: 3 total, 2 up, 3 in 2024-09-15T23:24:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:27.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:26 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/2184169869' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:28 smithi155 ceph-mon[35631]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:28 smithi077 ceph-mon[30968]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:28 smithi159 ceph-mon[35472]: pgmap v61: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:30 smithi155 ceph-mon[35631]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:30 smithi077 ceph-mon[30968]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:30 smithi159 ceph-mon[35472]: pgmap v62: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:32 smithi155 ceph-mon[35631]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:32 smithi077 ceph-mon[30968]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:33.205 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:32 smithi159 ceph-mon[35472]: pgmap v63: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:34 smithi155 ceph-mon[35631]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:24:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:35.114 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:34 smithi159 ceph-mon[35472]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:35.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:24:35.115 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:35.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:34 smithi077 ceph-mon[30968]: pgmap v64: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-15T23:24:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:36.077 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:35 smithi159 ceph-mon[35472]: Deploying daemon osd.2 on smithi159 2024-09-15T23:24:36.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:35 smithi155 ceph-mon[35631]: Deploying daemon osd.2 on smithi159 2024-09-15T23:24:36.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:35 smithi077 ceph-mon[30968]: Deploying daemon osd.2 on smithi159 2024-09-15T23:24:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:36 smithi155 ceph-mon[35631]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:37.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:36 smithi077 ceph-mon[30968]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:36 smithi159 ceph-mon[35472]: pgmap v65: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:38 smithi155 ceph-mon[35631]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:38 smithi077 ceph-mon[30968]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:39.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:38 smithi159 ceph-mon[35472]: pgmap v66: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:40 smithi155 ceph-mon[35631]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:40 smithi077 ceph-mon[30968]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:40 smithi159 ceph-mon[35472]: pgmap v67: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:43.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:42 smithi159 ceph-mon[35472]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:43.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:42 smithi155 ceph-mon[35631]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:42 smithi077 ceph-mon[30968]: pgmap v68: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:44.610 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.610 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.610 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:44.610 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:44.611 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.611 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:44 smithi159 ceph-mon[35472]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.649+0000 7f62237fe640 1 -- 172.21.15.159:0/654824161 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6230062630 con 0x7f621c0a31e0 2024-09-15T23:24:44.650 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 2 on host 'smithi159' 2024-09-15T23:24:44.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 msgr2=0x7f621c0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 0x7f621c0a56a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f623006a590 tx=0x7f6224005f90 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 msgr2=0x7f6230198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f622c009a50 tx=0x7f622c0042f0 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 shutdown_connections 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f621c0a31e0 0x7f621c0a56a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6230103870 0x7f623019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6230102eb0 0x7f6230198470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 --2- 172.21.15.159:0/654824161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62300ffed0 0x7f6230197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 >> 172.21.15.159:0/654824161 conn(0x7f62300fba40 msgr2=0x7f6230106250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:44.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 shutdown_connections 2024-09-15T23:24:44.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:24:44.651+0000 7f6238386640 1 -- 172.21.15.159:0/654824161 wait complete. 2024-09-15T23:24:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:44 smithi155 ceph-mon[35631]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:44.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:44.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:44.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:44.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:44 smithi077 ceph-mon[30968]: pgmap v69: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:45.258 DEBUG:teuthology.orchestra.run.smithi159:osd.2> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.2.service 2024-09-15T23:24:45.260 INFO:tasks.cephadm:Deploying osd.3 on smithi077 with /dev/vg_nvme/lv_3... 2024-09-15T23:24:45.261 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:24:45.503 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:45.510 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:45 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:45.510 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:45 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:45.510 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:45 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:45.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:45 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:45.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:45 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:45.623 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:45 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:45.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:45 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:24:45.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:45 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:45.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:45 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:46.665 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:46 smithi159 ceph-mon[35472]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:46.666 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:46 smithi159 ceph-mon[35472]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:46.666 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:46 smithi159 ceph-mon[35472]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:46.666 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:24:46.338+0000 7f9a54fd1640 -1 osd.2 0 log_to_monitors true 2024-09-15T23:24:46.741 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:46 smithi077 ceph-mon[30968]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:46.742 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:46 smithi077 ceph-mon[30968]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:46.742 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:46 smithi077 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:46 smithi155 ceph-mon[35631]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:46 smithi155 ceph-mon[35631]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:46 smithi155 ceph-mon[35631]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-15T23:24:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:47 smithi077 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:24:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:47 smithi077 ceph-mon[30968]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:47 smithi077 ceph-mon[30968]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:24:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:47 smithi077 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:24:47.431+0000 7f9a50f54640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T23:24:47.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:24:47.438+0000 7f9a4cd7c640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:24:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-mon[35472]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:24:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-mon[35472]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-mon[35472]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:24:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:47 smithi159 ceph-mon[35472]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:47 smithi155 ceph-mon[35631]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-15T23:24:47.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:47 smithi155 ceph-mon[35631]: from='osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:47 smithi155 ceph-mon[35631]: osdmap e16: 3 total, 2 up, 3 in 2024-09-15T23:24:47.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:47.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:47 smithi155 ceph-mon[35631]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:24:47.948 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:24:47.975 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_3 2024-09-15T23:24:48.224 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:48.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:48.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2955637112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 msgr2=0x7f65c4105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2955637112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c4105c40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f65bc009ca0 tx=0x7f65bc02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2955637112 shutdown_connections 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2955637112 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c4105c40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2955637112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 0x7f65c4105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2955637112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 0x7f65c41028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.739+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2955637112 >> 172.21.15.77:0/2955637112 conn(0x7f65c40fc2a0 msgr2=0x7f65c40fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2955637112 shutdown_connections 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2955637112 wait complete. 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 Processor -- start 2024-09-15T23:24:48.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- start start 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 0x7f65c419e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 0x7f65c419eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4113f60 con 0x7f65c4105790 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f65c4113de0 con 0x7f65c4100490 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.740+0000 7f65cb4e2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f65c41140e0 con 0x7f65c4102de0 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c8a7d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 0x7f65c419eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:50096/0 (socket says 172.21.15.77:50096) 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 -- 172.21.15.77:0/2228103505 learned_addr learned my addr 172.21.15.77:0/2228103505 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:24:48.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c927e640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 0x7f65c419e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 -- 172.21.15.77:0/2228103505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 msgr2=0x7f65c419eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 0x7f65c419eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 -- 172.21.15.77:0/2228103505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 msgr2=0x7f65c419e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 0x7f65c419e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 -- 172.21.15.77:0/2228103505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c41a6240 con 0x7f65c4105790 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65c9a7f640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0098d0 tx=0x7f65bc02f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc02fc30 con 0x7f65c4105790 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f65bc003e50 con 0x7f65c4105790 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65c41a64d0 con 0x7f65c4105790 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc004810 con 0x7f65c4105790 2024-09-15T23:24:48.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.741+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65c41a6a90 con 0x7f65c4105790 2024-09-15T23:24:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.742+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65c40fdd90 con 0x7f65c4105790 2024-09-15T23:24:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.743+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f65bc003970 con 0x7f65c4105790 2024-09-15T23:24:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.744+0000 7f65ba7fc640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 0x7f65b00a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:24:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.744+0000 7f65c927e640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 0x7f65b00a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:24:48.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.744+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f65bc0ef5a0 con 0x7f65c4105790 2024-09-15T23:24:48.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.744+0000 7f65c927e640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 0x7f65b00a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009990 tx=0x7f65c0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:24:48.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.748+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f65bc0bda10 con 0x7f65c4105790 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: osdmap e17: 3 total, 2 up, 3 in 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:24:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:48.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:24:48.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:48.922 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:48.921+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f65c4062630 con 0x7f65b00a31e0 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi159 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] boot 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:24:49.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:49.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:49 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi159 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] boot 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:24:49.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:49.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:49.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:49 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:49.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:24:49.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:24:49.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi159 2024-09-15T23:24:49.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi159 to 17088M 2024-09-15T23:24:49.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: osd.2 [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] boot 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: osdmap e18: 3 total, 3 up, 3 in 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:24:49.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:49 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:24:50.565 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:50 smithi077 ceph-mon[30968]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:50.565 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:50 smithi077 ceph-mon[30968]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:24:50.566 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:50 smithi077 ceph-mon[30968]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:50.566 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:50.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:50 smithi159 ceph-mon[35472]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:50.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:50 smithi159 ceph-mon[35472]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:24:50.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:50 smithi159 ceph-mon[35472]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:50.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:50 smithi155 ceph-mon[35631]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:24:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:50 smithi155 ceph-mon[35631]: osdmap e19: 3 total, 3 up, 3 in 2024-09-15T23:24:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:50 smithi155 ceph-mon[35631]: pgmap v76: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:51.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:24:51.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:51.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]: dispatch 2024-09-15T23:24:51.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]': finished 2024-09-15T23:24:51.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:24:51.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:51.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:24:51.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:51.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]: dispatch 2024-09-15T23:24:51.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]': finished 2024-09-15T23:24:51.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:24:51.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:51.866 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50259]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:51.866 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50259]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:51.866 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:51.866 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50259]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:51.866 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: osdmap e20: 3 total, 3 up, 3 in 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]: dispatch 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3604646098' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "507a52c1-e858-4adb-97e8-073b33f574aa"}]': finished 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: osdmap e21: 4 total, 3 up, 4 in 2024-09-15T23:24:51.867 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:52.133 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50283]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:52.133 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50283]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:52.133 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:52.133 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:24:51 smithi077 sudo[50283]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:52.406 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44225]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:52.406 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44225]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:52.406 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:52.406 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44225]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:52.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:24:52.463+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f65bc0b9980 con 0x7f65c4105790 2024-09-15T23:24:52.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44084]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:52.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44084]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:52.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:52.715 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44084]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:52.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:52.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/738195080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:52.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:52.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:24:52.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:52.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/738195080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:52.865 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44228]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:52.865 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44228]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:52.865 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:52.865 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:24:52 smithi155 sudo[44228]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:52.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: pgmap v79: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/738195080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:24:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: osdmap e22: 4 total, 3 up, 4 in 2024-09-15T23:24:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:24:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:53.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44087]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:53.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44087]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:53.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:53.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:24:52 smithi159 sudo[44087]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:53.470 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50516]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:53.470 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50516]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:53.470 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:53.470 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50516]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 ceph-mon[35472]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:53.731 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44090]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:53.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:53 smithi155 ceph-mon[35631]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:24:53.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:53 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:53.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:53 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50702]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 sudo[50702]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 ceph-mon[30968]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:24:53.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:53 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44093]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44093]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:53 smithi159 sudo[44093]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:54.470 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44231]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-15T23:24:54.470 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44231]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:54.470 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:54.470 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44231]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:54.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44234]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-15T23:24:54.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44234]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-15T23:24:54.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-15T23:24:54.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 sudo[44234]: pam_unix(sudo:session): session closed for user root 2024-09-15T23:24:54.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:54 smithi155 ceph-mon[35631]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:54.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:54 smithi077 ceph-mon[30968]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-15T23:24:54.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:54 smithi159 ceph-mon[35472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-15T23:24:57.068 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:56 smithi077 ceph-mon[30968]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:57.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:56 smithi155 ceph-mon[35631]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:56 smithi159 ceph-mon[35472]: pgmap v82: 1 pgs: 1 creating+peering; 0 B data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:59.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:58 smithi077 ceph-mon[30968]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:58 smithi155 ceph-mon[35631]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:24:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:58 smithi159 ceph-mon[35472]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:25:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:24:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:00.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:25:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:24:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-15T23:25:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:24:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:01.081 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:00 smithi077 ceph-mon[30968]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:01.081 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:00 smithi077 ceph-mon[30968]: Deploying daemon osd.3 on smithi077 2024-09-15T23:25:01.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:00 smithi155 ceph-mon[35631]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:01.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:00 smithi155 ceph-mon[35631]: Deploying daemon osd.3 on smithi077 2024-09-15T23:25:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:00 smithi159 ceph-mon[35472]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:00 smithi159 ceph-mon[35472]: Deploying daemon osd.3 on smithi077 2024-09-15T23:25:03.064 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:02 smithi077 ceph-mon[30968]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:03.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:02 smithi155 ceph-mon[35631]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:02 smithi159 ceph-mon[35472]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:05.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:04 smithi077 ceph-mon[30968]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:05.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:04 smithi155 ceph-mon[35631]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:05.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:04 smithi159 ceph-mon[35472]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:06 smithi155 ceph-mon[35631]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:06 smithi077 ceph-mon[30968]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:06 smithi159 ceph-mon[35472]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:09.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.898+0000 7f65ba7fc640 1 -- 172.21.15.77:0/2228103505 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f65c4062630 con 0x7f65b00a31e0 2024-09-15T23:25:09.900 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 3 on host 'smithi077' 2024-09-15T23:25:09.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 msgr2=0x7f65b00a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 0x7f65b00a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009990 tx=0x7f65c0009110 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 msgr2=0x7f65c41a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f65bc0098d0 tx=0x7f65bc02f840 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 shutdown_connections 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f65b00a31e0 0x7f65b00a56a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f65c4105790 0x7f65c41a5bd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65c4102de0 0x7f65c419eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 --2- 172.21.15.77:0/2228103505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f65c4100490 0x7f65c419e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 >> 172.21.15.77:0/2228103505 conn(0x7f65c40fc2a0 msgr2=0x7f65c4100dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 shutdown_connections 2024-09-15T23:25:09.902 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:25:09.900+0000 7f65cb4e2640 1 -- 172.21.15.77:0/2228103505 wait complete. 2024-09-15T23:25:10.537 DEBUG:teuthology.orchestra.run.smithi077:osd.3> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.3.service 2024-09-15T23:25:10.539 INFO:tasks.cephadm:Deploying osd.4 on smithi155 with /dev/vg_nvme/lv_3... 2024-09-15T23:25:10.539 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:25:10.796 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:25:11.045 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:10 smithi077 ceph-mon[30968]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:11.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:11.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:10 smithi155 ceph-mon[35631]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:11.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:11.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:10 smithi159 ceph-mon[35472]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:11.741 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:25:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:25:11.388+0000 7f97375c8640 -1 osd.3 0 log_to_monitors true 2024-09-15T23:25:12.019 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:11 smithi155 ceph-mon[35631]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:25:12.066 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:11 smithi077 ceph-mon[30968]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:25:12.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:11 smithi159 ceph-mon[35472]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-15T23:25:13.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:12 smithi077 ceph-mon[30968]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:13.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:12 smithi077 ceph-mon[30968]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:25:13.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:12 smithi077 ceph-mon[30968]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:25:13.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:12 smithi077 ceph-mon[30968]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:25:13.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:13.053 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:25:13.076 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:12 smithi155 ceph-mon[35631]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:13.076 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:12 smithi155 ceph-mon[35631]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:25:13.077 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:12 smithi155 ceph-mon[35631]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:25:13.077 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:12 smithi155 ceph-mon[35631]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:25:13.077 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:13.078 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2024-09-15T23:25:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:12 smithi159 ceph-mon[35472]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:12 smithi159 ceph-mon[35472]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-15T23:25:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:12 smithi159 ceph-mon[35472]: osdmap e23: 4 total, 3 up, 4 in 2024-09-15T23:25:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:12 smithi159 ceph-mon[35472]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:25:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:13.328 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- 172.21.15.155:0/564796045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8100ad0 msgr2=0x7f1bc8100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 --2- 172.21.15.155:0/564796045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8100ad0 0x7f1bc8100ed0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009ca0 tx=0x7f1bb802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- 172.21.15.155:0/564796045 shutdown_connections 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 --2- 172.21.15.155:0/564796045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8102690 0x7f1bc8108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 --2- 172.21.15.155:0/564796045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8101cd0 0x7f1bc8102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 --2- 172.21.15.155:0/564796045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8100ad0 0x7f1bc8100ed0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- 172.21.15.155:0/564796045 >> 172.21.15.155:0/564796045 conn(0x7f1bc80fc280 msgr2=0x7f1bc80fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- 172.21.15.155:0/564796045 shutdown_connections 2024-09-15T23:25:13.829 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- 172.21.15.155:0/564796045 wait complete. 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 Processor -- start 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.805+0000 7f1bcee92640 1 -- start start 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8100ad0 0x7f1bc819a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8101cd0 0x7f1bc819a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810c830 con 0x7f1bc8101cd0 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810c6b0 con 0x7f1bc8102690 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcee92640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc810c9b0 con 0x7f1bc8100ad0 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:55934/0 (socket says 172.21.15.155:55934) 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 -- 172.21.15.155:0/3867833155 learned_addr learned my addr 172.21.15.155:0/3867833155 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-15T23:25:13.830 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bc7fff640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8101cd0 0x7f1bc819a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bccc2e640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8100ad0 0x7f1bc819a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 -- 172.21.15.155:0/3867833155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8100ad0 msgr2=0x7f1bc819a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8100ad0 0x7f1bc819a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 -- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8101cd0 msgr2=0x7f1bc819a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8101cd0 0x7f1bc819a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 -- 172.21.15.155:0/3867833155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc81a1f00 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bcd42f640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fd0 tx=0x7f1bc000b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.806+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0015020 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.807+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bc0011d10 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.807+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc000f2e0 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.807+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc81a21f0 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.807+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc81a2760 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.808+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc81a2a20 con 0x7f1bc8102690 2024-09-15T23:25:13.831 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.809+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1bc0018020 con 0x7f1bc8102690 2024-09-15T23:25:13.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.809+0000 7f1bc5ffb640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 0x7f1bb40a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:13.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.810+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f1bc00cddd0 con 0x7f1bc8102690 2024-09-15T23:25:13.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.810+0000 7f1bccc2e640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 0x7f1bb40a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:13.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.810+0000 7f1bccc2e640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 0x7f1bb40a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006010 tx=0x7f1bb8000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:13.832 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.814+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1bc001f020 con 0x7f1bc8102690 2024-09-15T23:25:13.850 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:25:13.480+0000 7f973354b640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T23:25:13.850 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:25:13.486+0000 7f972b36b640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:25:13.999 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:13.997+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f1bc81a2bf0 con 0x7f1bb40a3270 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.000 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:14.001 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:14.001 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.001 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' 2024-09-15T23:25:14.001 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' 2024-09-15T23:25:14.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: osdmap e24: 4 total, 3 up, 4 in 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793]' entity='osd.3' 2024-09-15T23:25:14.218 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:15.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:25:15.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi077 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] boot 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:15.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:14 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi077 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:15.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] boot 2024-09-15T23:25:15.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:25:15.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:15.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:15.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:15.117 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:14 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi077 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi077 to 8544M 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: osd.3 [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] boot 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: osdmap e25: 4 total, 4 up, 4 in 2024-09-15T23:25:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-15T23:25:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:15.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:14 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:16.058 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:15 smithi155 ceph-mon[35631]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:16.058 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:15 smithi155 ceph-mon[35631]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:25:16.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:15 smithi077 ceph-mon[30968]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:16.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:15 smithi077 ceph-mon[30968]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:25:16.137 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:15 smithi159 ceph-mon[35472]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:16.137 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:15 smithi159 ceph-mon[35472]: osdmap e26: 4 total, 4 up, 4 in 2024-09-15T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:16.977 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/3052997411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]': finished 2024-09-15T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:25:16.978 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/3052997411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]': finished 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:25:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: osdmap e27: 4 total, 4 up, 4 in 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/3052997411' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]: dispatch 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7b175e86-d9a2-41a5-872e-9b979b709070"}]': finished 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: osdmap e28: 5 total, 4 up, 5 in 2024-09-15T23:25:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:18.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:17 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/1259917052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:18.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:17 smithi077 ceph-mon[30968]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:25:18.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:17 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:18.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:17 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/1259917052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:18.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:17 smithi159 ceph-mon[35472]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:25:18.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:17 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:18.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:17 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/1259917052' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:18.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:17 smithi155 ceph-mon[35631]: osdmap e29: 5 total, 4 up, 5 in 2024-09-15T23:25:18.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:17 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:18 smithi159 ceph-mon[35472]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:18 smithi155 ceph-mon[35631]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:19.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:18 smithi077 ceph-mon[30968]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:20 smithi159 ceph-mon[35472]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:21.215 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:20 smithi155 ceph-mon[35631]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:20 smithi077 ceph-mon[30968]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:22 smithi159 ceph-mon[35472]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:25:23.298 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:22 smithi155 ceph-mon[35631]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:25:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:22 smithi077 ceph-mon[30968]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:25:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:24 smithi159 ceph-mon[35472]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:25:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:25:25.306 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:24 smithi155 ceph-mon[35631]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:25:25.306 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:25:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:24 smithi077 ceph-mon[30968]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:25:25.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-15T23:25:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:25 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:25 smithi159 ceph-mon[35472]: Deploying daemon osd.4 on smithi155 2024-09-15T23:25:26.284 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:25 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:26.284 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:25 smithi077 ceph-mon[30968]: Deploying daemon osd.4 on smithi155 2024-09-15T23:25:26.320 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:26.320 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:25 smithi155 ceph-mon[35631]: Deploying daemon osd.4 on smithi155 2024-09-15T23:25:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:26 smithi159 ceph-mon[35472]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:25:27.336 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:26 smithi155 ceph-mon[35631]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:25:27.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:26 smithi077 ceph-mon[30968]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:25:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:28 smithi155 ceph-mon[35631]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:25:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:28 smithi159 ceph-mon[35472]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:25:29.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:28 smithi077 ceph-mon[30968]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:25:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:29 smithi159 ceph-mon[35472]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:30.317 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:29 smithi155 ceph-mon[35631]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:30.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:29 smithi077 ceph-mon[30968]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:31.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:31.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:31.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:31.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:31.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:31.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:31.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:31.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:31.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:32.532 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:32 smithi155 ceph-mon[35631]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:32.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:32 smithi077 ceph-mon[30968]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:32.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:32 smithi159 ceph-mon[35472]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.236 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.235+0000 7f1bc5ffb640 1 -- 172.21.15.155:0/3867833155 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1bc81a2bf0 con 0x7f1bb40a3270 2024-09-15T23:25:35.236 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 4 on host 'smithi155' 2024-09-15T23:25:35.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 msgr2=0x7f1bb40a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:35.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 0x7f1bb40a5730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006010 tx=0x7f1bb8000f40 comp rx=0 tx=0).stop 2024-09-15T23:25:35.239 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 msgr2=0x7f1bc81a1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fd0 tx=0x7f1bc000b820 comp rx=0 tx=0).stop 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 shutdown_connections 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1bb40a3270 0x7f1bb40a5730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc8102690 0x7f1bc81a1890 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1bc8101cd0 0x7f1bc819a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 --2- 172.21.15.155:0/3867833155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc8100ad0 0x7f1bc819a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 >> 172.21.15.155:0/3867833155 conn(0x7f1bc80fc280 msgr2=0x7f1bc806a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 shutdown_connections 2024-09-15T23:25:35.240 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:25:35.238+0000 7f1bcee92640 1 -- 172.21.15.155:0/3867833155 wait complete. 2024-09-15T23:25:35.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:35.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:35.925 DEBUG:teuthology.orchestra.run.smithi155:osd.4> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.4.service 2024-09-15T23:25:35.928 INFO:tasks.cephadm:Deploying osd.5 on smithi159 with /dev/vg_nvme/lv_3... 2024-09-15T23:25:35.928 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-15T23:25:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:36.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:36.183 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:25:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:36.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:36 smithi159 ceph-mon[35472]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:37.111 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:36 smithi155 ceph-mon[35631]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:37.112 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:25:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:25:37.036+0000 7f6feb35f640 -1 osd.4 0 log_to_monitors true 2024-09-15T23:25:37.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:36 smithi077 ceph-mon[30968]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:37.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:37 smithi077 ceph-mon[30968]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:37.947 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:37 smithi077 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:37 smithi159 ceph-mon[35472]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:37.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:37 smithi159 ceph-mon[35472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:37 smithi155 ceph-mon[35631]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:37 smithi155 ceph-mon[35631]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-15T23:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:25:38.745 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-09-15T23:25:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:38 smithi155 ceph-mon[35631]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:38 smithi159 ceph-mon[35472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-15T23:25:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: osdmap e30: 5 total, 4 up, 5 in 2024-09-15T23:25:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: from='osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:38 smithi077 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:25:39.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/523674715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0102700 msgr2=0x7fa3b0104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:39.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/523674715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0102700 0x7fa3b0104af0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009900 tx=0x7fa3a002a410 comp rx=0 tx=0).stop 2024-09-15T23:25:39.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/523674715 shutdown_connections 2024-09-15T23:25:39.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/523674715 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 0x7fa3b0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:39.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/523674715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0105030 0x7fa3b0107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/523674715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0102700 0x7fa3b0104af0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/523674715 >> 172.21.15.159:0/523674715 conn(0x7fa3b00fc2a0 msgr2=0x7fa3b00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/523674715 shutdown_connections 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/523674715 wait complete. 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 Processor -- start 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.544+0000 7fa3b4cfc640 1 -- start start 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0102700 0x7fa3b0197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 0x7fa3b019f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010d8c0 con 0x7fa3b0107960 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010d740 con 0x7fa3b0102700 2024-09-15T23:25:39.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b010da40 con 0x7fa3b0105030 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33518/0 (socket says 172.21.15.159:33518) 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 -- 172.21.15.159:0/2570353200 learned_addr learned my addr 172.21.15.159:0/2570353200 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3ae59c640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0102700 0x7fa3b0197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3aed9d640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 0x7fa3b019f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 -- 172.21.15.159:0/2570353200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0102700 msgr2=0x7fa3b0197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0102700 0x7fa3b0197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 -- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 msgr2=0x7fa3b019f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 0x7fa3b019f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 -- 172.21.15.159:0/2570353200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b019fb50 con 0x7fa3b0105030 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3add9b640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400e9f0 tx=0x7fa3a400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:39.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400ccc0 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b019fe40 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a4005500 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.545+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4010690 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.546+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b01a02f0 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.547+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b00fdd90 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.548+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa3a40046c0 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.548+0000 7fa39f7fe640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 0x7fa3980a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.548+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3821+0+0 (secure 0 0 0) 0x7fa3a40cea80 con 0x7fa3b0105030 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.548+0000 7fa3ae59c640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 0x7fa3980a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.549+0000 7fa3ae59c640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 0x7fa3980a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00314e0 tx=0x7fa3a0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:25:39.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.553+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3a409c930 con 0x7fa3b0105030 2024-09-15T23:25:39.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:25:39.730+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa3b0062630 con 0x7fa3980a3270 2024-09-15T23:25:39.820 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:25:39.479+0000 7f6fe7af6640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T23:25:39.820 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:25:39.486+0000 7f6fdf102640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi155 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='osd.4 ' entity='osd.4' 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:40.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:25:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T23:25:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi155 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='osd.4 ' entity='osd.4' 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:40.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:40.139 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:25:40.139 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: osdmap e31: 5 total, 4 up, 5 in 2024-09-15T23:25:40.139 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.139 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi155 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='osd.4 ' entity='osd.4' 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:25:40.140 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] boot 2024-09-15T23:25:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:25:41.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] boot 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:25:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: osd.4 [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] boot 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: osdmap e32: 5 total, 5 up, 5 in 2024-09-15T23:25:41.184 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/2972879121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]': finished 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:25:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:42 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/3320749769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/2972879121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]': finished 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:25:43.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/3320749769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:43.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:43.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: osdmap e33: 5 total, 5 up, 5 in 2024-09-15T23:25:43.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/2972879121' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]: dispatch 2024-09-15T23:25:43.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d"}]': finished 2024-09-15T23:25:43.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: osdmap e34: 6 total, 5 up, 6 in 2024-09-15T23:25:43.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:25:43.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:42 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/3320749769' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:25:45.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:44 smithi155 ceph-mon[35631]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:45.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:44 smithi077 ceph-mon[30968]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:44 smithi159 ceph-mon[35472]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:46.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:46 smithi159 ceph-mon[35472]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:46 smithi155 ceph-mon[35631]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:47.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:46 smithi077 ceph-mon[30968]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:49.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:48 smithi155 ceph-mon[35631]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:48 smithi077 ceph-mon[30968]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:49.200 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:48 smithi159 ceph-mon[35472]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:50 smithi155 ceph-mon[35631]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:25:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:50 smithi077 ceph-mon[30968]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:25:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:51.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:50 smithi159 ceph-mon[35472]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:51.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-15T23:25:51.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:25:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:51 smithi155 ceph-mon[35631]: Deploying daemon osd.5 on smithi159 2024-09-15T23:25:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:51 smithi077 ceph-mon[30968]: Deploying daemon osd.5 on smithi159 2024-09-15T23:25:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:51 smithi159 ceph-mon[35472]: Deploying daemon osd.5 on smithi159 2024-09-15T23:25:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:52 smithi155 ceph-mon[35631]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:53.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:52 smithi077 ceph-mon[30968]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:53.205 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:52 smithi159 ceph-mon[35472]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:55.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:54 smithi155 ceph-mon[35631]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:54 smithi077 ceph-mon[30968]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:54 smithi159 ceph-mon[35472]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:56.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:56 smithi159 ceph-mon[35472]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:57.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:56 smithi155 ceph-mon[35631]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:57.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:56 smithi077 ceph-mon[30968]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:57.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:57 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:57.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:57 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:57.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:57 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:58.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:57 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:58.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:57 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:58.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:57 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:57 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:25:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:57 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:58.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:57 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:25:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:25:58 smithi077 ceph-mon[30968]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:25:58 smithi159 ceph-mon[35472]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:25:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:25:58 smithi155 ceph-mon[35631]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.818 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:00 smithi159 ceph-mon[35472]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:00 smithi155 ceph-mon[35631]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:00.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:00 smithi077 ceph-mon[30968]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:01.169 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 5 on host 'smithi159' 2024-09-15T23:26:01.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.167+0000 7fa39f7fe640 1 -- 172.21.15.159:0/2570353200 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa3b0062630 con 0x7fa3980a3270 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 msgr2=0x7fa3980a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 0x7fa3980a5730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00314e0 tx=0x7fa3a0000bc0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 msgr2=0x7fa3b0198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400e9f0 tx=0x7fa3a400eeb0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 shutdown_connections 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3980a3270 0x7fa3980a5730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b0107960 0x7fa3b019f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b0105030 0x7fa3b0198460 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 --2- 172.21.15.159:0/2570353200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b0102700 0x7fa3b0197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:01.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 >> 172.21.15.159:0/2570353200 conn(0x7fa3b00fc2a0 msgr2=0x7fa3b01030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:01.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 shutdown_connections 2024-09-15T23:26:01.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:01.170+0000 7fa3b4cfc640 1 -- 172.21.15.159:0/2570353200 wait complete. 2024-09-15T23:26:01.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:01 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:01.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:01 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:01 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.864 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:01 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:01.864 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:01 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.865 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:01 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:01 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:01.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:01 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:01 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:01.899 DEBUG:teuthology.orchestra.run.smithi159:osd.5> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.5.service 2024-09-15T23:26:01.902 INFO:tasks.cephadm:Deploying osd.6 on smithi077 with /dev/vg_nvme/lv_2... 2024-09-15T23:26:01.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:26:02.156 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:26:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:02 smithi155 ceph-mon[35631]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:02.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:02 smithi077 ceph-mon[30968]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:02.910 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:02 smithi159 ceph-mon[35472]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:03.175 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:26:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:26:02.908+0000 7fe545b93640 -1 osd.5 0 log_to_monitors true 2024-09-15T23:26:03.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:03 smithi155 ceph-mon[35631]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:03.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:03 smithi155 ceph-mon[35631]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:03.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:03 smithi077 ceph-mon[30968]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:03.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:03 smithi077 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:03.964 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:03 smithi159 ceph-mon[35472]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:03.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:03 smithi159 ceph-mon[35472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-15T23:26:04.710 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:04 smithi159 ceph-mon[35472]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:04.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:26:04.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:26:04.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:04.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.735 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.736 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:04 smithi077 ceph-mon[30968]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:04.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_2 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: osdmap e35: 6 total, 5 up, 6 in 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: from='osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:26:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:04 smithi155 ceph-mon[35631]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-09-15T23:26:04.998 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:26:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.458+0000 7faa7cde7640 1 -- 172.21.15.77:0/1594233576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa781037c0 msgr2=0x7faa7810a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.458+0000 7faa7cde7640 1 --2- 172.21.15.77:0/1594233576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa781037c0 0x7faa7810a050 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faa70009ca0 tx=0x7faa7002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 -- 172.21.15.77:0/1594233576 shutdown_connections 2024-09-15T23:26:05.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 --2- 172.21.15.77:0/1594233576 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa781037c0 0x7faa7810a050 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 --2- 172.21.15.77:0/1594233576 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa78102e00 0x7faa78103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 --2- 172.21.15.77:0/1594233576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78101c00 0x7faa78102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 -- 172.21.15.77:0/1594233576 >> 172.21.15.77:0/1594233576 conn(0x7faa780fd390 msgr2=0x7faa780ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 -- 172.21.15.77:0/1594233576 shutdown_connections 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 -- 172.21.15.77:0/1594233576 wait complete. 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 Processor -- start 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.459+0000 7faa7cde7640 1 -- start start 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 0x7faa780745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa781037c0 0x7faa78074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faa7810d980 con 0x7faa78101c00 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa7810d800 con 0x7faa78102e00 2024-09-15T23:26:05.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7cde7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faa7810db00 con 0x7faa781037c0 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38150/0 (socket says 172.21.15.77:38150) 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 -- 172.21.15.77:0/626134880 learned_addr learned my addr 172.21.15.77:0/626134880 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa76d9d640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa781037c0 0x7faa78074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa75d9b640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 0x7faa780745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 -- 172.21.15.77:0/626134880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa781037c0 msgr2=0x7faa78074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa781037c0 0x7faa78074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 -- 172.21.15.77:0/626134880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 msgr2=0x7faa780745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 0x7faa780745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 -- 172.21.15.77:0/626134880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa780753e0 con 0x7faa78101c00 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa75d9b640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 0x7faa780745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa7659c640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa6800b450 tx=0x7faa6800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:05.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.460+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa68015020 con 0x7faa78101c00 2024-09-15T23:26:05.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.461+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa68011d70 con 0x7faa78101c00 2024-09-15T23:26:05.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.461+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa781a21c0 con 0x7faa78101c00 2024-09-15T23:26:05.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.461+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6800f340 con 0x7faa78101c00 2024-09-15T23:26:05.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.461+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa781a2750 con 0x7faa78101c00 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.462+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa78109050 con 0x7faa78101c00 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.463+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faa68018020 con 0x7faa78101c00 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.463+0000 7faa677fe640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 0x7faa600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.463+0000 7faa75d9b640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 0x7faa600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.463+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4253+0+0 (secure 0 0 0) 0x7faa680ce3b0 con 0x7faa78101c00 2024-09-15T23:26:05.466 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.464+0000 7faa75d9b640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 0x7faa600a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa6c006fd0 tx=0x7faa6c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:05.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.468+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faa6801f020 con 0x7faa78101c00 2024-09-15T23:26:05.609 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:26:05.276+0000 7fe541b16640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T23:26:05.609 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:26:05.282+0000 7fe539936640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi159 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='osd.5 ' entity='osd.5' 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] boot 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:26:05.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:05.645+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7faa78062630 con 0x7faa600a3240 2024-09-15T23:26:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:26:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T23:26:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi159 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='osd.5 ' entity='osd.5' 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] boot 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:26:05.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: osdmap e36: 6 total, 5 up, 6 in 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi159 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi159 to 8544M 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='osd.5 ' entity='osd.5' 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: osd.5 [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] boot 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: osdmap e37: 6 total, 6 up, 6 in 2024-09-15T23:26:05.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:06.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:06 smithi077 ceph-mon[30968]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:06 smithi159 ceph-mon[35472]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:06 smithi155 ceph-mon[35631]: osdmap e38: 6 total, 6 up, 6 in 2024-09-15T23:26:08.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T23:26:08.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:08.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]: dispatch 2024-09-15T23:26:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]': finished 2024-09-15T23:26:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:26:08.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:08.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T23:26:08.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:08.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]: dispatch 2024-09-15T23:26:08.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]': finished 2024-09-15T23:26:08.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:26:08.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: osdmap e39: 6 total, 6 up, 6 in 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]: dispatch 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2826257541' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a70f9349-8a28-4915-a236-68f7a4ba7045"}]': finished 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: osdmap e40: 7 total, 6 up, 7 in 2024-09-15T23:26:08.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:09.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1702808993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:09.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:09 smithi159 ceph-mon[35472]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:26:09.717 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:09 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:09.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:09 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1702808993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:09.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:09 smithi155 ceph-mon[35631]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:26:09.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:09 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:09.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:09 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1702808993' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:09.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:09 smithi077 ceph-mon[30968]: osdmap e41: 7 total, 6 up, 7 in 2024-09-15T23:26:09.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:09 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:10 smithi159 ceph-mon[35472]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:10 smithi155 ceph-mon[35631]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:10.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:10 smithi077 ceph-mon[30968]: pgmap v138: 1 pgs: 1 remapped+peering; 577 KiB data, 570 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:13.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:12 smithi155 ceph-mon[35631]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-15T23:26:13.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:12 smithi077 ceph-mon[30968]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-15T23:26:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:12 smithi159 ceph-mon[35472]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-09-15T23:26:14.844 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:14 smithi077 ceph-mon[30968]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-15T23:26:15.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:14 smithi155 ceph-mon[35631]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-15T23:26:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:14 smithi159 ceph-mon[35472]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-15T23:26:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:16 smithi155 ceph-mon[35631]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:26:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:26:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:16 smithi077 ceph-mon[30968]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:26:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:26:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:16 smithi159 ceph-mon[35472]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-15T23:26:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-15T23:26:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:18.098 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:17 smithi077 ceph-mon[30968]: Deploying daemon osd.6 on smithi077 2024-09-15T23:26:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:17 smithi155 ceph-mon[35631]: Deploying daemon osd.6 on smithi077 2024-09-15T23:26:18.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:17 smithi159 ceph-mon[35472]: Deploying daemon osd.6 on smithi077 2024-09-15T23:26:19.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:18 smithi155 ceph-mon[35631]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:26:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:18 smithi077 ceph-mon[30968]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:26:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:18 smithi159 ceph-mon[35472]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-09-15T23:26:20.939 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:20 smithi077 ceph-mon[30968]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T23:26:21.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:20 smithi155 ceph-mon[35631]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T23:26:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:20 smithi159 ceph-mon[35472]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 54 KiB/s, 0 objects/s recovering 2024-09-15T23:26:22.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:22 smithi077 ceph-mon[30968]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:26:22.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:22.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:22.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:22 smithi155 ceph-mon[35631]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:26:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:22 smithi159 ceph-mon[35472]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:26:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:24 smithi155 ceph-mon[35631]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:24 smithi077 ceph-mon[30968]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:24 smithi159 ceph-mon[35472]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:25.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.976+0000 7faa677fe640 1 -- 172.21.15.77:0/626134880 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7faa78062630 con 0x7faa600a3240 2024-09-15T23:26:25.977 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 6 on host 'smithi077' 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 msgr2=0x7faa600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 0x7faa600a5700 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa6c006fd0 tx=0x7faa6c008040 comp rx=0 tx=0).stop 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 msgr2=0x7faa78075f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa6800b450 tx=0x7faa6800b910 comp rx=0 tx=0).stop 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 shutdown_connections 2024-09-15T23:26:25.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faa600a3240 0x7faa600a5700 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa781037c0 0x7faa78074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa78102e00 0x7faa780745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 --2- 172.21.15.77:0/626134880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faa78101c00 0x7faa78075f90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 >> 172.21.15.77:0/626134880 conn(0x7faa780fd390 msgr2=0x7faa78106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 shutdown_connections 2024-09-15T23:26:25.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:26:25.978+0000 7faa7cde7640 1 -- 172.21.15.77:0/626134880 wait complete. 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.257 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:26.258 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:26.258 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.258 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.315 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:26.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:26.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.316 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:26.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:26.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.317 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:26.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:26.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:26.721 DEBUG:teuthology.orchestra.run.smithi077:osd.6> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.6.service 2024-09-15T23:26:26.723 INFO:tasks.cephadm:Deploying osd.7 on smithi155 with /dev/vg_nvme/lv_2... 2024-09-15T23:26:26.724 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:26:26.978 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:26:28.383 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:26:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:26:28.282+0000 7f18c1f54640 -1 osd.6 0 log_to_monitors true 2024-09-15T23:26:29.064 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:28 smithi077 ceph-mon[30968]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:29.064 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:28 smithi077 ceph-mon[30968]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:26:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:28 smithi155 ceph-mon[35631]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:28 smithi155 ceph-mon[35631]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:26:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:28 smithi159 ceph-mon[35472]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:28 smithi159 ceph-mon[35472]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-15T23:26:29.671 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:26:29.698 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:29.959 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:26:29.960 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:29 smithi155 ceph-mon[35631]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T23:26:29.961 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:26:30.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:26:30.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.135 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:26:30.136 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:29 smithi077 ceph-mon[30968]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: osdmap e42: 7 total, 6 up, 7 in 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:26:30.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:29 smithi159 ceph-mon[35472]: osdmap e43: 7 total, 6 up, 7 in 2024-09-15T23:26:30.488 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.473+0000 7fc43c939640 1 -- 172.21.15.155:0/1009996063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 msgr2=0x7fc438103290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.473+0000 7fc43c939640 1 --2- 172.21.15.155:0/1009996063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc438103290 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009900 tx=0x7fc42c02a410 comp rx=0 tx=0).stop 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 -- 172.21.15.155:0/1009996063 shutdown_connections 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 --2- 172.21.15.155:0/1009996063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc4381037d0 0x7fc43810a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 --2- 172.21.15.155:0/1009996063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc438103290 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 --2- 172.21.15.155:0/1009996063 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc438101c10 0x7fc438102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 -- 172.21.15.155:0/1009996063 >> 172.21.15.155:0/1009996063 conn(0x7fc4380fd3c0 msgr2=0x7fc4380ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 -- 172.21.15.155:0/1009996063 shutdown_connections 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 -- 172.21.15.155:0/1009996063 wait complete. 2024-09-15T23:26:30.489 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.474+0000 7fc43c939640 1 Processor -- start 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 -- start start 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc438101c10 0x7fc438197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4381037d0 0x7fc43819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc43810d8f0 con 0x7fc4381037d0 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc43810d770 con 0x7fc438102e10 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43c939640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc43810da70 con 0x7fc438101c10 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:58890/0 (socket says 172.21.15.155:58890) 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 -- 172.21.15.155:0/2191196901 learned_addr learned my addr 172.21.15.155:0/2191196901 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-15T23:26:30.490 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc436d9d640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4381037d0 0x7fc43819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc43659c640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc438101c10 0x7fc438197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 -- 172.21.15.155:0/2191196901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc438101c10 msgr2=0x7fc438197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc438101c10 0x7fc438197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 -- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4381037d0 msgr2=0x7fc43819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4381037d0 0x7fc43819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 -- 172.21.15.155:0/2191196901 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc43819fba0 con 0x7fc438102e10 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.475+0000 7fc435d9b640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009230 tx=0x7fc42c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.476+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c03f030 con 0x7fc438102e10 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.476+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc43819fe30 con 0x7fc438102e10 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.476+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc42c003ce0 con 0x7fc438102e10 2024-09-15T23:26:30.491 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.476+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c035070 con 0x7fc438102e10 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.476+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4381a0310 con 0x7fc438102e10 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.477+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc438109060 con 0x7fc438102e10 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.478+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc42c042030 con 0x7fc438102e10 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.478+0000 7fc4277fe640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 0x7fc4200a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.479+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4685+0+0 (secure 0 0 0) 0x7fc42c0ef520 con 0x7fc438102e10 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.479+0000 7fc43659c640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 0x7fc4200a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.479+0000 7fc43659c640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 0x7fc4200a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc428005fd0 tx=0x7fc428005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:30.492 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.482+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc42c0bd070 con 0x7fc438102e10 2024-09-15T23:26:30.666 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:30.665+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc438062630 con 0x7fc4200a3270 2024-09-15T23:26:30.820 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:26:30.478+0000 7f18bded7640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T23:26:30.820 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:26:30.488+0000 7f18b5cf7640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi077 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' 2024-09-15T23:26:31.074 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:31.074 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:31.074 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:31.074 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi077 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:31.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:31.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi077 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi077 to 5696M 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738]' entity='osd.6' 2024-09-15T23:26:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:31.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:31.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:31.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:26:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:26:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:32.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] boot 2024-09-15T23:26:32.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:26:32.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] boot 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:26:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: osd.6 [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] boot 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: osdmap e44: 7 total, 7 up, 7 in 2024-09-15T23:26:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-15T23:26:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:32 smithi155 ceph-mon[35631]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:32 smithi077 ceph-mon[30968]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:32 smithi159 ceph-mon[35472]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-09-15T23:26:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T23:26:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/4139641243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]': finished 2024-09-15T23:26:34.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:26:34.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:34.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:33 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/824393318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/4139641243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]': finished 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:33 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/824393318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: osdmap e45: 7 total, 7 up, 7 in 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/4139641243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]: dispatch 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "49b06105-0357-42ce-8a9e-a322dc8a07bc"}]': finished 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: osdmap e46: 8 total, 7 up, 8 in 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:33 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/824393318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:26:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:34 smithi155 ceph-mon[35631]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:35.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:34 smithi077 ceph-mon[30968]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:35.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:34 smithi159 ceph-mon[35472]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:36 smithi155 ceph-mon[35631]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:37.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:36 smithi077 ceph-mon[30968]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:36 smithi159 ceph-mon[35472]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:38 smithi155 ceph-mon[35631]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:39.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:38 smithi077 ceph-mon[30968]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:38 smithi159 ceph-mon[35472]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:40 smithi155 ceph-mon[35631]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:40 smithi077 ceph-mon[30968]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:40 smithi159 ceph-mon[35472]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:42.965 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:42 smithi155 ceph-mon[35631]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:42.965 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:26:42.966 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:42.966 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:42 smithi155 ceph-mon[35631]: Deploying daemon osd.7 on smithi155 2024-09-15T23:26:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:42 smithi077 ceph-mon[30968]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:26:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:42 smithi077 ceph-mon[30968]: Deploying daemon osd.7 on smithi155 2024-09-15T23:26:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:42 smithi159 ceph-mon[35472]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-15T23:26:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:42 smithi159 ceph-mon[35472]: Deploying daemon osd.7 on smithi155 2024-09-15T23:26:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:44 smithi155 ceph-mon[35631]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:45.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:44 smithi077 ceph-mon[30968]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:44 smithi159 ceph-mon[35472]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:47.072 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:46 smithi155 ceph-mon[35631]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:47.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:46 smithi077 ceph-mon[30968]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:46 smithi159 ceph-mon[35472]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:49.023 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:48 smithi155 ceph-mon[35631]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:49.270 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:49.270 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:49.270 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:49.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:48 smithi159 ceph-mon[35472]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:49.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:49.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:49.271 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:49.271 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:48 smithi077 ceph-mon[30968]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:49.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:49.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:49.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:51.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:51.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:51.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:51.771 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.769+0000 7fc4277fe640 1 -- 172.21.15.155:0/2191196901 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc438062630 con 0x7fc4200a3270 2024-09-15T23:26:51.772 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 7 on host 'smithi155' 2024-09-15T23:26:51.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 msgr2=0x7fc4200a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:51.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 0x7fc4200a5730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc428005fd0 tx=0x7fc428005850 comp rx=0 tx=0).stop 2024-09-15T23:26:51.773 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 msgr2=0x7fc4381984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009230 tx=0x7fc42c004360 comp rx=0 tx=0).stop 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 shutdown_connections 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc4200a3270 0x7fc4200a5730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc4381037d0 0x7fc43819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc438102e10 0x7fc4381984b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 --2- 172.21.15.155:0/2191196901 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc438101c10 0x7fc438197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 >> 172.21.15.155:0/2191196901 conn(0x7fc4380fd3c0 msgr2=0x7fc438106230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 shutdown_connections 2024-09-15T23:26:51.774 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:26:51.772+0000 7fc43c939640 1 -- 172.21.15.155:0/2191196901 wait complete. 2024-09-15T23:26:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:26:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:52.469 DEBUG:teuthology.orchestra.run.smithi155:osd.7> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.7.service 2024-09-15T23:26:52.475 INFO:tasks.cephadm:Deploying osd.8 on smithi159 with /dev/vg_nvme/lv_2... 2024-09-15T23:26:52.475 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-15T23:26:52.732 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:26:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:52 smithi155 ceph-mon[35631]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:53.273 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:52 smithi159 ceph-mon[35472]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:53.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:52 smithi077 ceph-mon[30968]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:54.364 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:26:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:26:54.087+0000 7f74f8bcb640 -1 osd.7 0 log_to_monitors true 2024-09-15T23:26:55.003 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:54 smithi155 ceph-mon[35631]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:55.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:54 smithi155 ceph-mon[35631]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.004 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:54 smithi155 ceph-mon[35631]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:54 smithi077 ceph-mon[30968]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:54 smithi077 ceph-mon[30968]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:54 smithi077 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.176 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:54 smithi159 ceph-mon[35472]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:55.176 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:54 smithi159 ceph-mon[35472]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.176 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:54 smithi159 ceph-mon[35472]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-15T23:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:26:55.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-09-15T23:26:55.782 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:26:56.042 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:26:56.042 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.043 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:26:56.044 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T23:26:56.044 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:55 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T23:26:56.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:55 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 -- 172.21.15.159:0/1195110822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 msgr2=0x7fed6c10a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 --2- 172.21.15.159:0/1195110822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c10a140 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fed64009930 tx=0x7fed6402a420 comp rx=0 tx=0).stop 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 -- 172.21.15.159:0/1195110822 shutdown_connections 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 --2- 172.21.15.159:0/1195110822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c10a140 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 --2- 172.21.15.159:0/1195110822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 0x7fed6c103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 --2- 172.21.15.159:0/1195110822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 0x7fed6c100310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 -- 172.21.15.159:0/1195110822 >> 172.21.15.159:0/1195110822 conn(0x7fed6c0fba80 msgr2=0x7fed6c0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 -- 172.21.15.159:0/1195110822 shutdown_connections 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 -- 172.21.15.159:0/1195110822 wait complete. 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.257+0000 7fed745ca640 1 Processor -- start 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 -- start start 2024-09-15T23:26:56.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 0x7fed6c197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 0x7fed6c198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c10d880 con 0x7fed6c102ef0 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c10d700 con 0x7fed6c0fff10 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed745ca640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c10da00 con 0x7fed6c1038b0 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72366640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 0x7fed6c197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37982/0 (socket says 172.21.15.159:37982) 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 -- 172.21.15.159:0/4210089471 learned_addr learned my addr 172.21.15.159:0/4210089471 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed71b65640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 0x7fed6c198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 -- 172.21.15.159:0/4210089471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 msgr2=0x7fed6c197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:56.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 0x7fed6c197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 -- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 msgr2=0x7fed6c198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 0x7fed6c198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 -- 172.21.15.159:0/4210089471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6c19fb00 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.258+0000 7fed72b67640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed64009900 tx=0x7fed640042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.259+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed6403f030 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.259+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fed64003ce0 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.259+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c19fd90 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.259+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed64035070 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.259+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c1a0260 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.260+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c109140 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.261+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fed64042030 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.262+0000 7fed6b7fe640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 0x7fed540a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.262+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5117+0+0 (secure 0 0 0) 0x7fed640ef110 con 0x7fed6c1038b0 2024-09-15T23:26:56.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.262+0000 7fed72366640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 0x7fed540a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:26:56.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.263+0000 7fed72366640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 0x7fed540a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed6c069d70 tx=0x7fed5c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:26:56.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.266+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fed640bc3c0 con 0x7fed6c1038b0 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: osdmap e47: 8 total, 7 up, 8 in 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: osdmap e48: 8 total, 7 up, 8 in 2024-09-15T23:26:56.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:55 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:56.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:26:56.448+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fed6c062630 con 0x7fed540a32f0 2024-09-15T23:26:56.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:26:56.524+0000 7f74f5362640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T23:26:56.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:26:56.534+0000 7f74ec96e640 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:26:57.005 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi155 2024-09-15T23:26:57.006 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-15T23:26:57.006 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:57.006 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.006 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='osd.7 ' entity='osd.7' 2024-09-15T23:26:57.007 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi155 2024-09-15T23:26:57.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-15T23:26:57.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:57.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='osd.7 ' entity='osd.7' 2024-09-15T23:26:57.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi155 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: osdmap e49: 8 total, 7 up, 8 in 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='osd.7 ' entity='osd.7' 2024-09-15T23:26:57.370 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] boot 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:26:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:57 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] boot 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:26:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:57 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: osd.7 [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] boot 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: osdmap e50: 8 total, 8 up, 8 in 2024-09-15T23:26:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:57 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-15T23:26:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:58 smithi159 ceph-mon[35472]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:58 smithi159 ceph-mon[35472]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T23:26:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:58 smithi155 ceph-mon[35631]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:58 smithi155 ceph-mon[35631]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T23:26:59.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:58 smithi077 ceph-mon[30968]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-09-15T23:26:59.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:58 smithi077 ceph-mon[30968]: osdmap e51: 8 total, 8 up, 8 in 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/2478777812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]': finished 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:26:59 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/1214221692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/2478777812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]': finished 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:00.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:26:59 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/1214221692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/2478777812' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]: dispatch 2024-09-15T23:27:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f0baf0c-70da-4e75-a6ee-018aba7a4232"}]': finished 2024-09-15T23:27:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: osdmap e52: 9 total, 8 up, 9 in 2024-09-15T23:27:00.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:00.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:26:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/1214221692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:00 smithi159 ceph-mon[35472]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:00 smithi159 ceph-mon[35472]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:27:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:00 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:00 smithi155 ceph-mon[35631]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:00 smithi155 ceph-mon[35631]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:27:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:00 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:01.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:00 smithi077 ceph-mon[30968]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:01.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:00 smithi077 ceph-mon[30968]: osdmap e53: 9 total, 8 up, 9 in 2024-09-15T23:27:01.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:00 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:01 smithi155 ceph-mon[35631]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:27:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:01 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:02.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:01 smithi155 ceph-mon[35631]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:01 smithi077 ceph-mon[30968]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:27:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:01 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:02.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:01 smithi077 ceph-mon[30968]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:01 smithi159 ceph-mon[35472]: osdmap e54: 9 total, 8 up, 9 in 2024-09-15T23:27:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:01 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:02.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:01 smithi159 ceph-mon[35472]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:05.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:04 smithi155 ceph-mon[35631]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:05.125 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:04 smithi159 ceph-mon[35472]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:04 smithi077 ceph-mon[30968]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:06.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:06 smithi159 ceph-mon[35472]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:06 smithi155 ceph-mon[35631]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:06 smithi077 ceph-mon[30968]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 246 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:08.041 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:27:08.041 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:27:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:08.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-15T23:27:08.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:08 smithi155 ceph-mon[35631]: Deploying daemon osd.8 on smithi159 2024-09-15T23:27:09.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:08 smithi155 ceph-mon[35631]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:08 smithi077 ceph-mon[30968]: Deploying daemon osd.8 on smithi159 2024-09-15T23:27:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:08 smithi077 ceph-mon[30968]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:09.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:08 smithi159 ceph-mon[35472]: Deploying daemon osd.8 on smithi159 2024-09-15T23:27:09.160 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:08 smithi159 ceph-mon[35472]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:11.111 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:10 smithi159 ceph-mon[35472]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:11.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:10 smithi155 ceph-mon[35631]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:10 smithi077 ceph-mon[30968]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:12 smithi159 ceph-mon[35472]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:13.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:12 smithi155 ceph-mon[35631]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:13.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:12 smithi077 ceph-mon[30968]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:14.100 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:14.100 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:14.100 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:14.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:14.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:14.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:14.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:15.109 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:14 smithi159 ceph-mon[35472]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:15.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:14 smithi155 ceph-mon[35631]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:15.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:14 smithi077 ceph-mon[30968]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:17.105 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:17.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.475+0000 7fed6b7fe640 1 -- 172.21.15.159:0/4210089471 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fed6c062630 con 0x7fed540a32f0 2024-09-15T23:27:17.478 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 8 on host 'smithi159' 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 msgr2=0x7fed540a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 0x7fed540a57b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed6c069d70 tx=0x7fed5c005f90 comp rx=0 tx=0).stop 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 msgr2=0x7fed6c19f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed64009900 tx=0x7fed640042f0 comp rx=0 tx=0).stop 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 shutdown_connections 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fed540a32f0 0x7fed540a57b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed6c1038b0 0x7fed6c19f490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fed6c102ef0 0x7fed6c198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 --2- 172.21.15.159:0/4210089471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fed6c0fff10 0x7fed6c197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 >> 172.21.15.159:0/4210089471 conn(0x7fed6c0fba80 msgr2=0x7fed6c106310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:27:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 shutdown_connections 2024-09-15T23:27:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:27:17.478+0000 7fed745ca640 1 -- 172.21.15.159:0/4210089471 wait complete. 2024-09-15T23:27:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:17 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:17 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:17 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:17 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:18.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:17 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:17 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:17 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:17 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.135 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:17 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:18.162 DEBUG:teuthology.orchestra.run.smithi159:osd.8> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.8.service 2024-09-15T23:27:18.164 INFO:tasks.cephadm:Deploying osd.9 on smithi077 with /dev/vg_nvme/lv_1... 2024-09-15T23:27:18.164 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:27:18.421 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:27:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:18 smithi155 ceph-mon[35631]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:18 smithi077 ceph-mon[30968]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:18 smithi159 ceph-mon[35472]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:19.606 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:27:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:27:19.235+0000 7f4de55b7640 -1 osd.8 0 log_to_monitors true 2024-09-15T23:27:19.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:19 smithi077 ceph-mon[30968]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:19.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:19 smithi077 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:19.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:19 smithi159 ceph-mon[35472]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:19.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:19 smithi159 ceph-mon[35472]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:19 smithi155 ceph-mon[35631]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:19 smithi155 ceph-mon[35631]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-15T23:27:21.014 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:21.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:27:21.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T23:27:21.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:20 smithi077 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.017 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:27:21.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi077:vg_nvme/lv_1 2024-09-15T23:27:21.084 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:21.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:27:21.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T23:27:21.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.085 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:20 smithi159 ceph-mon[35472]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: osdmap e55: 9 total, 8 up, 9 in 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: from='osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:20 smithi155 ceph-mon[35631]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:27:21.305 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 -- 172.21.15.77:0/2616797268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 msgr2=0x7f3648100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2616797268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f3648100ed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3638009ca0 tx=0x7f363802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 -- 172.21.15.77:0/2616797268 shutdown_connections 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2616797268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648102690 0x7f3648108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2616797268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648101cd0 0x7f3648102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2616797268 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f3648100ed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 -- 172.21.15.77:0/2616797268 >> 172.21.15.77:0/2616797268 conn(0x7f36480fc280 msgr2=0x7f36480fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.785+0000 7f364d5ac640 1 -- 172.21.15.77:0/2616797268 shutdown_connections 2024-09-15T23:27:21.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 -- 172.21.15.77:0/2616797268 wait complete. 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 Processor -- start 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 -- start start 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648101cd0 0x7f364819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 0x7f364819f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f364810c760 con 0x7f3648100ad0 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f364810c5e0 con 0x7f3648102690 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f364d5ac640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f364810c8e0 con 0x7f3648101cd0 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.786+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58188/0 (socket says 172.21.15.77:58188) 2024-09-15T23:27:21.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 -- 172.21.15.77:0/2732867889 learned_addr learned my addr 172.21.15.77:0/2732867889 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f36467fc640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648101cd0 0x7f364819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f36477fe640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 0x7f364819f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 -- 172.21.15.77:0/2732867889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648101cd0 msgr2=0x7f364819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648101cd0 0x7f364819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 -- 172.21.15.77:0/2732867889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 msgr2=0x7f364819f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 0x7f364819f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 -- 172.21.15.77:0/2732867889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364819fb10 con 0x7f3648100ad0 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f36477fe640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 0x7f364819f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f3646ffd640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3638004af0 tx=0x7f3638031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f363802faa0 con 0x7f3648100ad0 2024-09-15T23:27:21.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364819fd40 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f363802fc40 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3638046840 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.787+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481a0220 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.788+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648107e70 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.789+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3638030b30 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.790+0000 7f362ffff640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 0x7f36300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.790+0000 7f36467fc640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 0x7f36300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.790+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5582+0+0 (secure 0 0 0) 0x7f36380f03e0 con 0x7f3648100ad0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.790+0000 7f36467fc640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 0x7f36300a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f364806b050 tx=0x7f363c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:27:21.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.794+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f36380453e0 con 0x7f3648100ad0 2024-09-15T23:27:21.857 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:27:21.534+0000 7f4de153a640 -1 osd.8 0 waiting for initial osdmap 2024-09-15T23:27:21.857 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:27:21.543+0000 7f4dd935a640 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:27:21.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:21.972+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3648062630 con 0x7f36300a3240 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:21.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: osdmap e57: 9 total, 8 up, 9 in 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:21.975 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:21 smithi077 ceph-mon[30968]: from='osd.8 ' entity='osd.8' 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: osdmap e57: 9 total, 8 up, 9 in 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:21 smithi155 ceph-mon[35631]: from='osd.8 ' entity='osd.8' 2024-09-15T23:27:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:27:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: osdmap e56: 9 total, 8 up, 9 in 2024-09-15T23:27:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: osdmap e57: 9 total, 8 up, 9 in 2024-09-15T23:27:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.217 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:21 smithi159 ceph-mon[35472]: from='osd.8 ' entity='osd.8' 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi159 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:22.959 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:22.960 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:22.960 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] boot 2024-09-15T23:27:22.960 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:27:22.960 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi159 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] boot 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:27:23.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi159 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi159 to 5696M 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:23.251 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:23.252 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: osd.8 [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] boot 2024-09-15T23:27:23.252 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: osdmap e58: 9 total, 9 up, 9 in 2024-09-15T23:27:23.252 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-15T23:27:23.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:23 smithi077 ceph-mon[30968]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:23.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:23 smithi077 ceph-mon[30968]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:27:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:23 smithi155 ceph-mon[35631]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:24.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:23 smithi155 ceph-mon[35631]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:27:24.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:23 smithi159 ceph-mon[35472]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi077:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:24.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:23 smithi159 ceph-mon[35472]: osdmap e59: 9 total, 9 up, 9 in 2024-09-15T23:27:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:24 smithi155 ceph-mon[35631]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:24 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]: dispatch 2024-09-15T23:27:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:24 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]': finished 2024-09-15T23:27:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:24 smithi155 ceph-mon[35631]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:27:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:24 smithi077 ceph-mon[30968]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]: dispatch 2024-09-15T23:27:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]': finished 2024-09-15T23:27:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:24 smithi077 ceph-mon[30968]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:27:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:24 smithi159 ceph-mon[35472]: pgmap v193: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]: dispatch 2024-09-15T23:27:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1170187205' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8c4453cd-f940-4154-a304-1c0d4631e409"}]': finished 2024-09-15T23:27:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:24 smithi159 ceph-mon[35472]: osdmap e60: 10 total, 9 up, 10 in 2024-09-15T23:27:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:25 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2966886440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:25 smithi077 ceph-mon[30968]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:27:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:25 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:25 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2966886440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:25 smithi159 ceph-mon[35472]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:27:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:25 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:25 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2966886440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:25 smithi155 ceph-mon[35631]: osdmap e61: 10 total, 9 up, 10 in 2024-09-15T23:27:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:25 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:27.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:26 smithi077 ceph-mon[30968]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:26 smithi077 ceph-mon[30968]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:27:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:26 smithi159 ceph-mon[35472]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:26 smithi159 ceph-mon[35472]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:27:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:26 smithi155 ceph-mon[35631]: pgmap v196: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:26 smithi155 ceph-mon[35631]: osdmap e62: 10 total, 9 up, 10 in 2024-09-15T23:27:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:29.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:28 smithi077 ceph-mon[30968]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:28 smithi159 ceph-mon[35472]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:28 smithi155 ceph-mon[35631]: pgmap v198: 1 pgs: 1 remapped+peering; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:30.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:30 smithi077 ceph-mon[30968]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:27:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:30 smithi159 ceph-mon[35472]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:27:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:30 smithi155 ceph-mon[35631]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:27:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:32 smithi077 ceph-mon[30968]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T23:27:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:32 smithi159 ceph-mon[35472]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T23:27:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:32 smithi155 ceph-mon[35631]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-09-15T23:27:34.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:27:34.040 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:27:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:34.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-15T23:27:34.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:34 smithi077 ceph-mon[30968]: Deploying daemon osd.9 on smithi077 2024-09-15T23:27:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:34 smithi077 ceph-mon[30968]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T23:27:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:34 smithi159 ceph-mon[35472]: Deploying daemon osd.9 on smithi077 2024-09-15T23:27:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:34 smithi159 ceph-mon[35472]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T23:27:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:34 smithi155 ceph-mon[35631]: Deploying daemon osd.9 on smithi077 2024-09-15T23:27:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:34 smithi155 ceph-mon[35631]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-09-15T23:27:37.090 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:36 smithi077 ceph-mon[30968]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T23:27:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:36 smithi159 ceph-mon[35472]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T23:27:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:36 smithi155 ceph-mon[35631]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-15T23:27:39.212 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:38 smithi077 ceph-mon[30968]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-15T23:27:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:38 smithi159 ceph-mon[35472]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-15T23:27:39.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:38 smithi155 ceph-mon[35631]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-15T23:27:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:40.237 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:40.237 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:40.237 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:40.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:40.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:40.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:41.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:40 smithi077 ceph-mon[30968]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:27:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:40 smithi159 ceph-mon[35472]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:27:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:40 smithi155 ceph-mon[35631]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:42 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.321 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:43.321 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:43.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:43.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:42 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.359+0000 7f362ffff640 1 -- 172.21.15.77:0/2732867889 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3648062630 con 0x7f36300a3240 2024-09-15T23:27:43.361 INFO:teuthology.orchestra.run.smithi077.stdout:Created osd(s) 9 on host 'smithi077' 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 msgr2=0x7f36300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 0x7f36300a5700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f364806b050 tx=0x7f363c00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 msgr2=0x7f364806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3638004af0 tx=0x7f3638031ee0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 shutdown_connections 2024-09-15T23:27:43.363 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36300a3240 0x7f36300a5700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3648102690 0x7f364819f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3648101cd0 0x7f364819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 --2- 172.21.15.77:0/2732867889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3648100ad0 0x7f364806aad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 >> 172.21.15.77:0/2732867889 conn(0x7f36480fc280 msgr2=0x7f3648105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 shutdown_connections 2024-09-15T23:27:43.364 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:27:43.362+0000 7f364d5ac640 1 -- 172.21.15.77:0/2732867889 wait complete. 2024-09-15T23:27:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:43.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:43.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:42 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:43 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:43.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:43 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.918 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:43 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:43.944 DEBUG:teuthology.orchestra.run.smithi077:osd.9> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.9.service 2024-09-15T23:27:43.947 INFO:tasks.cephadm:Deploying osd.10 on smithi155 with /dev/vg_nvme/lv_1... 2024-09-15T23:27:43.947 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:27:44.203 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:27:44.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:43 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:44.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:43 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:44.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:43 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:44.324 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:43 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:27:44.324 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:43 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:44.324 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:43 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:44 smithi159 ceph-mon[35472]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:45.276 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:44 smithi077 ceph-mon[30968]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:45.336 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:44 smithi155 ceph-mon[35631]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:45.583 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:27:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:27:45.377+0000 7fb3339a8640 -1 osd.9 0 log_to_monitors true 2024-09-15T23:27:46.054 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:45 smithi155 ceph-mon[35631]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:27:46.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:45 smithi159 ceph-mon[35472]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:27:46.255 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:45 smithi077 ceph-mon[30968]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-15T23:27:46.789 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-15T23:27:46.815 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_1 2024-09-15T23:27:47.068 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.b/config 2024-09-15T23:27:47.077 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:27:46.910+0000 7fb32f92b640 -1 osd.9 0 waiting for initial osdmap 2024-09-15T23:27:47.077 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:27:46.925+0000 7fb32b753640 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:27:47.077 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-mon[30968]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:47.077 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-mon[30968]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:27:47.078 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-mon[30968]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T23:27:47.078 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-mon[30968]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:27:47.078 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:46 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:46 smithi155 ceph-mon[35631]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:46 smithi155 ceph-mon[35631]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:27:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:46 smithi155 ceph-mon[35631]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T23:27:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:46 smithi155 ceph-mon[35631]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:27:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:46 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:47.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:46 smithi159 ceph-mon[35472]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:46 smithi159 ceph-mon[35472]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-15T23:27:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:46 smithi159 ceph-mon[35472]: osdmap e63: 10 total, 9 up, 10 in 2024-09-15T23:27:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:46 smithi159 ceph-mon[35472]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]: dispatch 2024-09-15T23:27:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:46 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:47.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.563+0000 7f18898b4640 1 -- 172.21.15.155:0/336405150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884101c00 msgr2=0x7f1884102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:47.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.563+0000 7f18898b4640 1 --2- 172.21.15.155:0/336405150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884101c00 0x7f1884102000 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1874009900 tx=0x7f187402a410 comp rx=0 tx=0).stop 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- 172.21.15.155:0/336405150 shutdown_connections 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- 172.21.15.155:0/336405150 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f18841037c0 0x7f188410a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- 172.21.15.155:0/336405150 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1884102e00 0x7f1884103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- 172.21.15.155:0/336405150 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884101c00 0x7f1884102000 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- 172.21.15.155:0/336405150 >> 172.21.15.155:0/336405150 conn(0x7f18840fd390 msgr2=0x7f18840ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- 172.21.15.155:0/336405150 shutdown_connections 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- 172.21.15.155:0/336405150 wait complete. 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 Processor -- start 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- start start 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 0x7f1884075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18841037c0 0x7f1884074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:47.591 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f188410d8d0 con 0x7f1884101c00 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f188410d750 con 0x7f1884102e00 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.564+0000 7f18898b4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f188410da50 con 0x7f18841037c0 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:51620/0 (socket says 172.21.15.155:51620) 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 -- 172.21.15.155:0/2047347749 learned_addr learned my addr 172.21.15.155:0/2047347749 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f1882ffd640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 0x7f1884075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18837fe640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18841037c0 0x7f1884074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 -- 172.21.15.155:0/2047347749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18841037c0 msgr2=0x7f1884074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:47.592 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18841037c0 0x7f1884074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 -- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 msgr2=0x7f1884075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 0x7f1884075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 -- 172.21.15.155:0/2047347749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18840753e0 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f1882ffd640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 0x7f1884075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f187a7fc640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f186c00d770 tx=0x7f186c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c017070 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f186c005500 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18841a20b0 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186c004e00 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.565+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18841a2570 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.566+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1884108ff0 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.567+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f186c004fa0 con 0x7f1884102e00 2024-09-15T23:27:47.593 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.568+0000 7f18888b2640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 0x7f18700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:27:47.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.568+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5981+0+0 (secure 0 0 0) 0x7f186c0cea50 con 0x7f1884102e00 2024-09-15T23:27:47.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.568+0000 7f1882ffd640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 0x7f18700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:27:47.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.569+0000 7f1882ffd640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 0x7f18700a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f187402aa00 tx=0x7f1874000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:27:47.594 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.572+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f186c09c090 con 0x7f1884102e00 2024-09-15T23:27:47.750 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:27:47.749+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1884062630 con 0x7f18700a3240 2024-09-15T23:27:48.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:27:48.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: osdmap e64: 10 total, 9 up, 10 in 2024-09-15T23:27:48.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:48.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:48.116 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:27:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: osdmap e64: 10 total, 9 up, 10 in 2024-09-15T23:27:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:48.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi077", "root=default"]}]': finished 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: osdmap e64: 10 total, 9 up, 10 in 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:27:48.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:27:49.185 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi077 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] boot 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T23:27:49.186 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:48 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi077 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] boot 2024-09-15T23:27:49.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T23:27:49.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:48 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi077 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi077 to 4272M 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: from='client.24314 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:27:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-09-15T23:27:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: osd.9 [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] boot 2024-09-15T23:27:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: osdmap e65: 10 total, 10 up, 10 in 2024-09-15T23:27:49.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:48 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-15T23:27:50.460 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:50 smithi155 ceph-mon[35631]: osdmap e66: 10 total, 10 up, 10 in 2024-09-15T23:27:50.460 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:50 smithi155 ceph-mon[35631]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:50.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:50 smithi159 ceph-mon[35472]: osdmap e66: 10 total, 10 up, 10 in 2024-09-15T23:27:50.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:50 smithi159 ceph-mon[35472]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:50.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:50 smithi077 ceph-mon[30968]: osdmap e66: 10 total, 10 up, 10 in 2024-09-15T23:27:50.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:50 smithi077 ceph-mon[30968]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/2925770486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]': finished 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:27:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:51 smithi159 ceph-mon[35472]: from='client.? 172.21.15.155:0/1530020978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/2925770486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]': finished 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:27:51.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:51 smithi155 ceph-mon[35631]: from='client.? 172.21.15.155:0/1530020978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/2925770486' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]: dispatch 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2041bfe6-5aff-493b-be41-ece230318b08"}]': finished 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: osdmap e67: 11 total, 10 up, 11 in 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:27:51.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:51 smithi077 ceph-mon[30968]: from='client.? 172.21.15.155:0/1530020978' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:27:52.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:52 smithi159 ceph-mon[35472]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:52.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:52 smithi155 ceph-mon[35631]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:52.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:52 smithi077 ceph-mon[30968]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:55.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:54 smithi155 ceph-mon[35631]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:54 smithi077 ceph-mon[30968]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:54 smithi159 ceph-mon[35472]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:56.999 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:56 smithi155 ceph-mon[35631]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:57.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:56 smithi077 ceph-mon[30968]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:56 smithi159 ceph-mon[35472]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:59.048 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:58 smithi155 ceph-mon[35631]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:58 smithi077 ceph-mon[30968]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:27:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:58 smithi159 ceph-mon[35472]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:28:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:27:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:28:00.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:27:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-15T23:28:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:27:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:01.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:00 smithi155 ceph-mon[35631]: Deploying daemon osd.10 on smithi155 2024-09-15T23:28:01.101 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:00 smithi155 ceph-mon[35631]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:00 smithi077 ceph-mon[30968]: Deploying daemon osd.10 on smithi155 2024-09-15T23:28:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:00 smithi077 ceph-mon[30968]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:00 smithi159 ceph-mon[35472]: Deploying daemon osd.10 on smithi155 2024-09-15T23:28:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:00 smithi159 ceph-mon[35472]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:03.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:02 smithi155 ceph-mon[35631]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:03.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:02 smithi077 ceph-mon[30968]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:02 smithi159 ceph-mon[35472]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:05.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:04 smithi155 ceph-mon[35631]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:04 smithi077 ceph-mon[30968]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:05.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:04 smithi159 ceph-mon[35472]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:06.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:06.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:06.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:06.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:06.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:06.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:06.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:06.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:06.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:07.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:06 smithi155 ceph-mon[35631]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:06 smithi077 ceph-mon[30968]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:07.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:06 smithi159 ceph-mon[35472]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:08.587 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 10 on host 'smithi155' 2024-09-15T23:28:08.588 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.586+0000 7f18888b2640 1 -- 172.21.15.155:0/2047347749 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1884062630 con 0x7f18700a3240 2024-09-15T23:28:08.589 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 msgr2=0x7f18700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 0x7f18700a5700 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f187402aa00 tx=0x7f1874000bc0 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 msgr2=0x7f18840745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f186c00d770 tx=0x7f186c00dc30 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 shutdown_connections 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18700a3240 0x7f18700a5700 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f18841037c0 0x7f1884074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1884102e00 0x7f18840745e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 --2- 172.21.15.155:0/2047347749 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1884101c00 0x7f1884075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 >> 172.21.15.155:0/2047347749 conn(0x7f18840fd390 msgr2=0x7f18841061c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 shutdown_connections 2024-09-15T23:28:08.590 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-15T23:28:08.589+0000 7f18898b4640 1 -- 172.21.15.155:0/2047347749 wait complete. 2024-09-15T23:28:09.182 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:09.182 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.183 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:08 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.209 DEBUG:teuthology.orchestra.run.smithi155:osd.10> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.10.service 2024-09-15T23:28:09.212 INFO:tasks.cephadm:Deploying osd.11 on smithi159 with /dev/vg_nvme/lv_1... 2024-09-15T23:28:09.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:09.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:08 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:09.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:09.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.385 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:08 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:09.471 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:28:11.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:10 smithi155 ceph-mon[35631]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:11.144 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:10 smithi159 ceph-mon[35472]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:11.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:10 smithi077 ceph-mon[30968]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:11.453 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:28:11 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:28:11.131+0000 7f129e407640 -1 osd.10 0 log_to_monitors true 2024-09-15T23:28:11.924 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:11 smithi159 ceph-mon[35472]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:11.924 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:11 smithi159 ceph-mon[35472]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:12.323 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:11 smithi155 ceph-mon[35631]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:12.323 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:11 smithi155 ceph-mon[35631]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:12.328 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-15T23:28:12.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi159:vg_nvme/lv_1 2024-09-15T23:28:12.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:11 smithi077 ceph-mon[30968]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:12.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:11 smithi077 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-15T23:28:12.608 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.038 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:13.039 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 -- 172.21.15.159:0/754047783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf0101c10 msgr2=0x7facf0102010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 --2- 172.21.15.159:0/754047783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf0101c10 0x7facf0102010 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7facec009900 tx=0x7facec02a410 comp rx=0 tx=0).stop 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 -- 172.21.15.159:0/754047783 shutdown_connections 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 --2- 172.21.15.159:0/754047783 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf01037d0 0x7facf010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 --2- 172.21.15.159:0/754047783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 0x7facf0103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 --2- 172.21.15.159:0/754047783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf0101c10 0x7facf0102010 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:13.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 -- 172.21.15.159:0/754047783 >> 172.21.15.159:0/754047783 conn(0x7facf00fd3c0 msgr2=0x7facf00ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 -- 172.21.15.159:0/754047783 shutdown_connections 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.121+0000 7facf745f640 1 -- 172.21.15.159:0/754047783 wait complete. 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 Processor -- start 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 -- start start 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 0x7facf0075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 0x7facf00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7facf010d910 con 0x7facf0101c10 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7facf010d790 con 0x7facf0102e10 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf745f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7facf010da90 con 0x7facf01037d0 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46386/0 (socket says 172.21.15.159:46386) 2024-09-15T23:28:13.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 -- 172.21.15.159:0/3773879385 learned_addr learned my addr 172.21.15.159:0/3773879385 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf49fa640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 0x7facf00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf51fb640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 0x7facf0075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 -- 172.21.15.159:0/3773879385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 msgr2=0x7facf00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 0x7facf00745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 -- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 msgr2=0x7facf0075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 0x7facf0075f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 -- 172.21.15.159:0/3773879385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf00753e0 con 0x7facf01037d0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf51fb640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 0x7facf0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.122+0000 7facf59fc640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7face800b970 tx=0x7face800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.123+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8019070 con 0x7facf01037d0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.123+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7face800cb40 con 0x7facf01037d0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.123+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facf01a2130 con 0x7facf01037d0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.123+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7face8007650 con 0x7facf01037d0 2024-09-15T23:28:13.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.123+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facf01a2670 con 0x7facf01037d0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.124+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facf0102010 con 0x7facf01037d0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.125+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7face801c070 con 0x7facf01037d0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.125+0000 7face67fc640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.126+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6414+0+0 (secure 0 0 0) 0x7face80ce780 con 0x7facf01037d0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.126+0000 7facf51fb640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.126+0000 7facf51fb640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 0x7facdc0a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7facec006010 tx=0x7facec032dd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:13.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.129+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7face809b5c0 con 0x7facf01037d0 2024-09-15T23:28:13.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:13.305+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7facf0062630 con 0x7facdc0a3240 2024-09-15T23:28:13.364 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:28:12.903+0000 7f129a38a640 -1 osd.10 0 waiting for initial osdmap 2024-09-15T23:28:13.364 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:28:12.914+0000 7f12961b2640 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:28:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:28:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:13.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: osdmap e68: 11 total, 10 up, 11 in 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-15T23:28:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:13.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:13.991 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi155 2024-09-15T23:28:13.991 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-15T23:28:13.991 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:28:13.992 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: osdmap e69: 11 total, 10 up, 11 in 2024-09-15T23:28:13.992 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:13.992 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:13.992 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:28:13.992 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:28:13.993 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:13.993 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] boot 2024-09-15T23:28:13.993 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:28:13.993 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi155 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: osdmap e69: 11 total, 10 up, 11 in 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:28:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:28:14.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:14.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] boot 2024-09-15T23:28:14.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:28:14.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi155 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: osdmap e69: 11 total, 10 up, 11 in 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: osd.10 [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] boot 2024-09-15T23:28:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: osdmap e70: 11 total, 11 up, 11 in 2024-09-15T23:28:14.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-15T23:28:15.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:14 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:28:15.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:14 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:28:15.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:14 smithi159 ceph-mon[35472]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:15.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:14 smithi159 ceph-mon[35472]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:15.097 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:14 smithi159 ceph-mon[35472]: osdmap e71: 11 total, 11 up, 11 in 2024-09-15T23:28:15.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:14 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:28:15.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:14 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:28:15.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:14 smithi155 ceph-mon[35631]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:15.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:14 smithi155 ceph-mon[35631]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:15.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:14 smithi155 ceph-mon[35631]: osdmap e71: 11 total, 11 up, 11 in 2024-09-15T23:28:15.387 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:14 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:28:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:14 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:28:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:14 smithi077 ceph-mon[30968]: from='client.24367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:14 smithi077 ceph-mon[30968]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 305 MiB used, 894 GiB / 894 GiB avail 2024-09-15T23:28:15.388 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:14 smithi077 ceph-mon[30968]: osdmap e71: 11 total, 11 up, 11 in 2024-09-15T23:28:16.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:15 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/4289276932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:15 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:15 smithi159 ceph-mon[35472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]': finished 2024-09-15T23:28:16.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:15 smithi159 ceph-mon[35472]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:28:16.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:15 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:16.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:15 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/4289276932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:15 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:15 smithi155 ceph-mon[35631]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]': finished 2024-09-15T23:28:16.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:15 smithi155 ceph-mon[35631]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:28:16.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:15 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:16.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:15 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/4289276932' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:15 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]: dispatch 2024-09-15T23:28:16.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:15 smithi077 ceph-mon[30968]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d887c196-e9e9-4265-99c6-63bf61151831"}]': finished 2024-09-15T23:28:16.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:15 smithi077 ceph-mon[30968]: osdmap e72: 12 total, 11 up, 12 in 2024-09-15T23:28:16.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:15 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:16 smithi159 ceph-mon[35472]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:16 smithi159 ceph-mon[35472]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:28:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:16 smithi159 ceph-mon[35472]: from='client.? 172.21.15.159:0/3902839205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:28:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:16 smithi155 ceph-mon[35631]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:16 smithi155 ceph-mon[35631]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:28:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:16 smithi155 ceph-mon[35631]: from='client.? 172.21.15.159:0/3902839205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:28:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:16 smithi077 ceph-mon[30968]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:16 smithi077 ceph-mon[30968]: osdmap e73: 12 total, 11 up, 12 in 2024-09-15T23:28:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:16 smithi077 ceph-mon[30968]: from='client.? 172.21.15.159:0/3902839205' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-15T23:28:18.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:18 smithi155 ceph-mon[35631]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:28:18.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:18.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:18 smithi155 ceph-mon[35631]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:18.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:18 smithi077 ceph-mon[30968]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:28:18.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:18.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:18 smithi077 ceph-mon[30968]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:18.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:18 smithi159 ceph-mon[35472]: osdmap e74: 12 total, 11 up, 12 in 2024-09-15T23:28:18.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:18.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:18 smithi159 ceph-mon[35472]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 332 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:20.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:20 smithi159 ceph-mon[35472]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T23:28:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:20 smithi155 ceph-mon[35631]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T23:28:21.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:20 smithi077 ceph-mon[30968]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 118 KiB/s, 0 objects/s recovering 2024-09-15T23:28:23.098 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:22 smithi159 ceph-mon[35472]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:28:23.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:22 smithi155 ceph-mon[35631]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:28:23.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:22 smithi077 ceph-mon[30968]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-15T23:28:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:24 smithi159 ceph-mon[35472]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:28:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:28:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:24 smithi155 ceph-mon[35631]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:28:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:28:25.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:24 smithi077 ceph-mon[30968]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-15T23:28:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-15T23:28:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:26.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:25 smithi155 ceph-mon[35631]: Deploying daemon osd.11 on smithi159 2024-09-15T23:28:26.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:25 smithi077 ceph-mon[30968]: Deploying daemon osd.11 on smithi159 2024-09-15T23:28:26.137 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:25 smithi159 ceph-mon[35472]: Deploying daemon osd.11 on smithi159 2024-09-15T23:28:27.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:26 smithi155 ceph-mon[35631]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:28:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:26 smithi077 ceph-mon[30968]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:28:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:26 smithi159 ceph-mon[35472]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-15T23:28:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:28 smithi155 ceph-mon[35631]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:28:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:28 smithi077 ceph-mon[30968]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:28:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:28 smithi159 ceph-mon[35472]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 56 KiB/s, 0 objects/s recovering 2024-09-15T23:28:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:30 smithi155 ceph-mon[35631]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:28:31.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:30 smithi077 ceph-mon[30968]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:28:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:30 smithi159 ceph-mon[35472]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-15T23:28:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:31 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:32.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:31 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:31 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:32 smithi155 ceph-mon[35631]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:33.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:32 smithi077 ceph-mon[30968]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:33.161 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:32 smithi159 ceph-mon[35472]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:34.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.330+0000 7face67fc640 1 -- 172.21.15.159:0/3773879385 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7facf0062630 con 0x7facdc0a3240 2024-09-15T23:28:34.332 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 11 on host 'smithi159' 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.332+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 msgr2=0x7facdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.332+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 0x7facdc0a5700 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7facec006010 tx=0x7facec032dd0 comp rx=0 tx=0).stop 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.332+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 msgr2=0x7facf0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.332+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7face800b970 tx=0x7face800be30 comp rx=0 tx=0).stop 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 shutdown_connections 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facdc0a3240 0x7facdc0a5700 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7facf01037d0 0x7facf0074b20 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:34.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7facf0102e10 0x7facf00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:34.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 --2- 172.21.15.159:0/3773879385 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7facf0101c10 0x7facf0075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:34.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 >> 172.21.15.159:0/3773879385 conn(0x7facf00fd3c0 msgr2=0x7facf0106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:34.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 shutdown_connections 2024-09-15T23:28:34.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:34.333+0000 7facf745f640 1 -- 172.21.15.159:0/3773879385 wait complete. 2024-09-15T23:28:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:34 smithi155 ceph-mon[35631]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:34 smithi077 ceph-mon[30968]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:34 smithi159 ceph-mon[35472]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:35.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.183 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:35.210 DEBUG:teuthology.orchestra.run.smithi159:osd.11> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.11.service 2024-09-15T23:28:35.213 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-15T23:28:35.213 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:28:35.473 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:35.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.950+0000 7eff2e5c2640 1 -- 172.21.15.77:0/2356804295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28104f90 msgr2=0x7eff28107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:35.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.950+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/2356804295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28104f90 0x7eff28107380 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009900 tx=0x7eff1c02a410 comp rx=0 tx=0).stop 2024-09-15T23:28:35.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 -- 172.21.15.77:0/2356804295 shutdown_connections 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/2356804295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff281078c0 0x7eff28109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/2356804295 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28104f90 0x7eff28107380 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/2356804295 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff28102660 0x7eff28104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 -- 172.21.15.77:0/2356804295 >> 172.21.15.77:0/2356804295 conn(0x7eff280fc280 msgr2=0x7eff280fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 -- 172.21.15.77:0/2356804295 shutdown_connections 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 -- 172.21.15.77:0/2356804295 wait complete. 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 Processor -- start 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.951+0000 7eff2e5c2640 1 -- start start 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff28104f90 0x7eff28198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff281078c0 0x7eff2819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810d920 con 0x7eff28102660 2024-09-15T23:28:35.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810d7a0 con 0x7eff28104f90 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7eff2810daa0 con 0x7eff281078c0 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:49142/0 (socket says 172.21.15.77:49142) 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 -- 172.21.15.77:0/826514677 learned_addr learned my addr 172.21.15.77:0/826514677 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2cb5f640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff281078c0 0x7eff2819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 -- 172.21.15.77:0/826514677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff281078c0 msgr2=0x7eff2819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff281078c0 0x7eff2819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 -- 172.21.15.77:0/826514677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff28104f90 msgr2=0x7eff28198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff28104f90 0x7eff28198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 -- 172.21.15.77:0/826514677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2819fc00 con 0x7eff28102660 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff27fff640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d770 tx=0x7eff1800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:35.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18017070 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7eff18005500 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2819fef0 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18004e00 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.952+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff281a0420 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.953+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff280fdd70 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.955+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7eff18004fa0 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.955+0000 7eff257fa640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 0x7eff100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.955+0000 7eff277fe640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 0x7eff100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.956+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 6809+0+0 (secure 0 0 0) 0x7eff180cf090 con 0x7eff28102660 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.956+0000 7eff277fe640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 0x7eff100a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009230 tx=0x7eff1c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:35.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:35.959+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7eff1809c410 con 0x7eff28102660 2024-09-15T23:28:36.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.125+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7eff2802da10 con 0x7eff28102660 2024-09-15T23:28:36.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.125+0000 7eff257fa640 1 -- 172.21.15.77:0/826514677 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) ==== 74+0+133 (secure 0 0 0) 0x7eff1809bd10 con 0x7eff28102660 2024-09-15T23:28:36.135 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:36.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 msgr2=0x7eff100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:36.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 0x7eff100a57b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff1c009230 tx=0x7eff1c031400 comp rx=0 tx=0).stop 2024-09-15T23:28:36.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 msgr2=0x7eff28197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7eff1800d770 tx=0x7eff1800dc30 comp rx=0 tx=0).stop 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 shutdown_connections 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7eff100a32f0 0x7eff100a57b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff281078c0 0x7eff2819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7eff28104f90 0x7eff28198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 --2- 172.21.15.77:0/826514677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7eff28102660 0x7eff28197fd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 >> 172.21.15.77:0/826514677 conn(0x7eff280fc280 msgr2=0x7eff28102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 shutdown_connections 2024-09-15T23:28:36.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:36.127+0000 7eff2e5c2640 1 -- 172.21.15.77:0/826514677 wait complete. 2024-09-15T23:28:36.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:36 smithi159 ceph-mon[35472]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:36.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:36 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/826514677' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:36.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:36 smithi077 ceph-mon[30968]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:36.762 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:36 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/826514677' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:36 smithi155 ceph-mon[35631]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:36.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:36 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/826514677' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:36.921 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1726442893,"num_in_osds":12,"osd_in_since":1726442895,"num_remapped_pgs":0} 2024-09-15T23:28:37.126 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:28:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:28:36.872+0000 7ffbd6f8d640 -1 osd.11 0 log_to_monitors true 2024-09-15T23:28:37.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:37 smithi077 ceph-mon[30968]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:37 smithi077 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:37 smithi159 ceph-mon[35472]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:37 smithi159 ceph-mon[35472]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:37 smithi155 ceph-mon[35631]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:37 smithi155 ceph-mon[35631]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-15T23:28:37.923 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:28:38.171 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:38.564 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:28:38.564 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T23:28:38.564 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:38.564 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.564 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.565 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:38 smithi077 ceph-mon[30968]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:38.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 -- 172.21.15.77:0/2507330703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 msgr2=0x7f0194108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:38.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2507330703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f0194108f60 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f018c009ca0 tx=0x7f018c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 -- 172.21.15.77:0/2507330703 shutdown_connections 2024-09-15T23:28:38.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2507330703 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f0194108f60 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2507330703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 0x7f0194102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2507330703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 -- 172.21.15.77:0/2507330703 >> 172.21.15.77:0/2507330703 conn(0x7f01940fc2a0 msgr2=0x7f01940fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 -- 172.21.15.77:0/2507330703 shutdown_connections 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.642+0000 7f019c4d9640 1 -- 172.21.15.77:0/2507330703 wait complete. 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 Processor -- start 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 -- start start 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 0x7f01941983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:38.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f019410c770 con 0x7f01941026d0 2024-09-15T23:28:38.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f019410c5f0 con 0x7f0194100b10 2024-09-15T23:28:38.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019c4d9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f019410c8f0 con 0x7f0194101d10 2024-09-15T23:28:38.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019aa76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:38.649 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019aa76640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56526/0 (socket says 172.21.15.77:56526) 2024-09-15T23:28:38.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f019aa76640 1 -- 172.21.15.77:0/2548314685 learned_addr learned my addr 172.21.15.77:0/2548314685 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.643+0000 7f0199a74640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 0x7f01941983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019a275640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 -- 172.21.15.77:0/2548314685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 msgr2=0x7f01941983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 0x7f01941983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 -- 172.21.15.77:0/2548314685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 msgr2=0x7f0194197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 -- 172.21.15.77:0/2548314685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f019419fae0 con 0x7f01941026d0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019a275640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019aa76640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f018c005e30 tx=0x7f018c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c003c30 con 0x7f01941026d0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f018c003dd0 con 0x7f01941026d0 2024-09-15T23:28:38.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019419fd70 con 0x7f01941026d0 2024-09-15T23:28:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f018c02fde0 con 0x7f01941026d0 2024-09-15T23:28:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.644+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01941a0250 con 0x7f01941026d0 2024-09-15T23:28:38.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.645+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0194108a50 con 0x7f01941026d0 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.647+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f018c004050 con 0x7f01941026d0 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.648+0000 7f018b7fe640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 0x7f01800a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.648+0000 7f019a275640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 0x7f01800a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.648+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 6847+0+0 (secure 0 0 0) 0x7f018c0f07f0 con 0x7f01941026d0 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.648+0000 7f019a275640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 0x7f01800a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0190005d00 tx=0x7f0190005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:38.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.651+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f018c0bdad0 con 0x7f01941026d0 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:38 smithi159 ceph-mon[35472]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:38.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.817+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f0194062df0 con 0x7f01941026d0 2024-09-15T23:28:38.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.818+0000 7f018b7fe640 1 -- 172.21.15.77:0/2548314685 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) ==== 74+0+133 (secure 0 0 0) 0x7f018c0bd3d0 con 0x7f01941026d0 2024-09-15T23:28:38.819 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:38.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 msgr2=0x7f01800a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:38.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 0x7f01800a5730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0190005d00 tx=0x7f0190005c90 comp rx=0 tx=0).stop 2024-09-15T23:28:38.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 msgr2=0x7f019419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:38.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f018c005e30 tx=0x7f018c031ee0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 shutdown_connections 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01800a3270 0x7f01800a5730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01941026d0 0x7f019419f470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0194101d10 0x7f01941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 --2- 172.21.15.77:0/2548314685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0194100b10 0x7f0194197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 >> 172.21.15.77:0/2548314685 conn(0x7f01940fc2a0 msgr2=0x7f01940fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 shutdown_connections 2024-09-15T23:28:38.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:38.821+0000 7f019c4d9640 1 -- 172.21.15.77:0/2548314685 wait complete. 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: osdmap e75: 12 total, 11 up, 12 in 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: from='osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-09-15T23:28:38.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:38 smithi155 ceph-mon[35631]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:39.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:28:39.174+0000 7ffbd3724640 -1 osd.11 0 waiting for initial osdmap 2024-09-15T23:28:39.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:28:39.187+0000 7ffbcad30640 -1 osd.11 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T23:28:39.495 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1726442893,"num_in_osds":12,"osd_in_since":1726442895,"num_remapped_pgs":0} 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: osdmap e76: 12 total, 11 up, 12 in 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: Detected new or changed devices on smithi159 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2548314685' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.634 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.635 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:39 smithi077 ceph-mon[30968]: from='osd.11 ' entity='osd.11' 2024-09-15T23:28:39.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:28:39.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: osdmap e76: 12 total, 11 up, 12 in 2024-09-15T23:28:39.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: Detected new or changed devices on smithi159 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2548314685' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.866 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:39 smithi155 ceph-mon[35631]: from='osd.11 ' entity='osd.11' 2024-09-15T23:28:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-09-15T23:28:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: osdmap e76: 12 total, 11 up, 12 in 2024-09-15T23:28:39.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: Detected new or changed devices on smithi159 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2548314685' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: Adjusting osd_memory_target on smithi159 to 4272M 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:39.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:39.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:39.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:39.967 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:39 smithi159 ceph-mon[35472]: from='osd.11 ' entity='osd.11' 2024-09-15T23:28:40.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-15T23:28:40.749 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: purged_snaps scrub starts 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: purged_snaps scrub ok 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] boot 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:28:40.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:40 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:40.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: purged_snaps scrub starts 2024-09-15T23:28:40.869 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: purged_snaps scrub ok 2024-09-15T23:28:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] boot 2024-09-15T23:28:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:28:40.870 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:40 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: purged_snaps scrub starts 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: purged_snaps scrub ok 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: osd.11 [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] boot 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: osdmap e77: 12 total, 12 up, 12 in 2024-09-15T23:28:40.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:40 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 -- 172.21.15.77:0/1743671138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 msgr2=0x7feeb0104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1743671138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0104a90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feeac009900 tx=0x7feeac02a410 comp rx=0 tx=0).stop 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 -- 172.21.15.77:0/1743671138 shutdown_connections 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1743671138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0107900 0x7feeb0109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1743671138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb0104fd0 0x7feeb01073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1743671138 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0104a90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 -- 172.21.15.77:0/1743671138 >> 172.21.15.77:0/1743671138 conn(0x7feeb00fc2a0 msgr2=0x7feeb00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 -- 172.21.15.77:0/1743671138 shutdown_connections 2024-09-15T23:28:41.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.316+0000 7feeb7acb640 1 -- 172.21.15.77:0/1743671138 wait complete. 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 Processor -- start 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 -- start start 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 0x7feeb01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb0107900 0x7feeb019f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feeb010d940 con 0x7feeb01026a0 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feeb010d7c0 con 0x7feeb0104fd0 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb7acb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feeb010dac0 con 0x7feeb0107900 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56544/0 (socket says 172.21.15.77:56544) 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 -- 172.21.15.77:0/1019232306 learned_addr learned my addr 172.21.15.77:0/1019232306 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:41.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5066640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 0x7feeb01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:41.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 -- 172.21.15.77:0/1019232306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb0107900 msgr2=0x7feeb019f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:41.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb0107900 0x7feeb019f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 -- 172.21.15.77:0/1019232306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 msgr2=0x7feeb01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:41.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 0x7feeb01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5867640 1 -- 172.21.15.77:0/1019232306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb019fba0 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.317+0000 7feeb5066640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 0x7feeb01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feeb5867640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feeac009230 tx=0x7feeac004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac03f030 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feeac003ce0 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb019fe30 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeac035070 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.318+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb01a0300 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.319+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb00fdd90 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.320+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7feeac042030 con 0x7feeb01026a0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.321+0000 7feea6ffd640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 0x7fee9c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.321+0000 7feeb5066640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 0x7fee9c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:41.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.321+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7127+0+0 (secure 0 0 0) 0x7feeac0efc40 con 0x7feeb01026a0 2024-09-15T23:28:41.325 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.321+0000 7feeb5066640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 0x7fee9c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:41.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.325+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feeac0bce00 con 0x7feeb01026a0 2024-09-15T23:28:41.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.496+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7feeb0062df0 con 0x7feeb01026a0 2024-09-15T23:28:41.498 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.496+0000 7feea6ffd640 1 -- 172.21.15.77:0/1019232306 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) ==== 74+0+133 (secure 0 0 0) 0x7feeac0bc700 con 0x7feeb01026a0 2024-09-15T23:28:41.498 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 msgr2=0x7fee9c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 0x7fee9c0a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7feea0005fd0 tx=0x7feea0005ea0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 msgr2=0x7feeb0197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:41.499 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feeac009230 tx=0x7feeac004430 comp rx=0 tx=0).stop 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 shutdown_connections 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee9c0a3270 0x7fee9c0a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feeb0107900 0x7feeb019f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feeb0104fd0 0x7feeb01984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 --2- 172.21.15.77:0/1019232306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feeb01026a0 0x7feeb0197f70 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 >> 172.21.15.77:0/1019232306 conn(0x7feeb00fc2a0 msgr2=0x7feeb0103040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 shutdown_connections 2024-09-15T23:28:41.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:41.498+0000 7feeb7acb640 1 -- 172.21.15.77:0/1019232306 wait complete. 2024-09-15T23:28:42.146 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":78,"num_osds":12,"num_up_osds":12,"osd_up_since":1726442920,"num_in_osds":12,"osd_in_since":1726442895,"num_remapped_pgs":0} 2024-09-15T23:28:42.147 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:28:42.387 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:42.773 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:42 smithi077 ceph-mon[30968]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:28:42.773 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1019232306' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:42.773 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:42 smithi077 ceph-mon[30968]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:42.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:42 smithi155 ceph-mon[35631]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:28:42.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:42 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1019232306' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:42.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:42 smithi155 ceph-mon[35631]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 -- 172.21.15.77:0/2875568452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 msgr2=0x7face4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 --2- 172.21.15.77:0/2875568452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4101200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7facd4009900 tx=0x7facd402a480 comp rx=0 tx=0).stop 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 -- 172.21.15.77:0/2875568452 shutdown_connections 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 --2- 172.21.15.77:0/2875568452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102ef0 0x7face410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 --2- 172.21.15.77:0/2875568452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face4102570 0x7face41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 --2- 172.21.15.77:0/2875568452 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4101200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:42.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.851+0000 7face982a640 1 -- 172.21.15.77:0/2875568452 >> 172.21.15.77:0/2875568452 conn(0x7face40fc7d0 msgr2=0x7face40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- 172.21.15.77:0/2875568452 shutdown_connections 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- 172.21.15.77:0/2875568452 wait complete. 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 Processor -- start 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- start start 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102570 0x7face4197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face4102ef0 0x7face419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7face4111020 con 0x7face4100e20 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7face4110ea0 con 0x7face4102ef0 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.852+0000 7face982a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7face41111a0 con 0x7face4102570 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56558/0 (socket says 172.21.15.77:56558) 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 -- 172.21.15.77:0/646796993 learned_addr learned my addr 172.21.15.77:0/646796993 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:42.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face27fc640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102570 0x7face4197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 -- 172.21.15.77:0/646796993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102570 msgr2=0x7face4197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102570 0x7face4197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 -- 172.21.15.77:0/646796993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face4102ef0 msgr2=0x7face419be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face4102ef0 0x7face419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 -- 172.21.15.77:0/646796993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face419c530 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face2ffd640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd4006010 tx=0x7facd4003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd403f070 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face982a640 1 -- 172.21.15.77:0/646796993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face419c7c0 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facd4031e30 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd4035030 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.853+0000 7face982a640 1 -- 172.21.15.77:0/646796993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face41a4100 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.854+0000 7face982a640 1 -- 172.21.15.77:0/646796993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7face4101280 con 0x7face4100e20 2024-09-15T23:28:42.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.856+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7facd4042070 con 0x7face4100e20 2024-09-15T23:28:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.857+0000 7face8828640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 0x7faccc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.857+0000 7face27fc640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 0x7faccc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.857+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7facd40f0640 con 0x7face4100e20 2024-09-15T23:28:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.857+0000 7face27fc640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 0x7faccc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7face40ffea0 tx=0x7facd8009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:42.860+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7facd40bd760 con 0x7face4100e20 2024-09-15T23:28:42.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:42 smithi159 ceph-mon[35472]: osdmap e78: 12 total, 12 up, 12 in 2024-09-15T23:28:42.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:42 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1019232306' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-15T23:28:42.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:42 smithi159 ceph-mon[35472]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:43.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.027+0000 7face982a640 1 -- 172.21.15.77:0/646796993 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7face4109090 con 0x7face4100e20 2024-09-15T23:28:43.029 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.028+0000 7face8828640 1 -- 172.21.15.77:0/646796993 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) ==== 74+0+18485 (secure 0 0 0) 0x7facd40bd060 con 0x7face4100e20 2024-09-15T23:28:43.030 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:43.030 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":78,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:28:41.472749+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 msgr2=0x7faccc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 0x7faccc0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7face40ffea0 tx=0x7facd8009110 comp rx=0 tx=0).stop 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 msgr2=0x7face4197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7facd4006010 tx=0x7facd4003c80 comp rx=0 tx=0).stop 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 shutdown_connections 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faccc0a3240 0x7faccc0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:43.032 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7face4102ef0 0x7face419be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7face4102570 0x7face4197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 --2- 172.21.15.77:0/646796993 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7face4100e20 0x7face4197580 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 >> 172.21.15.77:0/646796993 conn(0x7face40fc7d0 msgr2=0x7face40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 shutdown_connections 2024-09-15T23:28:43.033 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:43.031+0000 7face982a640 1 -- 172.21.15.77:0/646796993 wait complete. 2024-09-15T23:28:43.753 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:43 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/646796993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:28:43.789 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:24:50.012656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T23:28:43.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-15T23:28:43.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:43 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/646796993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:28:43.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:43 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/646796993' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:28:44.038 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 -- 172.21.15.77:0/1206270281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c1027a0 msgr2=0x7f899c1067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1206270281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c1027a0 0x7f899c1067f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8990009900 tx=0x7f899002a410 comp rx=0 tx=0).stop 2024-09-15T23:28:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 -- 172.21.15.77:0/1206270281 shutdown_connections 2024-09-15T23:28:44.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1206270281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c106f20 0x7f899c10eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1206270281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c1027a0 0x7f899c1067f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1206270281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c101df0 0x7f899c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 -- 172.21.15.77:0/1206270281 >> 172.21.15.77:0/1206270281 conn(0x7f899c0fd8f0 msgr2=0x7f899c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 -- 172.21.15.77:0/1206270281 shutdown_connections 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.505+0000 7f89a1a78640 1 -- 172.21.15.77:0/1206270281 wait complete. 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.506+0000 7f89a1a78640 1 Processor -- start 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.506+0000 7f89a1a78640 1 -- start start 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c101df0 0x7f899c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c1027a0 0x7f899c1989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f899c111fa0 con 0x7f899c106f20 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f899c111e20 con 0x7f899c1027a0 2024-09-15T23:28:44.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f899c112120 con 0x7f899c101df0 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56582/0 (socket says 172.21.15.77:56582) 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 -- 172.21.15.77:0/1612381746 learned_addr learned my addr 172.21.15.77:0/1612381746 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899b7fe640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c101df0 0x7f899c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 -- 172.21.15.77:0/1612381746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c101df0 msgr2=0x7f899c1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899affd640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c1027a0 0x7f899c1989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c101df0 0x7f899c1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 -- 172.21.15.77:0/1612381746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c1027a0 msgr2=0x7f899c1989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c1027a0 0x7f899c1989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 -- 172.21.15.77:0/1612381746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899c19d460 con 0x7f899c106f20 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f899bfff640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:44.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8994011830 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8994016070 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899c19d750 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899400f2e0 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.507+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899c1a5030 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.508+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f899c1021d0 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.510+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f89940119d0 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.510+0000 7f8998ff9640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 0x7f89840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.510+0000 7f899b7fe640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 0x7f89840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.510+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f89940ceb50 con 0x7f899c106f20 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.511+0000 7f899b7fe640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 0x7f89840a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f898c005fd0 tx=0x7f898c009870 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:44.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.514+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f899409bd10 con 0x7f899c106f20 2024-09-15T23:28:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.680+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f899c02d7c0 con 0x7f899c106f20 2024-09-15T23:28:44.682 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:44 smithi077 ceph-mon[30968]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:44.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.681+0000 7f8998ff9640 1 -- 172.21.15.77:0/1612381746 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) ==== 93+0+10 (secure 0 0 0) 0x7f899409b610 con 0x7f899c106f20 2024-09-15T23:28:44.683 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-09-15T23:28:44.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 msgr2=0x7f89840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:44.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 0x7f89840a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f898c005fd0 tx=0x7f898c009870 comp rx=0 tx=0).stop 2024-09-15T23:28:44.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 msgr2=0x7f899c19cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:44.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8994009fd0 tx=0x7f899400b8e0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 shutdown_connections 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f89840a3240 0x7f89840a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f899c106f20 0x7f899c19cd80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f899c1027a0 0x7f899c1989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 --2- 172.21.15.77:0/1612381746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f899c101df0 0x7f899c1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 >> 172.21.15.77:0/1612381746 conn(0x7f899c0fd8f0 msgr2=0x7f899c0fed50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 shutdown_connections 2024-09-15T23:28:44.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:44.684+0000 7f89a1a78640 1 -- 172.21.15.77:0/1612381746 wait complete. 2024-09-15T23:28:44.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:44 smithi155 ceph-mon[35631]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:44.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:44 smithi159 ceph-mon[35472]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:45.423 INFO:tasks.cephadm:Adding mds.a on smithi077 2024-09-15T23:28:45.423 INFO:tasks.cephadm:Adding mds.d on smithi077 2024-09-15T23:28:45.423 INFO:tasks.cephadm:Adding mds.g on smithi077 2024-09-15T23:28:45.423 INFO:tasks.cephadm:Adding mds.j on smithi077 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.b on smithi155 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.e on smithi155 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.h on smithi155 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.k on smithi155 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.c on smithi159 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.f on smithi159 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.i on smithi159 2024-09-15T23:28:45.424 INFO:tasks.cephadm:Adding mds.l on smithi159 2024-09-15T23:28:45.424 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l' 2024-09-15T23:28:45.685 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.c/config 2024-09-15T23:28:45.714 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:45 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1612381746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:28:45.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:45 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1612381746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:28:45.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:45 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1612381746' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:28:46.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 -- 172.21.15.159:0/1310716865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000104fd0 msgr2=0x7f00001073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:46.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 --2- 172.21.15.159:0/1310716865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000104fd0 0x7f00001073c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efff0009900 tx=0x7efff002a410 comp rx=0 tx=0).stop 2024-09-15T23:28:46.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 -- 172.21.15.159:0/1310716865 shutdown_connections 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 --2- 172.21.15.159:0/1310716865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000107900 0x7f0000109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 --2- 172.21.15.159:0/1310716865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000104fd0 0x7f00001073c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 --2- 172.21.15.159:0/1310716865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 0x7f0000104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 -- 172.21.15.159:0/1310716865 >> 172.21.15.159:0/1310716865 conn(0x7f00000fc2a0 msgr2=0x7f00000fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 -- 172.21.15.159:0/1310716865 shutdown_connections 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.190+0000 7f0007760640 1 -- 172.21.15.159:0/1310716865 wait complete. 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 Processor -- start 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 -- start start 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 0x7f0000102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000104fd0 0x7f0000100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f000010d8a0 con 0x7f00001026a0 2024-09-15T23:28:46.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f000010d720 con 0x7f0000104fd0 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0007760640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f000010da20 con 0x7f0000107900 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0005cfd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0005cfd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55344/0 (socket says 172.21.15.159:55344) 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0005cfd640 1 -- 172.21.15.159:0/1183600519 learned_addr learned my addr 172.21.15.159:0/1183600519 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.191+0000 7f0004cfb640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000104fd0 0x7f0000100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f00054fc640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 0x7f0000102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 -- 172.21.15.159:0/1183600519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000104fd0 msgr2=0x7f0000100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000104fd0 0x7f0000100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 -- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 msgr2=0x7f0000102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 0x7f0000102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 -- 172.21.15.159:0/1183600519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00001010d0 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0005cfd640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efff800cad0 tx=0x7efff800ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff800ad60 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00001013c0 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efff8005020 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff800f6b0 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.192+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00001a6980 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.193+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00000fdd90 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.195+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efff8005560 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.196+0000 7efff67fc640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 0x7effec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.196+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7efff80cf3f0 con 0x7f0000107900 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.196+0000 7f00054fc640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 0x7effec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.197+0000 7f00054fc640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 0x7effec0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efffc00abe0 tx=0x7efffc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:46.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.201+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efff8014030 con 0x7f0000107900 2024-09-15T23:28:46.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.379+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}) -- 0x7f0000062730 con 0x7effec0a3240 2024-09-15T23:28:46.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.387+0000 7efff67fc640 1 -- 172.21.15.159:0/1183600519 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f0000062730 con 0x7effec0a3240 2024-09-15T23:28:46.388 INFO:teuthology.orchestra.run.smithi159.stdout:Scheduled mds.all update... 2024-09-15T23:28:46.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 msgr2=0x7effec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 0x7effec0a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efffc00abe0 tx=0x7efffc00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 msgr2=0x7f0000100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efff800cad0 tx=0x7efff800ced0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 shutdown_connections 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7effec0a3240 0x7effec0a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0000107900 0x7f0000100b90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0000104fd0 0x7f0000100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 --2- 172.21.15.159:0/1183600519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00001026a0 0x7f0000102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.389+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 >> 172.21.15.159:0/1183600519 conn(0x7f00000fc2a0 msgr2=0x7f0000102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.390+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 shutdown_connections 2024-09-15T23:28:46.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-15T23:28:46.390+0000 7f0007760640 1 -- 172.21.15.159:0/1183600519 wait complete. 2024-09-15T23:28:46.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:46 smithi159 ceph-mon[35472]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:46.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:46 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:46.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:46 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:46 smithi155 ceph-mon[35631]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:46 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:46.765 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:46 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:46.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:46 smithi077 ceph-mon[30968]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:46.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:46 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:46.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:46 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:28:47.126 DEBUG:teuthology.orchestra.run.smithi077:mds.a> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.a.service 2024-09-15T23:28:47.129 DEBUG:teuthology.orchestra.run.smithi077:mds.d> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.d.service 2024-09-15T23:28:47.172 DEBUG:teuthology.orchestra.run.smithi077:mds.g> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.g.service 2024-09-15T23:28:47.216 DEBUG:teuthology.orchestra.run.smithi077:mds.j> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.j.service 2024-09-15T23:28:47.261 DEBUG:teuthology.orchestra.run.smithi155:mds.b> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.b.service 2024-09-15T23:28:47.264 DEBUG:teuthology.orchestra.run.smithi155:mds.e> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.e.service 2024-09-15T23:28:47.307 DEBUG:teuthology.orchestra.run.smithi155:mds.h> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.h.service 2024-09-15T23:28:47.350 DEBUG:teuthology.orchestra.run.smithi155:mds.k> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.k.service 2024-09-15T23:28:47.393 DEBUG:teuthology.orchestra.run.smithi159:mds.c> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.c.service 2024-09-15T23:28:47.396 DEBUG:teuthology.orchestra.run.smithi159:mds.f> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.f.service 2024-09-15T23:28:47.439 DEBUG:teuthology.orchestra.run.smithi159:mds.i> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.i.service 2024-09-15T23:28:47.483 DEBUG:teuthology.orchestra.run.smithi159:mds.l> sudo journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.l.service 2024-09-15T23:28:47.526 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-15T23:28:47.526 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:28:47.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:47.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-15T23:28:47.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:47.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:47.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:47.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:47.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:47 smithi155 ceph-mon[35631]: Deploying daemon mds.l on smithi159 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:47 smithi159 ceph-mon[35472]: Deploying daemon mds.l on smithi159 2024-09-15T23:28:47.771 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:47.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='client.24412 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:28:47.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: Saving service mds.all spec with placement smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-15T23:28:47.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:28:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:47.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:47 smithi077 ceph-mon[30968]: Deploying daemon mds.l on smithi159 2024-09-15T23:28:48.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 -- 172.21.15.77:0/3480783411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb00106f20 msgr2=0x7ffb0010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:48.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3480783411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb00106f20 0x7ffb0010eaa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8009ca0 tx=0x7ffaf802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 -- 172.21.15.77:0/3480783411 shutdown_connections 2024-09-15T23:28:48.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3480783411 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb00106f20 0x7ffb0010eaa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3480783411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb001027a0 0x7ffb001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3480783411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00101df0 0x7ffb001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 -- 172.21.15.77:0/3480783411 >> 172.21.15.77:0/3480783411 conn(0x7ffb000fd8b0 msgr2=0x7ffb000ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 -- 172.21.15.77:0/3480783411 shutdown_connections 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.244+0000 7ffb048fc640 1 -- 172.21.15.77:0/3480783411 wait complete. 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 Processor -- start 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 -- start start 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 0x7ffb00198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00106f20 0x7ffb0019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00111f80 con 0x7ffb001027a0 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00111e00 con 0x7ffb00101df0 2024-09-15T23:28:48.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.245+0000 7ffb048fc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffb00112100 con 0x7ffb00106f20 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43106/0 (socket says 172.21.15.77:43106) 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 -- 172.21.15.77:0/3730953212 learned_addr learned my addr 172.21.15.77:0/3730953212 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafed9d640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00106f20 0x7ffb0019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafe59c640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 0x7ffb00198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:48.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 -- 172.21.15.77:0/3730953212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00106f20 msgr2=0x7ffb0019cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:48.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00106f20 0x7ffb0019cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 -- 172.21.15.77:0/3730953212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 msgr2=0x7ffb00198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:48.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 0x7ffb00198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 -- 172.21.15.77:0/3730953212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb0019d2f0 con 0x7ffb001027a0 2024-09-15T23:28:48.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafe59c640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 0x7ffb00198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffafdd9b640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c920 tx=0x7ffaf400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4007c70 con 0x7ffb001027a0 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb0019d5e0 con 0x7ffb001027a0 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffaf4007e10 con 0x7ffb001027a0 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4018890 con 0x7ffb001027a0 2024-09-15T23:28:48.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.246+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb001a4ec0 con 0x7ffb001027a0 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.247+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb001021d0 con 0x7ffb001027a0 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.248+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffaf4018b30 con 0x7ffb001027a0 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.249+0000 7ffaef7fe640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 0x7ffae80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.249+0000 7ffafe59c640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 0x7ffae80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.249+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7ffaf40cf540 con 0x7ffb001027a0 2024-09-15T23:28:48.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.249+0000 7ffafe59c640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 0x7ffae80a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000baa0 tx=0x7ffaf0005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:48.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.253+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ffaf4014030 con 0x7ffb001027a0 2024-09-15T23:28:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.453+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffb001a5190 con 0x7ffb001027a0 2024-09-15T23:28:48.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.454+0000 7ffaef7fe640 1 -- 172.21.15.77:0/3730953212 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7ffaf4018e20 con 0x7ffb001027a0 2024-09-15T23:28:48.456 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:48.456 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":1,"btime":"2024-09-15T23:21:49:385354+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-15T23:28:48.456 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 1 2024-09-15T23:28:48.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 msgr2=0x7ffae80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 0x7ffae80a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000baa0 tx=0x7ffaf0005d90 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 msgr2=0x7ffb00198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c920 tx=0x7ffaf400cde0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 shutdown_connections 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ffae80a3240 0x7ffae80a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb00106f20 0x7ffb0019cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ffb001027a0 0x7ffb00198880 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 --2- 172.21.15.77:0/3730953212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb00101df0 0x7ffb00198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:48.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 >> 172.21.15.77:0/3730953212 conn(0x7ffb000fd8b0 msgr2=0x7ffb000fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:48.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 shutdown_connections 2024-09-15T23:28:48.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:48.456+0000 7ffb048fc640 1 -- 172.21.15.77:0/3730953212 wait complete. 2024-09-15T23:28:48.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:48 smithi159 ceph-mon[35472]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:48.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:48 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3730953212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:48 smithi155 ceph-mon[35631]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:48.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:48 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3730953212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:48.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:48 smithi077 ceph-mon[30968]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:48.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:48 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3730953212' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:49.155 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:48 smithi159 systemd[1]: Starting Ceph mds.l for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:28:49.430 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 podman[65092]: 2024-09-15 23:28:49.056914228 +0000 UTC m=+0.015809580 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:28:49.430 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 podman[65092]: 2024-09-15 23:28:49.217744905 +0000 UTC m=+0.176640256 container create 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-8921c8e) 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 podman[65092]: 2024-09-15 23:28:49.557169106 +0000 UTC m=+0.516064458 container init 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 podman[65092]: 2024-09-15 23:28:49.560141933 +0000 UTC m=+0.519037286 container start 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=) 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 ceph-mds[65111]: -- 172.21.15.159:0/1900368762 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562bcb699860 con 0x562bcb677000 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l[65107]: starting mds.l at 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 bash[65092]: 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 2024-09-15T23:28:49.715 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:28:49 smithi159 systemd[1]: Started Ceph mds.l for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6832/1148226209,v1:172.21.15.159:6833/1148226209] up:boot 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: fsmap 1 up:standby 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:50.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:50.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:50.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: Deploying daemon mds.k on smithi155 2024-09-15T23:28:50.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:50 smithi155 ceph-mon[35631]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6832/1148226209,v1:172.21.15.159:6833/1148226209] up:boot 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: fsmap 1 up:standby 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:50.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: Deploying daemon mds.k on smithi155 2024-09-15T23:28:50.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:50 smithi077 ceph-mon[30968]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6832/1148226209,v1:172.21.15.159:6833/1148226209] up:boot 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: fsmap 1 up:standby 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:50.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:50.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:50.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:50.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: Deploying daemon mds.k on smithi155 2024-09-15T23:28:50.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:50 smithi159 ceph-mon[35472]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:51.184 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:28:51.438 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 -- 172.21.15.77:0/1128658654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650101420 msgr2=0x7fd65010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 --2- 172.21.15.77:0/1128658654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650101420 0x7fd65010d950 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd648009cd0 tx=0x7fd64802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 -- 172.21.15.77:0/1128658654 shutdown_connections 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 --2- 172.21.15.77:0/1128658654 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650101420 0x7fd65010d950 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 --2- 172.21.15.77:0/1128658654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd650100a80 0x7fd650100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 --2- 172.21.15.77:0/1128658654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650106a80 0x7fd650106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 -- 172.21.15.77:0/1128658654 >> 172.21.15.77:0/1128658654 conn(0x7fd6500fc7a0 msgr2=0x7fd6500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 -- 172.21.15.77:0/1128658654 shutdown_connections 2024-09-15T23:28:51.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.921+0000 7fd655836640 1 -- 172.21.15.77:0/1128658654 wait complete. 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 Processor -- start 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 -- start start 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd650100a80 0x7fd650198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650101420 0x7fd6501988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd650110e80 con 0x7fd650106a80 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd650110d00 con 0x7fd650101420 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd655836640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd650111000 con 0x7fd650100a80 2024-09-15T23:28:51.936 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43128/0 (socket says 172.21.15.77:43128) 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 -- 172.21.15.77:0/795107103 learned_addr learned my addr 172.21.15.77:0/795107103 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd647fff640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650101420 0x7fd6501988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 -- 172.21.15.77:0/795107103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd650100a80 msgr2=0x7fd650198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd650100a80 0x7fd650198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 -- 172.21.15.77:0/795107103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650101420 msgr2=0x7fd6501988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650101420 0x7fd6501988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.922+0000 7fd64f7fe640 1 -- 172.21.15.77:0/795107103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd65019d320 con 0x7fd650106a80 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd64f7fe640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd648005cc0 tx=0x7fd648003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648004040 con 0x7fd650106a80 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6480046c0 con 0x7fd650106a80 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd65019d5b0 con 0x7fd650106a80 2024-09-15T23:28:51.937 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd648030e70 con 0x7fd650106a80 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.923+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6501a4ef0 con 0x7fd650106a80 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.924+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd650100ee0 con 0x7fd650106a80 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.925+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd6480305a0 con 0x7fd650106a80 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.926+0000 7fd654834640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 0x7fd63c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.926+0000 7fd64effd640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 0x7fd63c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.926+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fd64802e030 con 0x7fd650106a80 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.926+0000 7fd64effd640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 0x7fd63c0a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd640005fd0 tx=0x7fd640005f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:51.938 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:51.929+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd6480bdcc0 con 0x7fd650106a80 2024-09-15T23:28:52.021 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:51 smithi155 systemd[1]: Starting Ceph mds.k for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:28:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.126+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6501a5120 con 0x7fd650106a80 2024-09-15T23:28:52.127 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.126+0000 7fd654834640 1 -- 172.21.15.77:0/795107103 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1438 (secure 0 0 0) 0x7fd6480098b0 con 0x7fd650106a80 2024-09-15T23:28:52.127 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:52.128 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":2,"btime":"2024-09-15T23:28:49:588673+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:28:52.128 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 2 2024-09-15T23:28:52.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 msgr2=0x7fd63c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:52.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 0x7fd63c0a5780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd640005fd0 tx=0x7fd640005f40 comp rx=0 tx=0).stop 2024-09-15T23:28:52.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 msgr2=0x7fd65019cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:52.129 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd648005cc0 tx=0x7fd648003970 comp rx=0 tx=0).stop 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 shutdown_connections 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd63c0a32c0 0x7fd63c0a5780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd650106a80 0x7fd65019cc40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd650101420 0x7fd6501988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 --2- 172.21.15.77:0/795107103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd650100a80 0x7fd650198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 >> 172.21.15.77:0/795107103 conn(0x7fd6500fc7a0 msgr2=0x7fd6500fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 shutdown_connections 2024-09-15T23:28:52.130 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:52.128+0000 7fd655836640 1 -- 172.21.15.77:0/795107103 wait complete. 2024-09-15T23:28:52.293 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 podman[64730]: 2024-09-15 23:28:51.923678345 +0000 UTC m=+0.016684117 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:28:52.294 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 podman[64730]: 2024-09-15 23:28:52.048468869 +0000 UTC m=+0.141474614 container create 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True) 2024-09-15T23:28:52.294 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 podman[64730]: 2024-09-15 23:28:52.293031426 +0000 UTC m=+0.386037180 container init 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:28:52.614 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 podman[64730]: 2024-09-15 23:28:52.29611092 +0000 UTC m=+0.389116666 container start 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:28:52.614 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mds[64749]: -- 172.21.15.155:0/1936263275 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5612846f7860 con 0x5612846d5400 2024-09-15T23:28:52.614 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k[64745]: starting mds.k at 2024-09-15T23:28:52.614 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 bash[64730]: 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 2024-09-15T23:28:52.614 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:28:52 smithi155 systemd[1]: Started Ceph mds.k for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/795107103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:52.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:52 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/795107103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:53.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:52 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/795107103' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:52 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:54.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:53 smithi155 ceph-mon[35631]: Deploying daemon mds.j on smithi077 2024-09-15T23:28:54.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:53 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.155:6832/2847751419,v1:172.21.15.155:6833/2847751419] up:boot 2024-09-15T23:28:54.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:53 smithi155 ceph-mon[35631]: fsmap 2 up:standby 2024-09-15T23:28:54.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:53 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:28:54.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:53 smithi077 ceph-mon[30968]: Deploying daemon mds.j on smithi077 2024-09-15T23:28:54.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:53 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.155:6832/2847751419,v1:172.21.15.155:6833/2847751419] up:boot 2024-09-15T23:28:54.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:53 smithi077 ceph-mon[30968]: fsmap 2 up:standby 2024-09-15T23:28:54.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:53 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:28:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:53 smithi159 ceph-mon[35472]: Deploying daemon mds.j on smithi077 2024-09-15T23:28:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:53 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.155:6832/2847751419,v1:172.21.15.155:6833/2847751419] up:boot 2024-09-15T23:28:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:53 smithi159 ceph-mon[35472]: fsmap 2 up:standby 2024-09-15T23:28:54.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:53 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-15T23:28:54.821 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:54 smithi077 systemd[1]: Starting Ceph mds.j for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:28:54.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:28:55.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:54 smithi155 ceph-mon[35631]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:54 smithi077 ceph-mon[30968]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:54 smithi077 podman[70735]: 2024-09-15 23:28:54.723069076 +0000 UTC m=+0.016036569 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:54 smithi077 podman[70735]: 2024-09-15 23:28:54.82650076 +0000 UTC m=+0.119468244 container create 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 podman[70735]: 2024-09-15 23:28:55.037931536 +0000 UTC m=+0.330899042 container init 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 podman[70735]: 2024-09-15 23:28:55.041320266 +0000 UTC m=+0.334287759 container start 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 ceph-mds[70772]: -- 172.21.15.77:0/1459521683 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea38881860 con 0x55ea3885f400 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j[70750]: starting mds.j at 2024-09-15T23:28:55.130 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 bash[70735]: 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 2024-09-15T23:28:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:54 smithi159 ceph-mon[35472]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:55.245 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:55.382 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:28:55 smithi077 systemd[1]: Started Ceph mds.j for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 -- 172.21.15.77:0/84550582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57401082a0 msgr2=0x7f574010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 --2- 172.21.15.77:0/84550582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57401082a0 0x7f574010ec40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5738009930 tx=0x7f573802a420 comp rx=0 tx=0).stop 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 -- 172.21.15.77:0/84550582 shutdown_connections 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 --2- 172.21.15.77:0/84550582 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f57401082a0 0x7f574010ec40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 --2- 172.21.15.77:0/84550582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401036e0 0x7f5740107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 --2- 172.21.15.77:0/84550582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5740102d30 0x7f5740103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 -- 172.21.15.77:0/84550582 >> 172.21.15.77:0/84550582 conn(0x7f57400fc7d0 msgr2=0x7f57400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 -- 172.21.15.77:0/84550582 shutdown_connections 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.707+0000 7f5744ecd640 1 -- 172.21.15.77:0/84550582 wait complete. 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 Processor -- start 2024-09-15T23:28:55.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 -- start start 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57401036e0 0x7f5740198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401082a0 0x7f574019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f57401120a0 con 0x7f5740102d30 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5740111f20 con 0x7f57401036e0 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f5744ecd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5740112220 con 0x7f57401082a0 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43166/0 (socket says 172.21.15.77:43166) 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 -- 172.21.15.77:0/2292990696 learned_addr learned my addr 172.21.15.77:0/2292990696 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573dd9b640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57401036e0 0x7f5740198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573ed9d640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401082a0 0x7f574019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 -- 172.21.15.77:0/2292990696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401082a0 msgr2=0x7f574019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401082a0 0x7f574019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 -- 172.21.15.77:0/2292990696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57401036e0 msgr2=0x7f5740198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57401036e0 0x7f5740198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.708+0000 7f573e59c640 1 -- 172.21.15.77:0/2292990696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574019d470 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f573e59c640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f573000cce0 tx=0x7f573000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730004b20 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574019d760 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5730004cc0 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573000f6b0 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.709+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57401a5040 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.710+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5740103110 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.711+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5730005000 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.712+0000 7f57377fe640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 0x7f572c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.712+0000 7f573dd9b640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 0x7f572c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.712+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f57300cf910 con 0x7f5740102d30 2024-09-15T23:28:55.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.712+0000 7f573dd9b640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 0x7f572c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57400fecf0 tx=0x7f572800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:55.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.715+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5730014030 con 0x7f5740102d30 2024-09-15T23:28:55.930 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.929+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5740199820 con 0x7f5740102d30 2024-09-15T23:28:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.929+0000 7f57377fe640 1 -- 172.21.15.77:0/2292990696 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3091 (secure 0 0 0) 0x7f573009cad0 con 0x7f5740102d30 2024-09-15T23:28:55.931 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:55.931 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":4,"btime":"2024-09-15T23:28:55:854194+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:28:55.931 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 4 2024-09-15T23:28:55.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 msgr2=0x7f572c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:55.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 0x7f572c0a5700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57400fecf0 tx=0x7f572800a2d0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 msgr2=0x7f57401984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:55.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f573000cce0 tx=0x7f573000a620 comp rx=0 tx=0).stop 2024-09-15T23:28:55.933 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 shutdown_connections 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f572c0a3240 0x7f572c0a5700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57401082a0 0x7f574019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f57401036e0 0x7f5740198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 --2- 172.21.15.77:0/2292990696 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5740102d30 0x7f57401984c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 >> 172.21.15.77:0/2292990696 conn(0x7f57400fc7d0 msgr2=0x7f5740106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 shutdown_connections 2024-09-15T23:28:55.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:55.932+0000 7f5744ecd640 1 -- 172.21.15.77:0/2292990696 wait complete. 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:56.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: Deploying daemon mds.d on smithi077 2024-09-15T23:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.77:6834/2999536599,v1:172.21.15.77:6835/2999536599] up:boot 2024-09-15T23:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: fsmap 3 up:standby 2024-09-15T23:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:28:56.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:56 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2292990696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:56.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: Deploying daemon mds.d on smithi077 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.77:6834/2999536599,v1:172.21.15.77:6835/2999536599] up:boot 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: fsmap 3 up:standby 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:28:56.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:56 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2292990696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: Deploying daemon mds.d on smithi077 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:56.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.77:6834/2999536599,v1:172.21.15.77:6835/2999536599] up:boot 2024-09-15T23:28:56.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: fsmap 3 up:standby 2024-09-15T23:28:56.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-15T23:28:56.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:56 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2292990696' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:28:58.198 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 systemd[1]: Starting Ceph mds.d for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:28:58.511 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 podman[71153]: 2024-09-15 23:28:58.255884561 +0000 UTC m=+0.016120264 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:28:58.511 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 podman[71153]: 2024-09-15 23:28:58.393770376 +0000 UTC m=+0.154006073 container create 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-15T23:28:58.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:28:59.056 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:58 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:59.133 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 podman[71153]: 2024-09-15 23:28:58.638279417 +0000 UTC m=+0.398515123 container init 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True) 2024-09-15T23:28:59.134 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 podman[71153]: 2024-09-15 23:28:58.641183971 +0000 UTC m=+0.401419667 container start 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T23:28:59.134 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-mds[71181]: -- 172.21.15.77:0/2224034777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ccd1b93860 con 0x55ccd1b70800 2024-09-15T23:28:59.134 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d[71176]: starting mds.d at 2024-09-15T23:28:59.134 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 bash[71153]: 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 2024-09-15T23:28:59.134 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:28:58 smithi077 systemd[1]: Started Ceph mds.d for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:28:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:28:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:28:59.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:28:59.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:28:59.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:58 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:28:59.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 -- 172.21.15.77:0/1018816889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 msgr2=0x7fc6c010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1018816889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c010da40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009900 tx=0x7fc6b802a480 comp rx=0 tx=0).stop 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 -- 172.21.15.77:0/1018816889 shutdown_connections 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1018816889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c010da40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1018816889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 0x7fc6c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1018816889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 -- 172.21.15.77:0/1018816889 >> 172.21.15.77:0/1018816889 conn(0x7fc6c00fc7d0 msgr2=0x7fc6c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 -- 172.21.15.77:0/1018816889 shutdown_connections 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.565+0000 7fc6c833b640 1 -- 172.21.15.77:0/1018816889 wait complete. 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 Processor -- start 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 -- start start 2024-09-15T23:28:59.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 0x7fc6c00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0110f80 con 0x7fc6c0102ef0 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0110e00 con 0x7fc6c0102570 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c833b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc6c0111100 con 0x7fc6c0100e20 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35642/0 (socket says 172.21.15.77:35642) 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 -- 172.21.15.77:0/1259468064 learned_addr learned my addr 172.21.15.77:0/1259468064 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c58d6640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 0x7fc6c00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:59.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c60d7640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 -- 172.21.15.77:0/1259468064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 msgr2=0x7fc6c00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 -- 172.21.15.77:0/1259468064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 msgr2=0x7fc6c00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 0x7fc6c00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c68d8640 1 -- 172.21.15.77:0/1259468064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6c01a68b0 con 0x7fc6c0102ef0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.566+0000 7fc6c60d7640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6c68d8640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8004770 tx=0x7fc6b8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b803f070 con 0x7fc6c0102ef0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b8031c30 con 0x7fc6c0102ef0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6c01a6b40 con 0x7fc6c0102ef0 2024-09-15T23:28:59.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8035030 con 0x7fc6c0102ef0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.567+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6c01a7020 con 0x7fc6c0102ef0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.568+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6c0101200 con 0x7fc6c0102ef0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.569+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc6b8042070 con 0x7fc6c0102ef0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.569+0000 7fc6bf7fe640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 0x7fc6a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.570+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fc6b80f0430 con 0x7fc6c0102ef0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.570+0000 7fc6c60d7640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 0x7fc6a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.570+0000 7fc6c60d7640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 0x7fc6a80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0008e00 tx=0x7fc6b0008350 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:28:59.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.573+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc6b80bd5f0 con 0x7fc6c0102ef0 2024-09-15T23:28:59.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.773+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6c010a0a0 con 0x7fc6c0102ef0 2024-09-15T23:28:59.775 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.774+0000 7fc6bf7fe640 1 -- 172.21.15.77:0/1259468064 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fc6b80bcef0 con 0x7fc6c0102ef0 2024-09-15T23:28:59.775 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:28:59.775 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":5,"btime":"2024-09-15T23:28:58:839849+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:28:59.776 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 5 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 msgr2=0x7fc6a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 0x7fc6a80a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc6b0008e00 tx=0x7fc6b0008350 comp rx=0 tx=0).stop 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 msgr2=0x7fc6c00fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8004770 tx=0x7fc6b8003c10 comp rx=0 tx=0).stop 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 shutdown_connections 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc6a80a3240 0x7fc6a80a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc6c0102ef0 0x7fc6c00fd700 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6c0102570 0x7fc6c00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 --2- 172.21.15.77:0/1259468064 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc6c0100e20 0x7fc6c00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:28:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 >> 172.21.15.77:0/1259468064 conn(0x7fc6c00fc7d0 msgr2=0x7fc6c006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:28:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 shutdown_connections 2024-09-15T23:28:59.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:28:59.776+0000 7fc6c833b640 1 -- 172.21.15.77:0/1259468064 wait complete. 2024-09-15T23:29:00.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:59 smithi077 ceph-mon[30968]: Deploying daemon mds.e on smithi155 2024-09-15T23:29:00.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:59 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.77:6836/1486038623,v1:172.21.15.77:6837/1486038623] up:boot 2024-09-15T23:29:00.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:59 smithi077 ceph-mon[30968]: fsmap 4 up:standby 2024-09-15T23:29:00.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:59 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:29:00.089 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:28:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1259468064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:59 smithi155 ceph-mon[35631]: Deploying daemon mds.e on smithi155 2024-09-15T23:29:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:59 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.77:6836/1486038623,v1:172.21.15.77:6837/1486038623] up:boot 2024-09-15T23:29:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:59 smithi155 ceph-mon[35631]: fsmap 4 up:standby 2024-09-15T23:29:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:59 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:29:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:28:59 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1259468064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:59 smithi159 ceph-mon[35472]: Deploying daemon mds.e on smithi155 2024-09-15T23:29:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:59 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.77:6836/1486038623,v1:172.21.15.77:6837/1486038623] up:boot 2024-09-15T23:29:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:59 smithi159 ceph-mon[35472]: fsmap 4 up:standby 2024-09-15T23:29:00.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:59 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-15T23:29:00.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:28:59 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1259468064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:01.057 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:00 smithi155 ceph-mon[35631]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:00 smithi077 ceph-mon[30968]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:00 smithi159 ceph-mon[35472]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:01.614 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:29:01 smithi155 systemd[1]: Started Ceph mds.e for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:02.343 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:02.605 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:02.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: Deploying daemon mds.f on smithi159 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.155:6834/31263925,v1:172.21.15.155:6835/31263925] up:boot 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: fsmap 5 up:standby 2024-09-15T23:29:02.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:02 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:02.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:02.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: Deploying daemon mds.f on smithi159 2024-09-15T23:29:02.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:02.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.155:6834/31263925,v1:172.21.15.155:6835/31263925] up:boot 2024-09-15T23:29:02.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: fsmap 5 up:standby 2024-09-15T23:29:02.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:02 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:02.953 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:02.954 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: Deploying daemon mds.f on smithi159 2024-09-15T23:29:02.954 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:02.954 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.155:6834/31263925,v1:172.21.15.155:6835/31263925] up:boot 2024-09-15T23:29:02.954 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: fsmap 5 up:standby 2024-09-15T23:29:02.954 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:02 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-15T23:29:03.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 -- 172.21.15.77:0/272240305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c100a80 msgr2=0x7fc29c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:03.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 --2- 172.21.15.77:0/272240305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c100a80 0x7fc29c100ee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc298009930 tx=0x7fc29802a420 comp rx=0 tx=0).stop 2024-09-15T23:29:03.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 -- 172.21.15.77:0/272240305 shutdown_connections 2024-09-15T23:29:03.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 --2- 172.21.15.77:0/272240305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 0x7fc29c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 --2- 172.21.15.77:0/272240305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c100a80 0x7fc29c100ee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 --2- 172.21.15.77:0/272240305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c106a80 0x7fc29c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 -- 172.21.15.77:0/272240305 >> 172.21.15.77:0/272240305 conn(0x7fc29c0fc7a0 msgr2=0x7fc29c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 -- 172.21.15.77:0/272240305 shutdown_connections 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.122+0000 7fc2a3890640 1 -- 172.21.15.77:0/272240305 wait complete. 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 Processor -- start 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 -- start start 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 0x7fc29c199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 0x7fc29c1998b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:03.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c110ea0 con 0x7fc29c106a80 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c110d20 con 0x7fc29c101420 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a3890640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc29c111020 con 0x7fc29c100a80 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35652/0 (socket says 172.21.15.77:35652) 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 -- 172.21.15.77:0/2281359019 learned_addr learned my addr 172.21.15.77:0/2281359019 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a0e2b640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 0x7fc29c1998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a162c640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 0x7fc29c199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 -- 172.21.15.77:0/2281359019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 msgr2=0x7fc29c199370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 0x7fc29c199370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 -- 172.21.15.77:0/2281359019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 msgr2=0x7fc29c1998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 0x7fc29c1998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 -- 172.21.15.77:0/2281359019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29c1a4930 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a162c640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 0x7fc29c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.123+0000 7fc2a1e2d640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc29400cad0 tx=0x7fc29400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.124+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29400ae20 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.124+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29c1a4b00 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.124+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc294005020 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.124+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc29400f6f0 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.124+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc29c1a4fc0 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.125+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc29c100ee0 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.126+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc2940051d0 con 0x7fc29c106a80 2024-09-15T23:29:03.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.126+0000 7fc28e7fc640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:03.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.126+0000 7fc2a162c640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:03.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.126+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fc2940cf5e0 con 0x7fc29c106a80 2024-09-15T23:29:03.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.127+0000 7fc2a162c640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 0x7fc2880a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:03.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.130+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc294014030 con 0x7fc29c106a80 2024-09-15T23:29:03.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.329+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc29c02d7c0 con 0x7fc29c106a80 2024-09-15T23:29:03.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.329+0000 7fc28e7fc640 1 -- 172.21.15.77:0/2281359019 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fc29409c7a0 con 0x7fc29c106a80 2024-09-15T23:29:03.331 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:03.331 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":6,"btime":"2024-09-15T23:29:01:854233+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T23:29:03.331 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 6 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 msgr2=0x7fc2880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 0x7fc2880a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc290006fd0 tx=0x7fc290008040 comp rx=0 tx=0).stop 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 msgr2=0x7fc29c1a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc29400cad0 tx=0x7fc29400cf90 comp rx=0 tx=0).stop 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 shutdown_connections 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc29c106a80 0x7fc29c1a43f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc29c101420 0x7fc29c1998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 --2- 172.21.15.77:0/2281359019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc29c100a80 0x7fc29c199370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.331+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 >> 172.21.15.77:0/2281359019 conn(0x7fc29c0fc7a0 msgr2=0x7fc29c0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.332+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 shutdown_connections 2024-09-15T23:29:03.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:03.332+0000 7fc2a3890640 1 -- 172.21.15.77:0/2281359019 wait complete. 2024-09-15T23:29:03.632 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:03 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2281359019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:03.669 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:03 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2281359019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:03.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:03 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2281359019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:04.215 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:29:04 smithi159 systemd[1]: Started Ceph mds.f for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:04.834 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:04.834 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.834 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.834 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.834 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:04.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:04.835 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:04 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:04.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:04.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:04 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:04.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:04 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:05 smithi155 ceph-mon[35631]: Deploying daemon mds.c on smithi159 2024-09-15T23:29:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:05 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6834/3015432739,v1:172.21.15.159:6835/3015432739] up:boot 2024-09-15T23:29:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:05 smithi155 ceph-mon[35631]: fsmap 6 up:standby 2024-09-15T23:29:05.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:05 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:29:05.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:05 smithi077 ceph-mon[30968]: Deploying daemon mds.c on smithi159 2024-09-15T23:29:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:05 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6834/3015432739,v1:172.21.15.159:6835/3015432739] up:boot 2024-09-15T23:29:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:05 smithi077 ceph-mon[30968]: fsmap 6 up:standby 2024-09-15T23:29:05.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:05 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:29:05.895 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:05 smithi159 ceph-mon[35472]: Deploying daemon mds.c on smithi159 2024-09-15T23:29:05.896 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:05 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6834/3015432739,v1:172.21.15.159:6835/3015432739] up:boot 2024-09-15T23:29:05.896 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:05 smithi159 ceph-mon[35472]: fsmap 6 up:standby 2024-09-15T23:29:05.896 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:05 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-15T23:29:06.072 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:06.215 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 systemd[1]: Starting Ceph mds.c for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:29:06.330 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:06.560 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:06 smithi159 ceph-mon[35472]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:06.561 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 podman[65693]: 2024-09-15 23:29:06.191283954 +0000 UTC m=+0.015778870 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:29:06.561 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 podman[65693]: 2024-09-15 23:29:06.324243027 +0000 UTC m=+0.148737943 container create 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:29:06.561 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 podman[65693]: 2024-09-15 23:29:06.560465013 +0000 UTC m=+0.384959928 container init 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:29:06.727 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:06 smithi077 ceph-mon[30968]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:06.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 -- 172.21.15.77:0/4071614043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5381002f0 msgr2=0x7fb5381006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:06.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 --2- 172.21.15.77:0/4071614043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5381002f0 0x7fb5381006d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb534009930 tx=0x7fb53402a420 comp rx=0 tx=0).stop 2024-09-15T23:29:06.827 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 -- 172.21.15.77:0/4071614043 shutdown_connections 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 --2- 172.21.15.77:0/4071614043 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538106f50 0x7fb53810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 --2- 172.21.15.77:0/4071614043 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb538100ca0 0x7fb538106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 --2- 172.21.15.77:0/4071614043 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb5381002f0 0x7fb5381006d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 -- 172.21.15.77:0/4071614043 >> 172.21.15.77:0/4071614043 conn(0x7fb538077210 msgr2=0x7fb5380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 -- 172.21.15.77:0/4071614043 shutdown_connections 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.806+0000 7fb53fb19640 1 -- 172.21.15.77:0/4071614043 wait complete. 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 Processor -- start 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 -- start start 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5381002f0 0x7fb538198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538100ca0 0x7fb538198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb538111fa0 con 0x7fb538106f50 2024-09-15T23:29:06.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb538111e20 con 0x7fb5381002f0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53fb19640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb538112120 con 0x7fb538100ca0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:35666/0 (socket says 172.21.15.77:35666) 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 -- 172.21.15.77:0/1653550167 learned_addr learned my addr 172.21.15.77:0/1653550167 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53d8b5640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5381002f0 0x7fb538198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53d0b4640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538100ca0 0x7fb538198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 -- 172.21.15.77:0/1653550167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538100ca0 msgr2=0x7fb538198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538100ca0 0x7fb538198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 -- 172.21.15.77:0/1653550167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5381002f0 msgr2=0x7fb538198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5381002f0 0x7fb538198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 -- 172.21.15.77:0/1653550167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb53819d510 con 0x7fb538106f50 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.807+0000 7fb53e0b6640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb53000eaa0 tx=0x7fb53000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:06.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.808+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb53000cdb0 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.808+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb530005020 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.808+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb53819d800 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.808+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5300116b0 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.808+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5381a50e0 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.809+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5381006d0 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.810+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb530005560 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.810+0000 7fb52effd640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 0x7fb5240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.811+0000 7fb53d8b5640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 0x7fb5240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.811+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7fb5300cf5a0 con 0x7fb538106f50 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.811+0000 7fb53d8b5640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 0x7fb5240a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb534009900 tx=0x7fb5340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:06.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:06.815+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb530016030 con 0x7fb538106f50 2024-09-15T23:29:06.863 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:06 smithi155 ceph-mon[35631]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:06.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 podman[65693]: 2024-09-15 23:29:06.563573395 +0000 UTC m=+0.388068320 container start 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-15T23:29:06.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 ceph-mds[65712]: -- 172.21.15.159:0/2219374129 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c66774d860 con 0x55c66772b400 2024-09-15T23:29:06.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c[65708]: starting mds.c at 2024-09-15T23:29:06.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 bash[65693]: 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 2024-09-15T23:29:06.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:29:06 smithi159 systemd[1]: Started Ceph mds.c for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:07.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.017+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb53802d7c0 con 0x7fb538106f50 2024-09-15T23:29:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.018+0000 7fb52effd640 1 -- 172.21.15.77:0/1653550167 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5566 (secure 0 0 0) 0x7fb53009c110 con 0x7fb538106f50 2024-09-15T23:29:07.019 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:07.019 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":7,"btime":"2024-09-15T23:29:04:489919+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-09-15T23:29:07.019 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 7 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 msgr2=0x7fb5240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 0x7fb5240a5700 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb534009900 tx=0x7fb5340058d0 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 msgr2=0x7fb53819ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb53000eaa0 tx=0x7fb53000ef60 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 shutdown_connections 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb5240a3240 0x7fb5240a5700 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb538106f50 0x7fb53819ce30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb538100ca0 0x7fb538198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 --2- 172.21.15.77:0/1653550167 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb5381002f0 0x7fb538198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 >> 172.21.15.77:0/1653550167 conn(0x7fb538077210 msgr2=0x7fb5380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.020+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 shutdown_connections 2024-09-15T23:29:07.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:07.021+0000 7fb53fb19640 1 -- 172.21.15.77:0/1653550167 wait complete. 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: Deploying daemon mds.h on smithi155 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1653550167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6836/2654057278,v1:172.21.15.159:6837/2654057278] up:boot 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: fsmap 7 up:standby 2024-09-15T23:29:07.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:07 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:29:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: Deploying daemon mds.h on smithi155 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1653550167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6836/2654057278,v1:172.21.15.159:6837/2654057278] up:boot 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: fsmap 7 up:standby 2024-09-15T23:29:08.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:07 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:08.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: Deploying daemon mds.h on smithi155 2024-09-15T23:29:08.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1653550167' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:08.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6836/2654057278,v1:172.21.15.159:6837/2654057278] up:boot 2024-09-15T23:29:08.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: fsmap 7 up:standby 2024-09-15T23:29:08.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:07 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-15T23:29:09.036 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:08 smithi155 ceph-mon[35631]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:09.037 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:08 smithi155 systemd[1]: Starting Ceph mds.h for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:29:09.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:08 smithi077 ceph-mon[30968]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:08 smithi159 ceph-mon[35472]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:09.321 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 podman[65351]: 2024-09-15 23:29:08.938571056 +0000 UTC m=+0.015835926 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:29:09.321 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 podman[65351]: 2024-09-15 23:29:09.068873371 +0000 UTC m=+0.146138231 container create 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:29:09.321 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 podman[65351]: 2024-09-15 23:29:09.320447038 +0000 UTC m=+0.397711898 container init 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e) 2024-09-15T23:29:09.614 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 podman[65351]: 2024-09-15 23:29:09.323480554 +0000 UTC m=+0.400745414 container start 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T23:29:09.614 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 ceph-mds[65370]: -- 172.21.15.155:0/1567393052 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5601de833860 con 0x5601de811400 2024-09-15T23:29:09.614 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h[65366]: starting mds.h at 2024-09-15T23:29:09.614 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 bash[65351]: 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 2024-09-15T23:29:09.614 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:29:09 smithi155 systemd[1]: Started Ceph mds.h for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:09.652 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:09.912 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 -- 172.21.15.77:0/3727635959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34681055b0 msgr2=0x7f346810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 --2- 172.21.15.77:0/3727635959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34681055b0 0x7f346810d130 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3460009ca0 tx=0x7f346002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 -- 172.21.15.77:0/3727635959 shutdown_connections 2024-09-15T23:29:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 --2- 172.21.15.77:0/3727635959 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f34681055b0 0x7f346810d130 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 --2- 172.21.15.77:0/3727635959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100e30 0x7f3468104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 --2- 172.21.15.77:0/3727635959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3468100480 0x7f3468100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 -- 172.21.15.77:0/3727635959 >> 172.21.15.77:0/3727635959 conn(0x7f3468077210 msgr2=0x7f34680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 -- 172.21.15.77:0/3727635959 shutdown_connections 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.365+0000 7f346f1d6640 1 -- 172.21.15.77:0/3727635959 wait complete. 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 Processor -- start 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 -- start start 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100480 0x7f34681992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34681055b0 0x7f34681a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3468110630 con 0x7f3468100e30 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34681104b0 con 0x7f34681055b0 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346f1d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f34681107b0 con 0x7f3468100480 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f3467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:10.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f3467fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38650/0 (socket says 172.21.15.77:38650) 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f3467fff640 1 -- 172.21.15.77:0/2727161321 learned_addr learned my addr 172.21.15.77:0/2727161321 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.366+0000 7f346cf72640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100480 0x7f34681992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f346d773640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34681055b0 0x7f34681a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 -- 172.21.15.77:0/2727161321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100480 msgr2=0x7f34681992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100480 0x7f34681992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 -- 172.21.15.77:0/2727161321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34681055b0 msgr2=0x7f34681a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34681055b0 0x7f34681a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 -- 172.21.15.77:0/2727161321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34681a4890 con 0x7f3468100e30 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3467fff640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f345c00b4a0 tx=0x7f345c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c014070 con 0x7f3468100e30 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f345c010af0 con 0x7f3468100e30 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f345c017d10 con 0x7f3468100e30 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34681a4a60 con 0x7f3468100e30 2024-09-15T23:29:10.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.367+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34681a4f20 con 0x7f3468100e30 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.368+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3468100860 con 0x7f3468100e30 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.369+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f345c017070 con 0x7f3468100e30 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.370+0000 7f3465ffb640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 0x7f34500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.370+0000 7f346cf72640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 0x7f34500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.370+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f345c0ce840 con 0x7f3468100e30 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.370+0000 7f346cf72640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 0x7f34500a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34580058c0 tx=0x7f345800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:10.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.374+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f345c09ba00 con 0x7f3468100e30 2024-09-15T23:29:10.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.578+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34681a51b0 con 0x7f3468100e30 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: Deploying daemon mds.i on smithi159 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.155:6836/1039901701,v1:172.21.15.155:6837/1039901701] up:boot 2024-09-15T23:29:10.580 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: fsmap 8 up:standby 2024-09-15T23:29:10.581 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:29:10.581 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:10 smithi077 ceph-mon[30968]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:10.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.579+0000 7f3465ffb640 1 -- 172.21.15.77:0/2727161321 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f345c09b300 con 0x7f3468100e30 2024-09-15T23:29:10.581 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:10.581 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":9,"btime":"2024-09-15T23:29:09:724099+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-15T23:29:10.582 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 9 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.581+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 msgr2=0x7f34500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.581+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 0x7f34500a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34580058c0 tx=0x7f345800a2d0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.581+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 msgr2=0x7f3468199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.581+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f345c00b4a0 tx=0x7f345c00b960 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 shutdown_connections 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f34500a3240 0x7f34500a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34681055b0 0x7f34681a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3468100e30 0x7f3468199810 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 --2- 172.21.15.77:0/2727161321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3468100480 0x7f34681992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 >> 172.21.15.77:0/2727161321 conn(0x7f3468077210 msgr2=0x7f34680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 shutdown_connections 2024-09-15T23:29:10.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:10.582+0000 7f346f1d6640 1 -- 172.21.15.77:0/2727161321 wait complete. 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:10.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:10.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: Deploying daemon mds.i on smithi159 2024-09-15T23:29:10.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.155:6836/1039901701,v1:172.21.15.155:6837/1039901701] up:boot 2024-09-15T23:29:10.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: fsmap 8 up:standby 2024-09-15T23:29:10.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:29:10.716 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:10 smithi159 ceph-mon[35472]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:10.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: Deploying daemon mds.i on smithi159 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.155:6836/1039901701,v1:172.21.15.155:6837/1039901701] up:boot 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: fsmap 8 up:standby 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-15T23:29:10.865 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:10 smithi155 ceph-mon[35631]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:11.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:11 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2727161321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:11.650 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:11 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2727161321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:11.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:11 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2727161321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:12.215 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:29:12 smithi159 systemd[1]: Started Ceph mds.i for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:12.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:12.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.761 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.762 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:12.762 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:12.762 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:12 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:12.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:12 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:12.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:12 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:13.328 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:13.595 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:13.606 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:13 smithi077 ceph-mon[30968]: Deploying daemon mds.g on smithi077 2024-09-15T23:29:13.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:13 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:boot 2024-09-15T23:29:13.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:13 smithi077 ceph-mon[30968]: fsmap 9 up:standby 2024-09-15T23:29:13.607 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:13 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:29:13.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:13 smithi155 ceph-mon[35631]: Deploying daemon mds.g on smithi077 2024-09-15T23:29:13.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:13 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:boot 2024-09-15T23:29:13.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:13 smithi155 ceph-mon[35631]: fsmap 9 up:standby 2024-09-15T23:29:13.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:13 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:29:13.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:13 smithi159 ceph-mon[35472]: Deploying daemon mds.g on smithi077 2024-09-15T23:29:13.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:13 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:boot 2024-09-15T23:29:13.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:13 smithi159 ceph-mon[35472]: fsmap 9 up:standby 2024-09-15T23:29:13.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:13 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:29:14.274 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 -- 172.21.15.77:0/1851453149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 msgr2=0x7f2f70112650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1851453149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f70112650 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c009900 tx=0x7f2f6c02a480 comp rx=0 tx=0).stop 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 -- 172.21.15.77:0/1851453149 shutdown_connections 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1851453149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 0x7f2f70114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1851453149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f70112650 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1851453149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 0x7f2f70074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 -- 172.21.15.77:0/1851453149 >> 172.21.15.77:0/1851453149 conn(0x7f2f700fd8c0 msgr2=0x7f2f700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 -- 172.21.15.77:0/1851453149 shutdown_connections 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.249+0000 7f2f779ff640 1 -- 172.21.15.77:0/1851453149 wait complete. 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 Processor -- start 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 -- start start 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 0x7f2f701a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:14.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 0x7f2f7019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70118640 con 0x7f2f70074eb0 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701184c0 con 0x7f2f70112b90 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f779ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2f701187c0 con 0x7f2f70074590 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f74f9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f74f9a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38666/0 (socket says 172.21.15.77:38666) 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.250+0000 7f2f74f9a640 1 -- 172.21.15.77:0/1279655823 learned_addr learned my addr 172.21.15.77:0/1279655823 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f7579b640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 0x7f2f701a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f75f9c640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 0x7f2f7019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 -- 172.21.15.77:0/1279655823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 msgr2=0x7f2f701a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 0x7f2f701a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 -- 172.21.15.77:0/1279655823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 msgr2=0x7f2f7019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 0x7f2f7019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 -- 172.21.15.77:0/1279655823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7019f0c0 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f74f9a640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c004770 tx=0x7f2f6c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c03f070 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f6c031ca0 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7019f350 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c035030 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.251+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f701ab6a0 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.252+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f70074970 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.253+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2f6c042070 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.254+0000 7f2f627fc640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 0x7f2f5c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.254+0000 7f2f7579b640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 0x7f2f5c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.254+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f2f6c0f00b0 con 0x7f2f70074eb0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.254+0000 7f2f7579b640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 0x7f2f5c0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f7019fad0 tx=0x7f2f6400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:14.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.257+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2f6c0bd270 con 0x7f2f70074eb0 2024-09-15T23:29:14.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.487+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f7019fec0 con 0x7f2f70074eb0 2024-09-15T23:29:14.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.487+0000 7f2f627fc640 1 -- 172.21.15.77:0/1279655823 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7f2f7019fec0 con 0x7f2f70074eb0 2024-09-15T23:29:14.489 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:14.489 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":10,"btime":"2024-09-15T23:29:12:463441+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T23:29:14.489 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 10 2024-09-15T23:29:14.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 msgr2=0x7f2f5c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:14.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 0x7f2f5c0a5780 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2f7019fad0 tx=0x7f2f6400b390 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 msgr2=0x7f2f701a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c004770 tx=0x7f2f6c003c10 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 shutdown_connections 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2f5c0a32c0 0x7f2f5c0a5780 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f70112b90 0x7f2f7019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2f70074eb0 0x7f2f701a4d10 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 --2- 172.21.15.77:0/1279655823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f70074590 0x7f2f701a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 >> 172.21.15.77:0/1279655823 conn(0x7f2f700fd8c0 msgr2=0x7f2f700ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 shutdown_connections 2024-09-15T23:29:14.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:14.489+0000 7f2f779ff640 1 -- 172.21.15.77:0/1279655823 wait complete. 2024-09-15T23:29:14.506 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:14 smithi077 ceph-mon[30968]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:14.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:14 smithi155 ceph-mon[35631]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:14.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:14 smithi159 ceph-mon[35472]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:15.581 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:15 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1279655823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:15.581 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:29:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g[72053]: starting mds.g at 2024-09-15T23:29:15.581 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:29:15 smithi077 bash[72025]: 3f3bf29ec5f74d6e5c0997a92229b5b708982e8132934be0c6ce62f8e549467c 2024-09-15T23:29:15.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:15 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1279655823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:15.866 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:15 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1279655823' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:15.882 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:29:15 smithi077 systemd[1]: Started Ceph mds.g for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:16.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: Deploying daemon mds.a on smithi077 2024-09-15T23:29:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.77:6838/1197951857,v1:172.21.15.77:6839/1197951857] up:boot 2024-09-15T23:29:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: fsmap 10 up:standby 2024-09-15T23:29:16.884 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:16 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: Deploying daemon mds.a on smithi077 2024-09-15T23:29:16.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:16.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.77:6838/1197951857,v1:172.21.15.77:6839/1197951857] up:boot 2024-09-15T23:29:16.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: fsmap 10 up:standby 2024-09-15T23:29:16.966 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:16 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:29:17.040 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:17.040 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:17.040 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:17.040 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: Deploying daemon mds.a on smithi077 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.77:6838/1197951857,v1:172.21.15.77:6839/1197951857] up:boot 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: fsmap 10 up:standby 2024-09-15T23:29:17.041 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:16 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-15T23:29:17.334 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:17.631 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 systemd[1]: Starting Ceph mds.a for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:29:17.883 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 podman[72362]: 2024-09-15 23:29:17.532366565 +0000 UTC m=+0.017177834 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:29:17.883 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 podman[72362]: 2024-09-15 23:29:17.668378304 +0000 UTC m=+0.153189570 container create 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T23:29:18.025 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:18.147 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 podman[72362]: 2024-09-15 23:29:17.886634868 +0000 UTC m=+0.371446147 container init 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:29:18.147 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 podman[72362]: 2024-09-15 23:29:17.889650037 +0000 UTC m=+0.374461305 container start 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T23:29:18.147 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 ceph-mds[72407]: -- 172.21.15.77:0/2413247564 <== mon.0 v2:172.21.15.77:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561a0951d860 con 0x561a094fb400 2024-09-15T23:29:18.148 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a[72401]: starting mds.a at 2024-09-15T23:29:18.148 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 bash[72362]: 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 2024-09-15T23:29:18.148 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:29:17 smithi077 systemd[1]: Started Ceph mds.a for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:29:18.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- 172.21.15.77:0/3358344506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5314102d30 msgr2=0x7f5314103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:18.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 --2- 172.21.15.77:0/3358344506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5314102d30 0x7f5314103110 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f530c009930 tx=0x7f530c02a440 comp rx=0 tx=0).stop 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- 172.21.15.77:0/3358344506 shutdown_connections 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 --2- 172.21.15.77:0/3358344506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141082a0 0x7f531410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 --2- 172.21.15.77:0/3358344506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53141036e0 0x7f5314107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 --2- 172.21.15.77:0/3358344506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5314102d30 0x7f5314103110 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- 172.21.15.77:0/3358344506 >> 172.21.15.77:0/3358344506 conn(0x7f53140fc7d0 msgr2=0x7f53140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- 172.21.15.77:0/3358344506 shutdown_connections 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- 172.21.15.77:0/3358344506 wait complete. 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 Processor -- start 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.513+0000 7f531bf65640 1 -- start start 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 0x7f5314100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141036e0 0x7f5314100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:18.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f53141120e0 con 0x7f53141082a0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5314111f60 con 0x7f53141036e0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531bf65640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5314112260 con 0x7f5314102d30 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40570/0 (socket says 172.21.15.77:40570) 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 -- 172.21.15.77:0/2071071384 learned_addr learned my addr 172.21.15.77:0/2071071384 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f5319500640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141036e0 0x7f5314100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f5319d01640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 0x7f5314100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 -- 172.21.15.77:0/2071071384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 msgr2=0x7f5314100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 0x7f5314100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 -- 172.21.15.77:0/2071071384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141036e0 msgr2=0x7f5314100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141036e0 0x7f5314100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 -- 172.21.15.77:0/2071071384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53141a6ae0 con 0x7f53141082a0 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f5319d01640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 0x7f5314100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:18.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f531a502640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f530400cad0 tx=0x7f530400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.514+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530400ad60 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.515+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53141a6dd0 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.515+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5304005020 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.515+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530400f6b0 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.515+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53141a72e0 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.516+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f531406a850 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.517+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5304005560 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.518+0000 7f5312ffd640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 0x7f52fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.518+0000 7f5319d01640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 0x7f52fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.518+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f53040cf470 con 0x7f53141082a0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.518+0000 7f5319d01640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 0x7f52fc0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096c0 tx=0x7f530c032d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:18.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.522+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f5304014030 con 0x7f53141082a0 2024-09-15T23:29:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.724+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f531402d7c0 con 0x7f53141082a0 2024-09-15T23:29:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.725+0000 7f5312ffd640 1 -- 172.21.15.77:0/2071071384 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8878 (secure 0 0 0) 0x7f530409c630 con 0x7f53141082a0 2024-09-15T23:29:18.727 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:18.727 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":11,"btime":"2024-09-15T23:29:16:477213+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T23:29:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 11 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 msgr2=0x7f52fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 0x7f52fc0a5780 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f530c0096c0 tx=0x7f530c032d50 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 msgr2=0x7f5314101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f530400cad0 tx=0x7f530400ced0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 shutdown_connections 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52fc0a32c0 0x7f52fc0a5780 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f53141082a0 0x7f5314101410 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f53141036e0 0x7f5314100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 --2- 172.21.15.77:0/2071071384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5314102d30 0x7f5314100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:18.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.727+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 >> 172.21.15.77:0/2071071384 conn(0x7f53140fc7d0 msgr2=0x7f5314105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.728+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 shutdown_connections 2024-09-15T23:29:18.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:18.728+0000 7f531bf65640 1 -- 172.21.15.77:0/2071071384 wait complete. 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:19.029 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:18 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2071071384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:19.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:19.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:19.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2071071384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-15T23:29:19.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-15T23:29:19.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:19.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:18 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2071071384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:19 smithi155 ceph-mon[35631]: Deploying daemon mds.b on smithi155 2024-09-15T23:29:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:19 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.77:6840/1286272134,v1:172.21.15.77:6841/1286272134] up:boot 2024-09-15T23:29:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:19 smithi155 ceph-mon[35631]: fsmap 11 up:standby 2024-09-15T23:29:20.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:19 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:29:20.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:19 smithi077 ceph-mon[30968]: Deploying daemon mds.b on smithi155 2024-09-15T23:29:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:19 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.77:6840/1286272134,v1:172.21.15.77:6841/1286272134] up:boot 2024-09-15T23:29:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:19 smithi077 ceph-mon[30968]: fsmap 11 up:standby 2024-09-15T23:29:20.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:19 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:29:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:19 smithi159 ceph-mon[35472]: Deploying daemon mds.b on smithi155 2024-09-15T23:29:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:19 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.77:6840/1286272134,v1:172.21.15.77:6841/1286272134] up:boot 2024-09-15T23:29:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:19 smithi159 ceph-mon[35472]: fsmap 11 up:standby 2024-09-15T23:29:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:19 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:21.357 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:21.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:21 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.155:6838/1912555419,v1:172.21.15.155:6839/1912555419] up:boot 2024-09-15T23:29:21.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:21 smithi159 ceph-mon[35472]: fsmap 12 up:standby 2024-09-15T23:29:21.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:29:21.956 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:21 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:22.022 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:22.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:21 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.155:6838/1912555419,v1:172.21.15.155:6839/1912555419] up:boot 2024-09-15T23:29:22.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:21 smithi077 ceph-mon[30968]: fsmap 12 up:standby 2024-09-15T23:29:22.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:29:22.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:21 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:21 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.155:6838/1912555419,v1:172.21.15.155:6839/1912555419] up:boot 2024-09-15T23:29:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:21 smithi155 ceph-mon[35631]: fsmap 12 up:standby 2024-09-15T23:29:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:29:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:21 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.507+0000 7faf334c3640 1 -- 172.21.15.77:0/1467535225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c102790 msgr2=0x7faf2c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.507+0000 7faf334c3640 1 --2- 172.21.15.77:0/1467535225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c102790 0x7faf2c1067e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faf1c009900 tx=0x7faf1c02a410 comp rx=0 tx=0).stop 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.507+0000 7faf334c3640 1 -- 172.21.15.77:0/1467535225 shutdown_connections 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- 172.21.15.77:0/1467535225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c106f10 0x7faf2c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- 172.21.15.77:0/1467535225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c102790 0x7faf2c1067e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- 172.21.15.77:0/1467535225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c101de0 0x7faf2c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- 172.21.15.77:0/1467535225 >> 172.21.15.77:0/1467535225 conn(0x7faf2c0fd8c0 msgr2=0x7faf2c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- 172.21.15.77:0/1467535225 shutdown_connections 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- 172.21.15.77:0/1467535225 wait complete. 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 Processor -- start 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- start start 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 0x7faf2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c102790 0x7faf2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c111f70 con 0x7faf2c106f10 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c111df0 con 0x7faf2c101de0 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.508+0000 7faf334c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faf2c1120f0 con 0x7faf2c102790 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:22.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40590/0 (socket says 172.21.15.77:40590) 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 -- 172.21.15.77:0/2543921475 learned_addr learned my addr 172.21.15.77:0/2543921475 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf30a5e640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c102790 0x7faf2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf3125f640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 0x7faf2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 -- 172.21.15.77:0/2543921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c102790 msgr2=0x7faf2c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c102790 0x7faf2c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 -- 172.21.15.77:0/2543921475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 msgr2=0x7faf2c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 0x7faf2c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 -- 172.21.15.77:0/2543921475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf2c1a68f0 con 0x7faf2c106f10 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf3125f640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 0x7faf2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf31a60640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf2400eaa0 tx=0x7faf2400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2400cdb0 con 0x7faf2c106f10 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf24005020 con 0x7faf2c106f10 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf2c1a6be0 con 0x7faf2c106f10 2024-09-15T23:29:22.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf240116b0 con 0x7faf2c106f10 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.509+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf2c1a70a0 con 0x7faf2c106f10 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.510+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf2c1021c0 con 0x7faf2c106f10 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.511+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7faf24005560 con 0x7faf2c106f10 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.512+0000 7faf227fc640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 0x7faf180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.512+0000 7faf3125f640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 0x7faf180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.512+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7faf240cfa10 con 0x7faf2c106f10 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.512+0000 7faf3125f640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 0x7faf180a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf28009c20 tx=0x7faf28005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:22.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.515+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7faf24016030 con 0x7faf2c106f10 2024-09-15T23:29:22.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.727+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf2c075a20 con 0x7faf2c106f10 2024-09-15T23:29:22.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.727+0000 7faf227fc640 1 -- 172.21.15.77:0/2543921475 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7faf2c075a20 con 0x7faf2c106f10 2024-09-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":13,"btime":"2024-09-15T23:29:20:855366+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24460,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-15T23:29:22.729 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 13 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 msgr2=0x7faf180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 0x7faf180a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faf28009c20 tx=0x7faf28005f90 comp rx=0 tx=0).stop 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 msgr2=0x7faf2c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7faf2400eaa0 tx=0x7faf2400ef60 comp rx=0 tx=0).stop 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 shutdown_connections 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7faf180a3240 0x7faf180a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faf2c106f10 0x7faf2c074f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf2c102790 0x7faf2c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 --2- 172.21.15.77:0/2543921475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf2c101de0 0x7faf2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 >> 172.21.15.77:0/2543921475 conn(0x7faf2c0fd8c0 msgr2=0x7faf2c0febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 shutdown_connections 2024-09-15T23:29:22.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:22.731+0000 7faf334c3640 1 -- 172.21.15.77:0/2543921475 wait complete. 2024-09-15T23:29:23.083 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:23.083 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.083 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.084 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.084 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.084 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:22 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2543921475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:22 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2543921475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:22 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2543921475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:23.448 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-15T23:29:23.714 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:24.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/3538183726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88101de0 msgr2=0x7f3b881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/3538183726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88101de0 0x7f3b881021c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009ca0 tx=0x7f3b8002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/3538183726 shutdown_connections 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/3538183726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88106f10 0x7f3b8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/3538183726 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 0x7f3b881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/3538183726 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88101de0 0x7f3b881021c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/3538183726 >> 172.21.15.77:0/3538183726 conn(0x7f3b880fd8c0 msgr2=0x7f3b880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/3538183726 shutdown_connections 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/3538183726 wait complete. 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.193+0000 7f3b8d6b3640 1 Processor -- start 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 -- start start 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 0x7f3b880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 0x7f3b88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:24.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3b88111f70 con 0x7f3b88106f10 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3b88111df0 con 0x7f3b88101de0 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b8d6b3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b881120f0 con 0x7f3b88102790 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40608/0 (socket says 172.21.15.77:40608) 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 -- 172.21.15.77:0/2063972447 learned_addr learned my addr 172.21.15.77:0/2063972447 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b86ffd640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 0x7f3b880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b867fc640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 0x7f3b88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 -- 172.21.15.77:0/2063972447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 msgr2=0x7f3b88074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 0x7f3b88074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 -- 172.21.15.77:0/2063972447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 msgr2=0x7f3b880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 0x7f3b880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 -- 172.21.15.77:0/2063972447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b881a6930 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b86ffd640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 0x7f3b880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.194+0000 7f3b877fe640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c970 tx=0x7f3b7800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.195+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78007bb0 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.195+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b881a6c20 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.195+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b78007d50 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.195+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800f450 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.195+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b881a7110 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.196+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b881021c0 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.197+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3b78004f00 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.197+0000 7f3b7ffff640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 0x7f3b740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.198+0000 7f3b86ffd640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 0x7f3b740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.198+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f3b780cf500 con 0x7f3b88106f10 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.198+0000 7f3b86ffd640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 0x7f3b740a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009ca0 tx=0x7f3b80000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:24.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.201+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3b78014030 con 0x7f3b88106f10 2024-09-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.381+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3b88075a20 con 0x7f3b88106f10 2024-09-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi077.stdout:[ 2024-09-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:29:24.383 INFO:teuthology.orchestra.run.smithi077.stdout: "poolnum": 1, 2024-09-15T23:29:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: "poolname": ".mgr" 2024-09-15T23:29:24.384 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:29:24.384 INFO:teuthology.orchestra.run.smithi077.stdout:] 2024-09-15T23:29:24.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.382+0000 7f3b7ffff640 1 -- 172.21.15.77:0/2063972447 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) ==== 84+0+65 (secure 0 0 0) 0x7f3b7809c6c0 con 0x7f3b88106f10 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 msgr2=0x7f3b740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 0x7f3b740a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3b80009ca0 tx=0x7f3b80000f40 comp rx=0 tx=0).stop 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 msgr2=0x7f3b88074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c970 tx=0x7f3b7800ce30 comp rx=0 tx=0).stop 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 shutdown_connections 2024-09-15T23:29:24.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3b740a3240 0x7f3b740a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3b88106f10 0x7f3b88074f70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b88102790 0x7f3b88074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 --2- 172.21.15.77:0/2063972447 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b88101de0 0x7f3b880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 >> 172.21.15.77:0/2063972447 conn(0x7f3b880fd8c0 msgr2=0x7f3b880fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 shutdown_connections 2024-09-15T23:29:24.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:24.384+0000 7f3b8d6b3640 1 -- 172.21.15.77:0/2063972447 wait complete. 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:24.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:24 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2063972447' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:29:24.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:24.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2063972447' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:24.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2063972447' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-15T23:29:25.726 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T23:29:25.726 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T23:29:26.002 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:26 smithi077 ceph-mon[30968]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:26 smithi159 ceph-mon[35472]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 -- 172.21.15.77:0/4147773180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e68102d30 msgr2=0x7f9e68103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 --2- 172.21.15.77:0/4147773180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e68102d30 0x7f9e68103110 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009930 tx=0x7f9e5802a420 comp rx=0 tx=0).stop 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 -- 172.21.15.77:0/4147773180 shutdown_connections 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 --2- 172.21.15.77:0/4147773180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e681082a0 0x7f9e6810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 --2- 172.21.15.77:0/4147773180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 --2- 172.21.15.77:0/4147773180 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e68102d30 0x7f9e68103110 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 -- 172.21.15.77:0/4147773180 >> 172.21.15.77:0/4147773180 conn(0x7f9e680fc7d0 msgr2=0x7f9e680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:26.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 -- 172.21.15.77:0/4147773180 shutdown_connections 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.476+0000 7f9e6e990640 1 -- 172.21.15.77:0/4147773180 wait complete. 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 Processor -- start 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 -- start start 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e68102d30 0x7f9e68198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68198ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e68112120 con 0x7f9e681082a0 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e68111fa0 con 0x7f9e68102d30 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6e990640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9e681122a0 con 0x7f9e681036e0 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6cf2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6cf2d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40626/0 (socket says 172.21.15.77:40626) 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.477+0000 7f9e6cf2d640 1 -- 172.21.15.77:0/2192527069 learned_addr learned my addr 172.21.15.77:0/2192527069 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:26.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e67fff640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e68102d30 0x7f9e68198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e677fe640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68198ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 -- 172.21.15.77:0/2192527069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 msgr2=0x7f9e68198ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68198ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 -- 172.21.15.77:0/2192527069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e68102d30 msgr2=0x7f9e68198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e68102d30 0x7f9e68198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 -- 172.21.15.77:0/2192527069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6819d610 con 0x7f9e681082a0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e677fe640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6cf2d640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000b970 tx=0x7f9e6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60019070 con 0x7f9e681082a0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6819d900 con 0x7f9e681082a0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e6000cb40 con 0x7f9e681082a0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e60007650 con 0x7f9e681082a0 2024-09-15T23:29:26.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.478+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e681a51e0 con 0x7f9e681082a0 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.479+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6806a850 con 0x7f9e681082a0 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.480+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9e6001c070 con 0x7f9e681082a0 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.481+0000 7f9e657fa640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.481+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7127+0+0 (secure 0 0 0) 0x7f9e600cea60 con 0x7f9e681082a0 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.481+0000 7f9e67fff640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:26.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.482+0000 7f9e67fff640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 0x7f9e500a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009900 tx=0x7f9e580058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:26.608 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.485+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e6009b5d0 con 0x7f9e681082a0 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:26.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:26 smithi155 ceph-mon[35631]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:26.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:26.663+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9e6810a2b0 con 0x7f9e681082a0 2024-09-15T23:29:27.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.669+0000 7f9e657fa640 1 -- 172.21.15.77:0/2192527069 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) ==== 138+0+0 (secure 0 0 0) 0x7f9e600cce20 con 0x7f9e681082a0 2024-09-15T23:29:27.671 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' created 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.671+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 msgr2=0x7f9e500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.671+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 0x7f9e500a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009900 tx=0x7f9e580058d0 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.671+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 msgr2=0x7f9e6819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.671+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9e6000b970 tx=0x7f9e6000be30 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 shutdown_connections 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e500a3240 0x7f9e500a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e681082a0 0x7f9e6819cf30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e681036e0 0x7f9e68198ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 --2- 172.21.15.77:0/2192527069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e68102d30 0x7f9e68198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 >> 172.21.15.77:0/2192527069 conn(0x7f9e680fc7d0 msgr2=0x7f9e68105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:27.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 shutdown_connections 2024-09-15T23:29:27.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:27.672+0000 7f9e6e990640 1 -- 172.21.15.77:0/2192527069 wait complete. 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:27.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:29:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:27.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:29:27.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:29:28.337 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T23:29:28.586 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:28.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:28 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:29:28.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:28 smithi159 ceph-mon[35472]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:29:28.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:28 smithi159 ceph-mon[35472]: pgmap v275: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:28.995 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:28 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:29:28.996 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:28 smithi077 ceph-mon[30968]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:29:28.996 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:28 smithi077 ceph-mon[30968]: pgmap v275: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 -- 172.21.15.77:0/1514369952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc100a60 msgr2=0x7fc3fc100ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 --2- 172.21.15.77:0/1514369952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc100a60 0x7fc3fc100ec0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009930 tx=0x7fc3e402a420 comp rx=0 tx=0).stop 2024-09-15T23:29:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 -- 172.21.15.77:0/1514369952 shutdown_connections 2024-09-15T23:29:29.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 --2- 172.21.15.77:0/1514369952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc101400 0x7fc3fc10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 --2- 172.21.15.77:0/1514369952 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc100a60 0x7fc3fc100ec0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 --2- 172.21.15.77:0/1514369952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc106a60 0x7fc3fc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 -- 172.21.15.77:0/1514369952 >> 172.21.15.77:0/1514369952 conn(0x7fc3fc0fc780 msgr2=0x7fc3fc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 -- 172.21.15.77:0/1514369952 shutdown_connections 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.082+0000 7fc401130640 1 -- 172.21.15.77:0/1514369952 wait complete. 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.083+0000 7fc401130640 1 Processor -- start 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.083+0000 7fc401130640 1 -- start start 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc100a60 0x7fc3fc197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 0x7fc3fc197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc110e20 con 0x7fc3fc101400 2024-09-15T23:29:29.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc110ca0 con 0x7fc3fc100a60 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3fc110fa0 con 0x7fc3fc106a60 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56234/0 (socket says 172.21.15.77:56234) 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 -- 172.21.15.77:0/2034491191 learned_addr learned my addr 172.21.15.77:0/2034491191 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fad9d640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc100a60 0x7fc3fc197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fb59e640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 0x7fc3fc197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 -- 172.21.15.77:0/2034491191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 msgr2=0x7fc3fc197bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 0x7fc3fc197bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 -- 172.21.15.77:0/2034491191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc100a60 msgr2=0x7fc3fc197130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc100a60 0x7fc3fc197130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 -- 172.21.15.77:0/2034491191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3fc1a69a0 con 0x7fc3fc101400 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fb59e640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 0x7fc3fc197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3fa59c640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009230 tx=0x7fc3e4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e403f030 con 0x7fc3fc101400 2024-09-15T23:29:29.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3fc1a6c30 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3e4003ad0 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4035070 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.084+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3fc1a7110 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.085+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3fc100ec0 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.087+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc3e4042030 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.087+0000 7fc3f3fff640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.087+0000 7fc3fad9d640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.088+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7497+0+0 (secure 0 0 0) 0x7fc3e40efe90 con 0x7fc3fc101400 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.088+0000 7fc3fad9d640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 0x7fc3e80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00bb60 tx=0x7fc3ec00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:29.107 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.091+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc3e40bcee0 con 0x7fc3fc101400 2024-09-15T23:29:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:28 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2192527069' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-15T23:29:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:28 smithi155 ceph-mon[35631]: osdmap e79: 12 total, 12 up, 12 in 2024-09-15T23:29:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:28 smithi155 ceph-mon[35631]: pgmap v275: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:29.256 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.255+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc3fc02d7c0 con 0x7fc3fc101400 2024-09-15T23:29:29.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.684+0000 7fc3f3fff640 1 -- 172.21.15.77:0/2034491191 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v81) ==== 171+0+0 (secure 0 0 0) 0x7fc3e40bc7e0 con 0x7fc3fc101400 2024-09-15T23:29:29.686 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' created 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 msgr2=0x7fc3e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 0x7fc3e80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec00bb60 tx=0x7fc3ec00b390 comp rx=0 tx=0).stop 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 msgr2=0x7fc3fc197670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3e4009230 tx=0x7fc3e4004270 comp rx=0 tx=0).stop 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 shutdown_connections 2024-09-15T23:29:29.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc3e80a3240 0x7fc3e80a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc3fc106a60 0x7fc3fc197bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc3fc101400 0x7fc3fc197670 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 --2- 172.21.15.77:0/2034491191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3fc100a60 0x7fc3fc197130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 >> 172.21.15.77:0/2034491191 conn(0x7fc3fc0fc780 msgr2=0x7fc3fc0fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 shutdown_connections 2024-09-15T23:29:29.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:29.687+0000 7fc401130640 1 -- 172.21.15.77:0/2034491191 wait complete. 2024-09-15T23:29:29.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:29 smithi159 ceph-mon[35472]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:29.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:29 smithi159 ceph-mon[35472]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:29:29.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:29 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T23:29:30.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:29 smithi077 ceph-mon[30968]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:30.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:29 smithi077 ceph-mon[30968]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:29:30.075 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:29 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T23:29:30.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:29 smithi155 ceph-mon[35631]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:30.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:29 smithi155 ceph-mon[35631]: osdmap e80: 12 total, 12 up, 12 in 2024-09-15T23:29:30.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:29 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-09-15T23:29:30.364 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T23:29:30.612 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:30 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T23:29:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:30 smithi159 ceph-mon[35472]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:29:30.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:30 smithi159 ceph-mon[35472]: pgmap v278: 97 pgs: 1 creating+activating, 9 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:30.995 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:30 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T23:29:30.995 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:30 smithi077 ceph-mon[30968]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:29:30.995 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:30 smithi077 ceph-mon[30968]: pgmap v278: 97 pgs: 1 creating+activating, 9 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:30 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2034491191' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-15T23:29:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:30 smithi155 ceph-mon[35631]: osdmap e81: 12 total, 12 up, 12 in 2024-09-15T23:29:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:30 smithi155 ceph-mon[35631]: pgmap v278: 97 pgs: 1 creating+activating, 9 creating+peering, 9 active+clean, 78 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1245171960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 msgr2=0x7fdd8810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1245171960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8810eaa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdd80009ca0 tx=0x7fdd8002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1245171960 shutdown_connections 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1245171960 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8810eaa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1245171960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd881027a0 0x7fdd881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1245171960 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd88101df0 0x7fdd881021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1245171960 >> 172.21.15.77:0/1245171960 conn(0x7fdd880fd8f0 msgr2=0x7fdd880ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1245171960 shutdown_connections 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.076+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1245171960 wait complete. 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 Processor -- start 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 -- start start 2024-09-15T23:29:31.121 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd88101df0 0x7fdd88198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 0x7fdd88198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdd88112020 con 0x7fdd88106f20 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdd88111ea0 con 0x7fdd88101df0 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd8de4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdd881121a0 con 0x7fdd881027a0 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56262/0 (socket says 172.21.15.77:56262) 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 -- 172.21.15.77:0/1004953215 learned_addr learned my addr 172.21.15.77:0/1004953215 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd877fe640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd88101df0 0x7fdd88198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd7effd640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 0x7fdd88198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 -- 172.21.15.77:0/1004953215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 msgr2=0x7fdd88198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 0x7fdd88198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 -- 172.21.15.77:0/1004953215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd88101df0 msgr2=0x7fdd88198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd88101df0 0x7fdd88198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd87fff640 1 -- 172.21.15.77:0/1004953215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8819d4d0 con 0x7fdd88106f20 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.077+0000 7fdd7effd640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 0x7fdd88198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd87fff640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd80031a60 tx=0x7fdd80031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80003b70 con 0x7fdd88106f20 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdd80003d10 con 0x7fdd88106f20 2024-09-15T23:29:31.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8819d760 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd80004770 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.078+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd881a50a0 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.079+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd88102250 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.080+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdd8002f790 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.081+0000 7fdd857fa640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 0x7fdd740a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.081+0000 7fdd877fe640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 0x7fdd740a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.081+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 7879+0+0 (secure 0 0 0) 0x7fdd800f0c70 con 0x7fdd88106f20 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.081+0000 7fdd877fe640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 0x7fdd740a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009990 tx=0x7fdd78009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:31.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.084+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdd800bdb40 con 0x7fdd88106f20 2024-09-15T23:29:31.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.285+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdd88199880 con 0x7fdd88106f20 2024-09-15T23:29:31.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.693+0000 7fdd857fa640 1 -- 172.21.15.77:0/1004953215 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fdd88199880 con 0x7fdd88106f20 2024-09-15T23:29:31.694 INFO:teuthology.orchestra.run.smithi077.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 msgr2=0x7fdd740a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 0x7fdd740a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009990 tx=0x7fdd78009110 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 msgr2=0x7fdd8819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdd80031a60 tx=0x7fdd80031a90 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 shutdown_connections 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdd740a3240 0x7fdd740a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdd88106f20 0x7fdd8819cdf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd881027a0 0x7fdd88198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 --2- 172.21.15.77:0/1004953215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdd88101df0 0x7fdd88198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.695+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 >> 172.21.15.77:0/1004953215 conn(0x7fdd880fd8f0 msgr2=0x7fdd880fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.696+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 shutdown_connections 2024-09-15T23:29:31.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:31.696+0000 7fdd8de4b640 1 -- 172.21.15.77:0/1004953215 wait complete. 2024-09-15T23:29:31.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:31 smithi159 ceph-mon[35472]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:29:31.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:31 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:29:31.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:31 smithi159 ceph-mon[35472]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T23:29:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:31 smithi155 ceph-mon[35631]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:29:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:31 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:29:32.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:31 smithi155 ceph-mon[35631]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T23:29:32.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:31 smithi077 ceph-mon[30968]: osdmap e82: 12 total, 12 up, 12 in 2024-09-15T23:29:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:31 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-15T23:29:32.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:31 smithi077 ceph-mon[30968]: daemon mds.i assigned to filesystem cephfs as rank 0 2024-09-15T23:29:32.502 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T23:29:32.502 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T23:29:32.747 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:32 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:29:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:32 smithi077 ceph-mon[30968]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:29:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:32 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T23:29:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:32 smithi077 ceph-mon[30968]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T23:29:32.868 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:32 smithi077 ceph-mon[30968]: pgmap v281: 97 pgs: 1 creating+activating, 37 creating+peering, 28 active+clean, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:32 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:29:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:32 smithi159 ceph-mon[35472]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:29:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:32 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T23:29:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:32 smithi159 ceph-mon[35472]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T23:29:32.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:32 smithi159 ceph-mon[35472]: pgmap v281: 97 pgs: 1 creating+activating, 37 creating+peering, 28 active+clean, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:32 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1004953215' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-15T23:29:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:32 smithi155 ceph-mon[35631]: osdmap e83: 12 total, 12 up, 12 in 2024-09-15T23:29:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:32 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:creating} 11 up:standby 2024-09-15T23:29:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:32 smithi155 ceph-mon[35631]: daemon mds.i is now active in filesystem cephfs as rank 0 2024-09-15T23:29:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:32 smithi155 ceph-mon[35631]: pgmap v281: 97 pgs: 1 creating+activating, 37 creating+peering, 28 active+clean, 31 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/1340576493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 msgr2=0x7f2bec1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/1340576493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec1029b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2be0009900 tx=0x7f2be002a480 comp rx=0 tx=0).stop 2024-09-15T23:29:33.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/1340576493 shutdown_connections 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/1340576493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/1340576493 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec1029b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/1340576493 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 0x7f2bec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/1340576493 >> 172.21.15.77:0/1340576493 conn(0x7f2bec0fc7d0 msgr2=0x7f2bec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/1340576493 shutdown_connections 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.246+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/1340576493 wait complete. 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 Processor -- start 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 -- start start 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 0x7f2bec1975a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec19be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec111020 con 0x7f2bec102570 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec110ea0 con 0x7f2bec102ef0 2024-09-15T23:29:33.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bf0ad3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2bec1111a0 con 0x7f2bec100e20 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56282/0 (socket says 172.21.15.77:56282) 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 -- 172.21.15.77:0/3406495061 learned_addr learned my addr 172.21.15.77:0/3406495061 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 -- 172.21.15.77:0/3406495061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 msgr2=0x7f2bec1975a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bea59c640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 0x7f2bec1975a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bead9d640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec19be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 0x7f2bec1975a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 -- 172.21.15.77:0/3406495061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 msgr2=0x7f2bec19be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec19be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2be9d9b640 1 -- 172.21.15.77:0/3406495061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bec19c550 con 0x7f2bec102570 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.247+0000 7f2bead9d640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:33.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2be9d9b640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0003c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be003f070 con 0x7f2bec102570 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2be0031e30 con 0x7f2bec102570 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bec19c7e0 con 0x7f2bec102570 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be0035030 con 0x7f2bec102570 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.248+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bec1a4120 con 0x7f2bec102570 2024-09-15T23:29:33.253 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.249+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bec1021b0 con 0x7f2bec102570 2024-09-15T23:29:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.250+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2be0042070 con 0x7f2bec102570 2024-09-15T23:29:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.251+0000 7f2bdb7fe640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 0x7f2bd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.251+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 7979+0+0 (secure 0 0 0) 0x7f2be00f07b0 con 0x7f2bec102570 2024-09-15T23:29:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.251+0000 7f2bea59c640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 0x7f2bd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:33.254 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.251+0000 7f2bea59c640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 0x7f2bd40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00a810 tx=0x7f2bdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:33.255 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.254+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2be00bd6b0 con 0x7f2bec102570 2024-09-15T23:29:33.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.427+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f2bec109090 con 0x7f2bec102570 2024-09-15T23:29:33.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.715+0000 7f2bdb7fe640 1 -- 172.21.15.77:0/3406495061 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v84) ==== 157+0+0 (secure 0 0 0) 0x7f2be00bcfb0 con 0x7f2bec102570 2024-09-15T23:29:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.718+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 msgr2=0x7f2bd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:33.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.718+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 0x7f2bd40a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00a810 tx=0x7f2bdc008040 comp rx=0 tx=0).stop 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.718+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 msgr2=0x7f2bec197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.718+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2be0006010 tx=0x7f2be0003c80 comp rx=0 tx=0).stop 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 shutdown_connections 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2bd40a3240 0x7f2bd40a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bec102ef0 0x7f2bec19be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2bec102570 0x7f2bec197ae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 --2- 172.21.15.77:0/3406495061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2bec100e20 0x7f2bec1975a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 >> 172.21.15.77:0/3406495061 conn(0x7f2bec0fc7d0 msgr2=0x7f2bec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 shutdown_connections 2024-09-15T23:29:33.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:33.719+0000 7f2bf0ad3640 1 -- 172.21.15.77:0/3406495061 wait complete. 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: Cluster is now healthy 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:active 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:33.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:33 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: Cluster is now healthy 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:active 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:34.026 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:33 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: Cluster is now healthy 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] up:active 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:34.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:33 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-09-15T23:29:34.363 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T23:29:34.609 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:34.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:34 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T23:29:34.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:34 smithi077 ceph-mon[30968]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:29:34.997 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:34 smithi077 ceph-mon[30968]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 58 active+clean, 10 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 5 op/s 2024-09-15T23:29:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 -- 172.21.15.77:0/1649524047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30102790 msgr2=0x7f1b301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1649524047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30102790 0x7f1b301067e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009900 tx=0x7f1b2002a410 comp rx=0 tx=0).stop 2024-09-15T23:29:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 -- 172.21.15.77:0/1649524047 shutdown_connections 2024-09-15T23:29:35.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1649524047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b30106f10 0x7f1b3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1649524047 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30102790 0x7f1b301067e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1649524047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30101de0 0x7f1b301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 -- 172.21.15.77:0/1649524047 >> 172.21.15.77:0/1649524047 conn(0x7f1b300fd8c0 msgr2=0x7f1b300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 -- 172.21.15.77:0/1649524047 shutdown_connections 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.084+0000 7f1b384dc640 1 -- 172.21.15.77:0/1649524047 wait complete. 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 Processor -- start 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 -- start start 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 0x7f1b30074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b30106f10 0x7f1b30074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30111f90 con 0x7f1b30101de0 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30111e10 con 0x7f1b30102790 2024-09-15T23:29:35.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b384dc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1b30112110 con 0x7f1b30106f10 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56290/0 (socket says 172.21.15.77:56290) 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 -- 172.21.15.77:0/1578559765 learned_addr learned my addr 172.21.15.77:0/1578559765 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b35a77640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 0x7f1b30074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 -- 172.21.15.77:0/1578559765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b30106f10 msgr2=0x7f1b30074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b30106f10 0x7f1b30074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 -- 172.21.15.77:0/1578559765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 msgr2=0x7f1b30074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 0x7f1b30074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 -- 172.21.15.77:0/1578559765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b301a68e0 con 0x7f1b30101de0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b35a77640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 0x7f1b30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.085+0000 7f1b36278640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c920 tx=0x7f1b2c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.086+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c007c70 con 0x7f1b30101de0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.086+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b301a6bd0 con 0x7f1b30101de0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.086+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1b2c007e10 con 0x7f1b30101de0 2024-09-15T23:29:35.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.086+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c018890 con 0x7f1b30101de0 2024-09-15T23:29:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.086+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b301a7110 con 0x7f1b30101de0 2024-09-15T23:29:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.087+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b301021c0 con 0x7f1b30101de0 2024-09-15T23:29:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.088+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1b2c018a50 con 0x7f1b30101de0 2024-09-15T23:29:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.089+0000 7f1b277fe640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 0x7f1b1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:35.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.089+0000 7f1b35a77640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 0x7f1b1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.089+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8277+0+0 (secure 0 0 0) 0x7f1b2c0cfd70 con 0x7f1b30101de0 2024-09-15T23:29:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.089+0000 7f1b35a77640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 0x7f1b1c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b30075f80 tx=0x7f1b20005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:35.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.092+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1b2c014030 con 0x7f1b30101de0 2024-09-15T23:29:35.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:34 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T23:29:35.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:34 smithi155 ceph-mon[35631]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:29:35.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:34 smithi155 ceph-mon[35631]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 58 active+clean, 10 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 5 op/s 2024-09-15T23:29:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:34 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3406495061' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-15T23:29:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:34 smithi159 ceph-mon[35472]: osdmap e84: 12 total, 12 up, 12 in 2024-09-15T23:29:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:34 smithi159 ceph-mon[35472]: pgmap v283: 97 pgs: 1 creating+activating, 28 creating+peering, 58 active+clean, 10 unknown; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 249 B/s wr, 5 op/s 2024-09-15T23:29:35.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:35.260+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f1b30075a20 con 0x7f1b30101de0 2024-09-15T23:29:36.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:35 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:29:36.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:35 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:29:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:35 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-15T23:29:36.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.738+0000 7f1b277fe640 1 -- 172.21.15.77:0/1578559765 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v86) ==== 228+0+0 (secure 0 0 0) 0x7f1b2c09caf0 con 0x7f1b30101de0 2024-09-15T23:29:36.739 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' created 2024-09-15T23:29:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.741+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 msgr2=0x7f1b1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.741+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 0x7f1b1c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1b30075f80 tx=0x7f1b20005a20 comp rx=0 tx=0).stop 2024-09-15T23:29:36.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.741+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 msgr2=0x7f1b300744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:36.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.741+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c00c920 tx=0x7f1b2c00cde0 comp rx=0 tx=0).stop 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 shutdown_connections 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1b1c0a3240 0x7f1b1c0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b30106f10 0x7f1b30074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1b30102790 0x7f1b30074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 --2- 172.21.15.77:0/1578559765 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1b30101de0 0x7f1b300744f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:36.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.743+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 >> 172.21.15.77:0/1578559765 conn(0x7f1b300fd8c0 msgr2=0x7f1b300fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:36.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.747+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 shutdown_connections 2024-09-15T23:29:36.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:36.747+0000 7f1b384dc640 1 -- 172.21.15.77:0/1578559765 wait complete. 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T23:29:37.004 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T23:29:37.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T23:29:37.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T23:29:37.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-09-15T23:29:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: pgmap v285: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-15T23:29:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: osdmap e85: 12 total, 12 up, 12 in 2024-09-15T23:29:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-15T23:29:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-15T23:29:37.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]: dispatch 2024-09-15T23:29:37.380 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T23:29:37.636 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:37.748 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: 2024-09-15T23:29:37.476+0000 7f07051a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-09-15T23:29:38.005 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:37 smithi077 ceph-mon[30968]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T23:29:38.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-09-15T23:29:38.115 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:37 smithi155 ceph-mon[35631]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:29:38.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1578559765' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-15T23:29:38.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [8, 11]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 9]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 6]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.37", "id": [5, 7]}]': finished 2024-09-15T23:29:38.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:37 smithi159 ceph-mon[35472]: osdmap e86: 12 total, 12 up, 12 in 2024-09-15T23:29:38.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 -- 172.21.15.77:0/2922501153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102570 msgr2=0x7f369c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:38.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 --2- 172.21.15.77:0/2922501153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102570 0x7f369c1029b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3690009900 tx=0x7f369002a480 comp rx=0 tx=0).stop 2024-09-15T23:29:38.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 -- 172.21.15.77:0/2922501153 shutdown_connections 2024-09-15T23:29:38.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 --2- 172.21.15.77:0/2922501153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102ef0 0x7f369c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 --2- 172.21.15.77:0/2922501153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102570 0x7f369c1029b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 --2- 172.21.15.77:0/2922501153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 0x7f369c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 -- 172.21.15.77:0/2922501153 >> 172.21.15.77:0/2922501153 conn(0x7f369c0fc7d0 msgr2=0x7f369c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 -- 172.21.15.77:0/2922501153 shutdown_connections 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 -- 172.21.15.77:0/2922501153 wait complete. 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.200+0000 7f36a35d0640 1 Processor -- start 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 -- start start 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 0x7f369c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102570 0x7f369c10ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:38.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f369c112060 con 0x7f369c102ef0 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f369c111ee0 con 0x7f369c100e20 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a35d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f369c1121e0 con 0x7f369c102570 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48804/0 (socket says 172.21.15.77:48804) 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 -- 172.21.15.77:0/607906502 learned_addr learned my addr 172.21.15.77:0/607906502 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a136c640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 0x7f369c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a0b6b640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102570 0x7f369c10ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 -- 172.21.15.77:0/607906502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102570 msgr2=0x7f369c10ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102570 0x7f369c10ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 -- 172.21.15.77:0/607906502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 msgr2=0x7f369c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 0x7f369c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 -- 172.21.15.77:0/607906502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c1a68c0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.201+0000 7f36a1b6d640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f369400cce0 tx=0x7f369400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.202+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369400f450 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.202+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f369400fad0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.202+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f369c1a6bb0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.202+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3694018c10 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.202+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f369c1a70a0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.203+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f369c101200 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.204+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f369400f5f0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.205+0000 7f368e7fc640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 0x7f36880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.205+0000 7f36a136c640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 0x7f36880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.205+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9002+0+0 (secure 0 0 0) 0x7f36940d02b0 con 0x7f369c102ef0 2024-09-15T23:29:38.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.205+0000 7f36a136c640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 0x7f36880a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3698005e10 tx=0x7f3698005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:38.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.208+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3694014030 con 0x7f369c102ef0 2024-09-15T23:29:38.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.380+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f369c10fa00 con 0x7f369c102ef0 2024-09-15T23:29:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.751+0000 7f368e7fc640 1 -- 172.21.15.77:0/607906502 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v88) ==== 169+0+0 (secure 0 0 0) 0x7f369409ce00 con 0x7f369c102ef0 2024-09-15T23:29:38.753 INFO:teuthology.orchestra.run.smithi077.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 msgr2=0x7f36880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 0x7f36880a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3698005e10 tx=0x7f3698005da0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 msgr2=0x7f369c10ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f369400cce0 tx=0x7f369400a620 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 shutdown_connections 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f36880a3240 0x7f36880a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f369c102ef0 0x7f369c10ef50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f369c102570 0x7f369c10ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 --2- 172.21.15.77:0/607906502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f369c100e20 0x7f369c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.754+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 >> 172.21.15.77:0/607906502 conn(0x7f369c0fc7d0 msgr2=0x7f369c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.755+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 shutdown_connections 2024-09-15T23:29:38.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:38.755+0000 7f36a35d0640 1 -- 172.21.15.77:0/607906502 wait complete. 2024-09-15T23:29:39.069 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:38 smithi077 ceph-mon[30968]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:29:39.069 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:38 smithi077 ceph-mon[30968]: pgmap v288: 129 pgs: 3 creating+peering, 29 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-15T23:29:39.069 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:38 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T23:29:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:38 smithi155 ceph-mon[35631]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:29:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:38 smithi155 ceph-mon[35631]: pgmap v288: 129 pgs: 3 creating+peering, 29 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-15T23:29:39.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:38 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T23:29:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:38 smithi159 ceph-mon[35472]: osdmap e87: 12 total, 12 up, 12 in 2024-09-15T23:29:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:38 smithi159 ceph-mon[35472]: pgmap v288: 129 pgs: 3 creating+peering, 29 unknown, 97 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s wr, 5 op/s 2024-09-15T23:29:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:38 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-09-15T23:29:39.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T23:29:39.677 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:39 smithi155 ceph-mon[35631]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:39 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T23:29:40.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:39 smithi155 ceph-mon[35631]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:29:40.115 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:39 smithi077 ceph-mon[30968]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:40.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:39 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T23:29:40.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:39 smithi077 ceph-mon[30968]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:29:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:39 smithi159 ceph-mon[35472]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-15T23:29:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:39 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/607906502' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-15T23:29:40.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:39 smithi159 ceph-mon[35472]: osdmap e88: 12 total, 12 up, 12 in 2024-09-15T23:29:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 -- 172.21.15.77:0/1862020011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890100310 msgr2=0x7f58901006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:40.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 --2- 172.21.15.77:0/1862020011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890100310 0x7f58901006f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5880009900 tx=0x7f588002a410 comp rx=0 tx=0).stop 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 -- 172.21.15.77:0/1862020011 shutdown_connections 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 --2- 172.21.15.77:0/1862020011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890106f30 0x7f589010eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 --2- 172.21.15.77:0/1862020011 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 0x7f5890106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 --2- 172.21.15.77:0/1862020011 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890100310 0x7f58901006f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 -- 172.21.15.77:0/1862020011 >> 172.21.15.77:0/1862020011 conn(0x7f5890077210 msgr2=0x7f58900fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 -- 172.21.15.77:0/1862020011 shutdown_connections 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.197+0000 7f589598d640 1 -- 172.21.15.77:0/1862020011 wait complete. 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 Processor -- start 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 -- start start 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890100310 0x7f5890198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 0x7f5890198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5890111fd0 con 0x7f5890106f30 2024-09-15T23:29:40.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5890111e50 con 0x7f5890100310 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f589598d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5890112150 con 0x7f5890100cc0 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f588f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f588f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48830/0 (socket says 172.21.15.77:48830) 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f588f7fe640 1 -- 172.21.15.77:0/1791095143 learned_addr learned my addr 172.21.15.77:0/1791095143 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.198+0000 7f5887fff640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 0x7f5890198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588effd640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890100310 0x7f5890198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 -- 172.21.15.77:0/1791095143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 msgr2=0x7f5890198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 0x7f5890198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 -- 172.21.15.77:0/1791095143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890100310 msgr2=0x7f5890198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890100310 0x7f5890198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 -- 172.21.15.77:0/1791095143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589019d4e0 con 0x7f5890106f30 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f588f7fe640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f588800b970 tx=0x7f588800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:40.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888019070 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f589019d7d0 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f588800cb40 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5888007650 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.199+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58901a50b0 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.200+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58901006f0 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.201+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f588801c070 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.202+0000 7f589498b640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 0x7f587c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.202+0000 7f588effd640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 0x7f587c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.203+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9002+0+0 (secure 0 0 0) 0x7f58880cf200 con 0x7f5890106f30 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.203+0000 7f588effd640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 0x7f587c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5880005ab0 tx=0x7f5880005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:40.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.207+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f588809b5d0 con 0x7f5890106f30 2024-09-15T23:29:40.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.410+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f589002d7c0 con 0x7f5890106f30 2024-09-15T23:29:40.756 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.754+0000 7f589498b640 1 -- 172.21.15.77:0/1791095143 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f588809f8d0 con 0x7f5890106f30 2024-09-15T23:29:40.756 INFO:teuthology.orchestra.run.smithi077.stderr:added data pool 4 to fsmap 2024-09-15T23:29:40.758 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 msgr2=0x7f587c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 0x7f587c0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5880005ab0 tx=0x7f5880005a20 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 msgr2=0x7f589019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f588800b970 tx=0x7f588800be30 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 shutdown_connections 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f587c0a3240 0x7f587c0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5890106f30 0x7f589019ce00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5890100cc0 0x7f5890198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 --2- 172.21.15.77:0/1791095143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5890100310 0x7f5890198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 >> 172.21.15.77:0/1791095143 conn(0x7f5890077210 msgr2=0x7f5890105820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:40.759 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 shutdown_connections 2024-09-15T23:29:40.760 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:40.757+0000 7f589598d640 1 -- 172.21.15.77:0/1791095143 wait complete. 2024-09-15T23:29:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:40 smithi155 ceph-mon[35631]: pgmap v290: 129 pgs: 1 creating+activating, 3 creating+peering, 19 unknown, 106 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-15T23:29:41.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:40 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T23:29:41.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:40 smithi077 ceph-mon[30968]: pgmap v290: 129 pgs: 1 creating+activating, 3 creating+peering, 19 unknown, 106 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-15T23:29:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:40 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T23:29:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:40 smithi159 ceph-mon[35472]: pgmap v290: 129 pgs: 1 creating+activating, 3 creating+peering, 19 unknown, 106 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-15T23:29:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:40 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-09-15T23:29:41.490 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:41.737 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:42.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:41 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T23:29:42.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:41 smithi155 ceph-mon[35631]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:29:42.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:41 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:42.123 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:41 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T23:29:42.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:41 smithi077 ceph-mon[30968]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:29:42.124 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:41 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:41 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1791095143' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-15T23:29:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:41 smithi159 ceph-mon[35472]: osdmap e89: 12 total, 12 up, 12 in 2024-09-15T23:29:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:41 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 -- 172.21.15.77:0/453832369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748101de0 msgr2=0x7f17481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 --2- 172.21.15.77:0/453832369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748101de0 0x7f17481021c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1738009900 tx=0x7f173802a410 comp rx=0 tx=0).stop 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 -- 172.21.15.77:0/453832369 shutdown_connections 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 --2- 172.21.15.77:0/453832369 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748106f10 0x7f174810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 --2- 172.21.15.77:0/453832369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748102790 0x7f17481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 --2- 172.21.15.77:0/453832369 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748101de0 0x7f17481021c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 -- 172.21.15.77:0/453832369 >> 172.21.15.77:0/453832369 conn(0x7f17480fd8c0 msgr2=0x7f17480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 -- 172.21.15.77:0/453832369 shutdown_connections 2024-09-15T23:29:42.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.201+0000 7f174e3a9640 1 -- 172.21.15.77:0/453832369 wait complete. 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.202+0000 7f174e3a9640 1 Processor -- start 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.202+0000 7f174e3a9640 1 -- start start 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748101de0 0x7f1748198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748102790 0x7f1748198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1748111f70 con 0x7f1748106f10 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1748111df0 con 0x7f1748101de0 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17481120f0 con 0x7f1748102790 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48846/0 (socket says 172.21.15.77:48846) 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f1747fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748101de0 0x7f1748198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 -- 172.21.15.77:0/46404694 learned_addr learned my addr 172.21.15.77:0/46404694 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:42.217 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f17477fe640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748102790 0x7f1748198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 -- 172.21.15.77:0/46404694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748102790 msgr2=0x7f1748198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748102790 0x7f1748198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 -- 172.21.15.77:0/46404694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748101de0 msgr2=0x7f1748198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748101de0 0x7f1748198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 -- 172.21.15.77:0/46404694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174819d400 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174c946640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f174000eaa0 tx=0x7f174000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174000cdb0 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174819d6f0 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1740005020 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17400116b0 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.203+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17481a4fd0 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.205+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17481021c0 con 0x7f1748106f10 2024-09-15T23:29:42.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.206+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1740005560 con 0x7f1748106f10 2024-09-15T23:29:42.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.206+0000 7f17457fa640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 0x7f17300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:42.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.206+0000 7f1747fff640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 0x7f17300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:42.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.206+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f17400cfd90 con 0x7f1748106f10 2024-09-15T23:29:42.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.207+0000 7f1747fff640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 0x7f17300a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1738009230 tx=0x7f17380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:42.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.210+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1740016030 con 0x7f1748106f10 2024-09-15T23:29:42.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.415+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f174802d7c0 con 0x7f1748106f10 2024-09-15T23:29:42.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.416+0000 7f17457fa640 1 -- 172.21.15.77:0/46404694 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f174009c140 con 0x7f1748106f10 2024-09-15T23:29:42.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:42.417 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"btime":"2024-09-15T23:29:40:753883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:29:40.411708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:29:42.418 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-09-15T23:29:42.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 msgr2=0x7f17300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 0x7f17300a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1738009230 tx=0x7f17380058d0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 msgr2=0x7f174819cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f174000eaa0 tx=0x7f174000ef60 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 shutdown_connections 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17300a3240 0x7f17300a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1748106f10 0x7f174819cd20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1748102790 0x7f1748198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 --2- 172.21.15.77:0/46404694 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1748101de0 0x7f1748198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 >> 172.21.15.77:0/46404694 conn(0x7f17480fd8c0 msgr2=0x7f17480fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 shutdown_connections 2024-09-15T23:29:42.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:42.418+0000 7f174e3a9640 1 -- 172.21.15.77:0/46404694 wait complete. 2024-09-15T23:29:43.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:42 smithi077 ceph-mon[30968]: pgmap v292: 129 pgs: 1 creating+activating, 3 creating+peering, 125 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:43.113 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/46404694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:43.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:42 smithi155 ceph-mon[35631]: pgmap v292: 129 pgs: 1 creating+activating, 3 creating+peering, 125 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:43.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:42 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/46404694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:43.141 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:29:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:42 smithi159 ceph-mon[35472]: pgmap v292: 129 pgs: 1 creating+activating, 3 creating+peering, 125 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:42 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/46404694' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:43.384 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 -- 172.21.15.77:0/407621841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028100a80 msgr2=0x7f7028100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 --2- 172.21.15.77:0/407621841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028100a80 0x7f7028100ee0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7018009930 tx=0x7f701802a420 comp rx=0 tx=0).stop 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 -- 172.21.15.77:0/407621841 shutdown_connections 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 --2- 172.21.15.77:0/407621841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028101420 0x7f702810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 --2- 172.21.15.77:0/407621841 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028100a80 0x7f7028100ee0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 --2- 172.21.15.77:0/407621841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028106a80 0x7f7028106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 -- 172.21.15.77:0/407621841 >> 172.21.15.77:0/407621841 conn(0x7f70280fc7a0 msgr2=0x7f70280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 -- 172.21.15.77:0/407621841 shutdown_connections 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.871+0000 7f7030363640 1 -- 172.21.15.77:0/407621841 wait complete. 2024-09-15T23:29:43.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 Processor -- start 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 -- start start 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028100a80 0x7f7028197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028106a80 0x7f702819bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7028110ea0 con 0x7f7028101420 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7028110d20 con 0x7f7028106a80 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f7030363640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7028111020 con 0x7f7028100a80 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48868/0 (socket says 172.21.15.77:48868) 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 -- 172.21.15.77:0/3751508513 learned_addr learned my addr 172.21.15.77:0/3751508513 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702e0ff640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028100a80 0x7f7028197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 -- 172.21.15.77:0/3751508513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028100a80 msgr2=0x7f7028197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:43.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028100a80 0x7f7028197320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702e900640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028106a80 0x7f702819bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 -- 172.21.15.77:0/3751508513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028106a80 msgr2=0x7f702819bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028106a80 0x7f702819bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 -- 172.21.15.77:0/3751508513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702819c2d0 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.872+0000 7f702d8fe640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7018009a50 tx=0x7f7018004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.873+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f701803f030 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.873+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7018003ce0 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.873+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018035070 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.873+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702819c560 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.873+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70281a3ea0 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.874+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7028100ee0 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.875+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7018042030 con 0x7f7028101420 2024-09-15T23:29:43.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.875+0000 7f701f7fe640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:43.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.876+0000 7f702e0ff640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:43.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.876+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f70180f06d0 con 0x7f7028101420 2024-09-15T23:29:43.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.876+0000 7f702e0ff640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 0x7f70140a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f702400ba40 tx=0x7f7024005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:43.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:43.878+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f70180bd0d0 con 0x7f7028101420 2024-09-15T23:29:44.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.047+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70281a4070 con 0x7f7028101420 2024-09-15T23:29:44.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:43 smithi077 ceph-mon[30968]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T23:29:44.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:43 smithi077 ceph-mon[30968]: Cluster is now healthy 2024-09-15T23:29:44.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.049+0000 7f701f7fe640 1 -- 172.21.15.77:0/3751508513 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f70180bc9d0 con 0x7f7028101420 2024-09-15T23:29:44.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:44.050 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:29:44.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 msgr2=0x7f70140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:44.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 0x7f70140a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f702400ba40 tx=0x7f7024005cc0 comp rx=0 tx=0).stop 2024-09-15T23:29:44.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 msgr2=0x7f7028197860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:44.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7018009a50 tx=0x7f7018004270 comp rx=0 tx=0).stop 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 shutdown_connections 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f70140a3240 0x7f70140a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7028106a80 0x7f702819bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7028101420 0x7f7028197860 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 --2- 172.21.15.77:0/3751508513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7028100a80 0x7f7028197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.051+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 >> 172.21.15.77:0/3751508513 conn(0x7f70280fc7a0 msgr2=0x7f70280fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.052+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 shutdown_connections 2024-09-15T23:29:44.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:44.052+0000 7f7030363640 1 -- 172.21.15.77:0/3751508513 wait complete. 2024-09-15T23:29:44.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:43 smithi155 ceph-mon[35631]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T23:29:44.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:43 smithi155 ceph-mon[35631]: Cluster is now healthy 2024-09-15T23:29:44.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:43 smithi159 ceph-mon[35472]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-09-15T23:29:44.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:43 smithi159 ceph-mon[35472]: Cluster is now healthy 2024-09-15T23:29:44.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:29:44.941 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:45.062 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:44 smithi077 ceph-mon[30968]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:45.062 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:44 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3751508513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:44 smithi155 ceph-mon[35631]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:45.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:44 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3751508513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:45.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:44 smithi159 ceph-mon[35472]: pgmap v293: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:45.116 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:44 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3751508513' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:45.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 -- 172.21.15.77:0/2742440023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 msgr2=0x7fef08106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 --2- 172.21.15.77:0/2742440023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef08106e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fef00009cd0 tx=0x7fef0002a8e0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 -- 172.21.15.77:0/2742440023 shutdown_connections 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 --2- 172.21.15.77:0/2742440023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 0x7fef0810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 --2- 172.21.15.77:0/2742440023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 0x7fef08100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 --2- 172.21.15.77:0/2742440023 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef08106e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 -- 172.21.15.77:0/2742440023 >> 172.21.15.77:0/2742440023 conn(0x7fef080fc7a0 msgr2=0x7fef080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 -- 172.21.15.77:0/2742440023 shutdown_connections 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.404+0000 7fef105a8640 1 -- 172.21.15.77:0/2742440023 wait complete. 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 Processor -- start 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 -- start start 2024-09-15T23:29:45.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 0x7fef081972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 0x7fef08197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fef08110e80 con 0x7fef08106a80 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef08110d00 con 0x7fef08101420 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef105a8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fef08111000 con 0x7fef08100a80 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef0eb45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef0eb45640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48884/0 (socket says 172.21.15.77:48884) 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef0eb45640 1 -- 172.21.15.77:0/1338775921 learned_addr learned my addr 172.21.15.77:0/1338775921 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef0e344640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 0x7fef081972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.405+0000 7fef0db43640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 0x7fef08197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 -- 172.21.15.77:0/1338775921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 msgr2=0x7fef081972e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:45.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 0x7fef081972e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 -- 172.21.15.77:0/1338775921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 msgr2=0x7fef08197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 0x7fef08197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 -- 172.21.15.77:0/1338775921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0819c290 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef0eb45640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c970 tx=0x7fef0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04007bb0 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef04007d50 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0819c580 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef04018800 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.406+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef081a3e60 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.407+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef08100ee0 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.408+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fef0400fa50 con 0x7fef08106a80 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.409+0000 7feeff7fe640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 0x7feef40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.409+0000 7fef0e344640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 0x7feef40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:45.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.409+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fef040cfb80 con 0x7fef08106a80 2024-09-15T23:29:45.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.409+0000 7fef0e344640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 0x7feef40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef00006010 tx=0x7fef00009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:45.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.413+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fef04014030 con 0x7fef08106a80 2024-09-15T23:29:45.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.579+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef08108a60 con 0x7fef08106a80 2024-09-15T23:29:45.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.581+0000 7feeff7fe640 1 -- 172.21.15.77:0/1338775921 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7fef0409c580 con 0x7fef08106a80 2024-09-15T23:29:45.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:45.583 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:29:45.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 msgr2=0x7feef40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:45.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 0x7feef40a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fef00006010 tx=0x7fef00009360 comp rx=0 tx=0).stop 2024-09-15T23:29:45.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 msgr2=0x7fef0819bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fef0400c970 tx=0x7fef0400ce30 comp rx=0 tx=0).stop 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 shutdown_connections 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feef40a3240 0x7feef40a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fef08106a80 0x7fef0819bbb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef08101420 0x7fef08197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 --2- 172.21.15.77:0/1338775921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fef08100a80 0x7fef081972e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 >> 172.21.15.77:0/1338775921 conn(0x7fef080fc7a0 msgr2=0x7fef080fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 shutdown_connections 2024-09-15T23:29:45.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:45.583+0000 7fef105a8640 1 -- 172.21.15.77:0/1338775921 wait complete. 2024-09-15T23:29:45.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:45 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1338775921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:46.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:45 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1338775921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:46.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:45 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1338775921' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:46.384 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:29:46.634 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:47.095 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:46 smithi077 ceph-mon[30968]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:47.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:46 smithi155 ceph-mon[35631]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:47.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 -- 172.21.15.77:0/3319638451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 msgr2=0x7f3608101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 --2- 172.21.15.77:0/3319638451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f3608101200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009900 tx=0x7f35f802a480 comp rx=0 tx=0).stop 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 -- 172.21.15.77:0/3319638451 shutdown_connections 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 --2- 172.21.15.77:0/3319638451 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102ef0 0x7f360810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 --2- 172.21.15.77:0/3319638451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102570 0x7f36081029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 --2- 172.21.15.77:0/3319638451 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f3608101200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 -- 172.21.15.77:0/3319638451 >> 172.21.15.77:0/3319638451 conn(0x7f36080fc7d0 msgr2=0x7f36080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 -- 172.21.15.77:0/3319638451 shutdown_connections 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 -- 172.21.15.77:0/3319638451 wait complete. 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.172+0000 7f360d3ff640 1 Processor -- start 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 -- start start 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102570 0x7f3608199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 0x7f36081a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:47.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3608110f80 con 0x7f3608100e20 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3608110e00 con 0x7f3608102570 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f360d3ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3608111100 con 0x7f3608102ef0 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41444/0 (socket says 172.21.15.77:41444) 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 -- 172.21.15.77:0/1632949826 learned_addr learned my addr 172.21.15.77:0/1632949826 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f36067fc640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102570 0x7f3608199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f36077fe640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 0x7f36081a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 -- 172.21.15.77:0/1632949826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 msgr2=0x7f36081a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 0x7f36081a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 -- 172.21.15.77:0/1632949826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102570 msgr2=0x7f3608199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102570 0x7f3608199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f3606ffd640 1 -- 172.21.15.77:0/1632949826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36081a4990 con 0x7f3608100e20 2024-09-15T23:29:47.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.173+0000 7f36077fe640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 0x7f36081a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f3606ffd640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35f8006010 tx=0x7f35f8003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f803f070 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f8031c30 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36081a4b60 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8035030 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.174+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36081a4fb0 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.175+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608101200 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.176+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f35f8042070 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.177+0000 7f35fffff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.177+0000 7f36067fc640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.177+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f35f80f07f0 con 0x7f3608100e20 2024-09-15T23:29:47.181 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.177+0000 7f36067fc640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 0x7f35f40a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f360806aac0 tx=0x7f35f000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:47.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.180+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f35f80bd1f0 con 0x7f3608100e20 2024-09-15T23:29:47.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:46 smithi159 ceph-mon[35472]: pgmap v294: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.380+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3608109090 con 0x7f3608100e20 2024-09-15T23:29:47.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.380+0000 7f35fffff640 1 -- 172.21.15.77:0/1632949826 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11851 (secure 0 0 0) 0x7f35f80bcaf0 con 0x7f3608100e20 2024-09-15T23:29:47.382 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:47.382 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"btime":"2024-09-15T23:29:40:753883+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24455,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:29:40.411708+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:29:47.382 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 17 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.382+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 msgr2=0x7f35f40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.382+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 0x7f35f40a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f360806aac0 tx=0x7f35f000a250 comp rx=0 tx=0).stop 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.382+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 msgr2=0x7f36081993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.382+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f35f8006010 tx=0x7f35f8003c10 comp rx=0 tx=0).stop 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 shutdown_connections 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f35f40a3240 0x7f35f40a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3608102ef0 0x7f36081a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3608102570 0x7f3608199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 --2- 172.21.15.77:0/1632949826 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3608100e20 0x7f36081993d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 >> 172.21.15.77:0/1632949826 conn(0x7f36080fc7d0 msgr2=0x7f36080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 shutdown_connections 2024-09-15T23:29:47.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:47.383+0000 7f360d3ff640 1 -- 172.21.15.77:0/1632949826 wait complete. 2024-09-15T23:29:48.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:47 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1632949826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:48.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:47 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1632949826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:48.120 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:29:48.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:47 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1632949826' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:29:48.363 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.857+0000 7fd585b6f640 1 -- 172.21.15.77:0/850959472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5801082a0 msgr2=0x7fd58010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 --2- 172.21.15.77:0/850959472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5801082a0 0x7fd58010ec40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd578009cd0 tx=0x7fd57802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 -- 172.21.15.77:0/850959472 shutdown_connections 2024-09-15T23:29:48.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 --2- 172.21.15.77:0/850959472 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd5801082a0 0x7fd58010ec40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 --2- 172.21.15.77:0/850959472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 0x7fd580107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 --2- 172.21.15.77:0/850959472 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd580102d30 0x7fd580103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 -- 172.21.15.77:0/850959472 >> 172.21.15.77:0/850959472 conn(0x7fd5800fc7d0 msgr2=0x7fd5800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 -- 172.21.15.77:0/850959472 shutdown_connections 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 -- 172.21.15.77:0/850959472 wait complete. 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 Processor -- start 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.858+0000 7fd585b6f640 1 -- start start 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 0x7fd580198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5801082a0 0x7fd58019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd5801120a0 con 0x7fd580102d30 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd580111f20 con 0x7fd5801036e0 2024-09-15T23:29:48.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd585b6f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd580112220 con 0x7fd5801082a0 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41462/0 (socket says 172.21.15.77:41462) 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 -- 172.21.15.77:0/986601527 learned_addr learned my addr 172.21.15.77:0/986601527 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57ffff640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5801082a0 0x7fd58019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd577fff640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 0x7fd580198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 -- 172.21.15.77:0/986601527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5801082a0 msgr2=0x7fd58019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5801082a0 0x7fd58019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 -- 172.21.15.77:0/986601527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 msgr2=0x7fd580198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 0x7fd580198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 -- 172.21.15.77:0/986601527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58019d500 con 0x7fd580102d30 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57f7fe640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd57000d950 tx=0x7fd57000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.859+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd570017030 con 0x7fd580102d30 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.860+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd58019d7f0 con 0x7fd580102d30 2024-09-15T23:29:48.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.860+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd570004020 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.860+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5700047a0 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.860+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5801a50d0 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.861+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd580103110 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.862+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd5700041d0 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.862+0000 7fd57d7fa640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 0x7fd56c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.863+0000 7fd577fff640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 0x7fd56c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.863+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fd5700cf4e0 con 0x7fd580102d30 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.863+0000 7fd577fff640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 0x7fd56c0a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5800fedf0 tx=0x7fd56800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:48.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:48.867+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd57009bee0 con 0x7fd580102d30 2024-09-15T23:29:49.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.035+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5801998b0 con 0x7fd580102d30 2024-09-15T23:29:49.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:48 smithi077 ceph-mon[30968]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:49.037 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.036+0000 7fd57d7fa640 1 -- 172.21.15.77:0/986601527 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7fd57009b7e0 con 0x7fd580102d30 2024-09-15T23:29:49.038 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:49.038 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 msgr2=0x7fd56c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 0x7fd56c0a5780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd5800fedf0 tx=0x7fd56800b390 comp rx=0 tx=0).stop 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 msgr2=0x7fd580198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd57000d950 tx=0x7fd57000de10 comp rx=0 tx=0).stop 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 shutdown_connections 2024-09-15T23:29:49.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd56c0a32c0 0x7fd56c0a5780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5801082a0 0x7fd58019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5801036e0 0x7fd580198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 --2- 172.21.15.77:0/986601527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd580102d30 0x7fd580198550 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 >> 172.21.15.77:0/986601527 conn(0x7fd5800fc7d0 msgr2=0x7fd580105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 shutdown_connections 2024-09-15T23:29:49.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:49.039+0000 7fd585b6f640 1 -- 172.21.15.77:0/986601527 wait complete. 2024-09-15T23:29:49.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:48 smithi155 ceph-mon[35631]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:48 smithi159 ceph-mon[35472]: pgmap v295: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:49.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T23:29:31.287245+0000', 'modified': '2024-09-15T23:29:40.411708+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.159:6839/2481115545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 2481115545}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 2481115545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24460, 'qdb_cluster': [24460]} 2024-09-15T23:29:49.755 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:29:49.755 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T23:29:50.005 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:50.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:49 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/986601527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:50.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:49 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/986601527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:50.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:49 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/986601527' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:29:50.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 -- 172.21.15.77:0/1124022210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9410c150 msgr2=0x7f4b9410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 --2- 172.21.15.77:0/1124022210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9410c150 0x7f4b9410e5f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009ca0 tx=0x7f4b8c02a950 comp rx=0 tx=0).stop 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 -- 172.21.15.77:0/1124022210 shutdown_connections 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 --2- 172.21.15.77:0/1124022210 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b9410c150 0x7f4b9410e5f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 --2- 172.21.15.77:0/1124022210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 0x7f4b9410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 --2- 172.21.15.77:0/1124022210 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b94102d20 0x7f4b94103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 -- 172.21.15.77:0/1124022210 >> 172.21.15.77:0/1124022210 conn(0x7f4b940fc780 msgr2=0x7f4b940feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 -- 172.21.15.77:0/1124022210 shutdown_connections 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.468+0000 7f4b9b663640 1 -- 172.21.15.77:0/1124022210 wait complete. 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 Processor -- start 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 -- start start 2024-09-15T23:29:50.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 0x7f4b94198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 0x7f4b9419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4b94111f50 con 0x7f4b94102d20 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4b94111dd0 con 0x7f4b9410c150 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b9b663640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4b941120d0 con 0x7f4b94103640 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b993ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b993ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41478/0 (socket says 172.21.15.77:41478) 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b993ff640 1 -- 172.21.15.77:0/828537805 learned_addr learned my addr 172.21.15.77:0/828537805 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b99c00640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 0x7f4b9419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.469+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 0x7f4b94198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 -- 172.21.15.77:0/828537805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 msgr2=0x7f4b94198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 0x7f4b94198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 -- 172.21.15.77:0/828537805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 msgr2=0x7f4b9419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 0x7f4b9419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 -- 172.21.15.77:0/828537805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9419d3d0 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b99c00640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 0x7f4b9419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b993ff640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d950 tx=0x7f4b9000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b8a7fc640 1 -- 172.21.15.77:0/828537805 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b90017070 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9419d6c0 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b8a7fc640 1 -- 172.21.15.77:0/828537805 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b90009c30 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b8a7fc640 1 -- 172.21.15.77:0/828537805 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b9000f6b0 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.470+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b941a4fa0 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.472+0000 7f4b8a7fc640 1 -- 172.21.15.77:0/828537805 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4b900109d0 con 0x7f4b94102d20 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 Processor -- start 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 -- start start 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b8a7fc640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 0x7f4b800a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf26dddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561cf2644090 con 0x561cf26e8bb0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf25eba70 con 0x561cf26de2f0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561cf2640050 con 0x561cf26dd9d0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b99c00640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 0x7f4b800a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b8a7fc640 1 -- 172.21.15.77:0/828537805 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f4b900cf8f0 con 0x7f4b94102d20 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41490/0 (socket says 172.21.15.77:41490) 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b99c00640 1 -- 172.21.15.77:0/4003498478 learned_addr learned my addr 172.21.15.77:0/4003498478 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.473+0000 7f4b993ff640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf26dddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 -- 172.21.15.77:0/4003498478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 msgr2=0x561cf26dddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf26dddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 -- 172.21.15.77:0/4003498478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 msgr2=0x561cf26e8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 -- 172.21.15.77:0/4003498478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf25f8130 con 0x561cf26e8bb0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b993ff640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf26dddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 0x7f4b800a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c035000 tx=0x7f4b8c009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b99c00640 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c02af30 tx=0x7f4b8c047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d591799cad4be9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b7f7fe640 1 -- 172.21.15.77:0/4003498478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c04d070 con 0x561cf26e8bb0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b7f7fe640 1 -- 172.21.15.77:0/4003498478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8c003d40 con 0x561cf26e8bb0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.474+0000 7f4b7f7fe640 1 -- 172.21.15.77:0/4003498478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c034040 con 0x561cf26e8bb0 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- 172.21.15.77:0/4003498478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 msgr2=0x561cf26eafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c02af30 tx=0x7f4b8c047000 comp rx=0 tx=0).stop 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- 172.21.15.77:0/4003498478 shutdown_connections 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26eafa0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/4003498478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf26dddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- 172.21.15.77:0/4003498478 >> 172.21.15.77:0/4003498478 conn(0x561cf26d9f60 msgr2=0x561cf26da340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- 172.21.15.77:0/4003498478 shutdown_connections 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- 172.21.15.77:0/4003498478 wait complete. 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- start start 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 Processor -- start 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26e8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e5780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561cf26efb90 con 0x561cf26e8bb0 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf25fef20 con 0x561cf26dd9d0 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.475+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561cf26efd10 con 0x561cf26de2f0 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b9da3c740 10 client.0 _ll_register_callbacks cb 0x561cf25c8030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:29:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41492/0 (socket says 172.21.15.77:41492) 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 -- 172.21.15.77:0/664112073 learned_addr learned my addr 172.21.15.77:0/664112073 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b993ff640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26e8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 -- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 msgr2=0x561cf26e5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 -- 172.21.15.77:0/664112073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 msgr2=0x561cf26e8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26e8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 -- 172.21.15.77:0/664112073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf23b52b0 con 0x561cf26e8bb0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b99c00640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009ca0 tx=0x7f4b8c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e834560de750ec4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c044040 con 0x561cf26e8bb0 2024-09-15T23:29:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f4b8c0497e0 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8c003d40 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4b8c04d040 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b9da3c740 10 client.14703 fetch_fsmap learned FSMap version 17 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x561cf26fb4f0 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.476+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8c003d40 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4b8c052640 con 0x561cf26e8bb0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 10 client.14703 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 10 client.14703 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 20 client.14703 populate_metadata read hostname 'smithi077' 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf26fd750 0x561cf26febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 4 client.14703 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561cf2651600 con 0x561cf26fd750 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.477+0000 7f4b993ff640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf26fd750 0x561cf26febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.478+0000 7f4b7cff9640 10 client.14703 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:29:50.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.478+0000 7f4b993ff640 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf26fd750 0x561cf26febc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff0e3a8b0215e4f0 server_cookie=86ced118ccca5067 in_seq=0 out_seq=0 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.478+0000 7f4b7cff9640 1 -- 172.21.15.77:0/664112073 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561cf2651600 con 0x561cf26fd750 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.478+0000 7f4b7cff9640 10 client.14703 handle_command_reply: tid=0 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.478+0000 7f4b9da3c740 1 client.14703 shutdown 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 msgr2=0x561cf26e5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009ca0 tx=0x7f4b8c0043b0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 shutdown_connections 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf26fd750 0x561cf26febc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e5cc0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b7cff9640 0 client.14703 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/664112073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26e8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 >> 172.21.15.77:0/664112073 conn(0x561cf26d9f60 msgr2=0x561cf26dfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 shutdown_connections 2024-09-15T23:29:50.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 1 -- 172.21.15.77:0/664112073 wait complete. 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.479+0000 7f4b9da3c740 20 client.14703 trim_cache size 0 max 16384 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 Processor -- start 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 -- start start 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26fde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561cf26fcf00 con 0x561cf26e8bb0 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf26fd5d0 con 0x561cf26dd9d0 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561cf26fdca0 con 0x561cf26de2f0 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41498/0 (socket says 172.21.15.77:41498) 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 -- 172.21.15.77:0/1247941153 learned_addr learned my addr 172.21.15.77:0/1247941153 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b993ff640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26fde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 -- 172.21.15.77:0/1247941153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 msgr2=0x561cf26e4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 -- 172.21.15.77:0/1247941153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 msgr2=0x561cf26fde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26fde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b99c00640 1 -- 172.21.15.77:0/1247941153 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561cf26e4770 con 0x561cf26e8bb0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b993ff640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26fde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.496+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b99c00640 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c02ae70 tx=0x7f4b8c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5516cfe745c742 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b7effd640 1 -- 172.21.15.77:0/1247941153 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c004760 con 0x561cf26e8bb0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b7effd640 1 -- 172.21.15.77:0/1247941153 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8c004420 con 0x561cf26e8bb0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b7effd640 1 -- 172.21.15.77:0/1247941153 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c049ae0 con 0x561cf26e8bb0 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 -- 172.21.15.77:0/1247941153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 msgr2=0x561cf26e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c02ae70 tx=0x7f4b8c009b20 comp rx=0 tx=0).stop 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 -- 172.21.15.77:0/1247941153 shutdown_connections 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26de2f0 0x561cf26e4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/1247941153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26dd9d0 0x561cf26fde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 -- 172.21.15.77:0/1247941153 >> 172.21.15.77:0/1247941153 conn(0x561cf26d9f60 msgr2=0x561cf26e0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 -- 172.21.15.77:0/1247941153 shutdown_connections 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.497+0000 7f4b9da3c740 1 -- 172.21.15.77:0/1247941153 wait complete. 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 -- start start 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 Processor -- start 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf2707700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561cf26fea40 con 0x561cf26e8bb0 2024-09-15T23:29:50.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561cf26fe370 con 0x561cf26de2f0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561cf26ff110 con 0x561cf26dd9d0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b9da3c740 10 client.0 _ll_register_callbacks cb 0x7f4b9406b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b99c00640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41508/0 (socket says 172.21.15.77:41508) 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b99c00640 1 -- 172.21.15.77:0/3706965423 learned_addr learned my addr 172.21.15.77:0/3706965423 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b98bfe640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.498+0000 7f4b993ff640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf2707700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 -- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 msgr2=0x561cf2707700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf2707700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 -- 172.21.15.77:0/3706965423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 msgr2=0x561cf26e2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 -- 172.21.15.77:0/3706965423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561cf2705220 con 0x561cf26e8bb0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b993ff640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf2707700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b99c00640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c005e30 tx=0x7f4b8c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c8887a3fce8a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:50.527 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c034030 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f4b8c052450 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4b8c004420 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f4b8c07a050 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 10 client.14709 fetch_fsmap learned FSMap version 17 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x561cf2767f20 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4b8c004420 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f4b8c070030 con 0x561cf26e8bb0 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 10 client.14709 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 10 client.14709 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.499+0000 7f4b9da3c740 20 client.14709 populate_metadata read hostname 'smithi077' 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf276c690 0x561cf276b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:50.528 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b9da3c740 4 client.14709 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "status"}) -- 0x561cf264bb10 con 0x561cf276c690 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b993ff640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf276c690 0x561cf276b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b7cff9640 10 client.14709 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b993ff640 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf276c690 0x561cf276b3a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90a22915c9e88243 server_cookie=9aae9f4691fd8816 in_seq=0 out_seq=0 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b7cff9640 1 -- 172.21.15.77:0/3706965423 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561cf264bb10 con 0x561cf276c690 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b7cff9640 10 client.14709 handle_command_reply: tid=0 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.500+0000 7f4b9da3c740 1 client.14709 shutdown 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 msgr2=0x561cf26e2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c005e30 tx=0x7f4b8c005fd0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 shutdown_connections 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561cf276c690 0x561cf276b3a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561cf26e8bb0 0x561cf26e2ed0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561cf26de2f0 0x561cf26e2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.529 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 --2- 172.21.15.77:0/3706965423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561cf26dd9d0 0x561cf2707700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 >> 172.21.15.77:0/3706965423 conn(0x561cf26d9f60 msgr2=0x561cf26e0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b7cff9640 0 client.14709 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 shutdown_connections 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 1 -- 172.21.15.77:0/3706965423 wait complete. 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9da3c740 20 client.14709 trim_cache size 0 max 16384 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:29:50.530 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24460, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 18.805989179000001, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 17, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 89, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 88, 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 38.562567868000002 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 msgr2=0x7f4b800a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.531 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 0x7f4b800a5700 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c035000 tx=0x7f4b8c009880 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 msgr2=0x7f4b94198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4b9000d950 tx=0x7f4b9000de10 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 shutdown_connections 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4b800a3240 0x7f4b800a5700 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4b9410c150 0x7f4b9419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b94103640 0x7f4b94198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 --2- 172.21.15.77:0/828537805 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4b94102d20 0x7f4b94198420 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 >> 172.21.15.77:0/828537805 conn(0x7f4b940fc780 msgr2=0x7f4b940fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 shutdown_connections 2024-09-15T23:29:50.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:50.501+0000 7f4b9b663640 1 -- 172.21.15.77:0/828537805 wait complete. 2024-09-15T23:29:51.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:50 smithi155 ceph-mon[35631]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:51.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:50 smithi077 ceph-mon[30968]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:51.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:50 smithi159 ceph-mon[35472]: pgmap v296: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-09-15T23:29:51.225 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:29:51.226 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:51.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T23:29:51.469 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 -- 172.21.15.77:0/2853025287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa158102da0 msgr2=0x7fa158103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 --2- 172.21.15.77:0/2853025287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa158102da0 0x7fa158103180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fa150009900 tx=0x7fa15002a480 comp rx=0 tx=0).stop 2024-09-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 -- 172.21.15.77:0/2853025287 shutdown_connections 2024-09-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 --2- 172.21.15.77:0/2853025287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa15810c180 0x7fa15810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:51.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 --2- 172.21.15.77:0/2853025287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1581036c0 0x7fa15810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 --2- 172.21.15.77:0/2853025287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa158102da0 0x7fa158103180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 -- 172.21.15.77:0/2853025287 >> 172.21.15.77:0/2853025287 conn(0x7fa1580fc7a0 msgr2=0x7fa1580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 -- 172.21.15.77:0/2853025287 shutdown_connections 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 -- 172.21.15.77:0/2853025287 wait complete. 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.936+0000 7fa160302640 1 Processor -- start 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 -- start start 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158102da0 0x7fa1581985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 0x7fa15819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa158112020 con 0x7fa1581036c0 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa158111ea0 con 0x7fa158102da0 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa160302640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa1581121a0 con 0x7fa15810c180 2024-09-15T23:29:51.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41524/0 (socket says 172.21.15.77:41524) 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 -- 172.21.15.77:0/443869782 learned_addr learned my addr 172.21.15.77:0/443869782 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15e89f640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 0x7fa15819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15e09e640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158102da0 0x7fa1581985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 -- 172.21.15.77:0/443869782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 msgr2=0x7fa15819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 0x7fa15819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 -- 172.21.15.77:0/443869782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158102da0 msgr2=0x7fa1581985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158102da0 0x7fa1581985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 -- 172.21.15.77:0/443869782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15819d550 con 0x7fa1581036c0 2024-09-15T23:29:51.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15e89f640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 0x7fa15819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.937+0000 7fa15d89d640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b4a0 tx=0x7fa14c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.938+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c014070 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.938+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa14c010af0 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.938+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c017d10 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.938+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15819d840 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.938+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1581a5120 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.939+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa158103200 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.940+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa14c017070 con 0x7fa1581036c0 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.940+0000 7fa1577fe640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 0x7fa1400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:51.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.941+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fa14c0cf4c0 con 0x7fa1581036c0 2024-09-15T23:29:51.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.941+0000 7fa15e09e640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 0x7fa1400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:51.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.941+0000 7fa15e09e640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 0x7fa1400a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa1500096c0 tx=0x7fa150000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:51.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:51.944+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa14c09bec0 con 0x7fa1581036c0 2024-09-15T23:29:52.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.150+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa158199900 con 0x7fa1581036c0 2024-09-15T23:29:52.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.150+0000 7fa1577fe640 1 -- 172.21.15.77:0/443869782 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7fa158199900 con 0x7fa1581036c0 2024-09-15T23:29:52.152 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:29:52.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 msgr2=0x7fa1400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 0x7fa1400a5700 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa1500096c0 tx=0x7fa150000bc0 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 msgr2=0x7fa158198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa14c00b4a0 tx=0x7fa14c00b960 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 shutdown_connections 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1400a3240 0x7fa1400a5700 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa15810c180 0x7fa15819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa1581036c0 0x7fa158198ae0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 --2- 172.21.15.77:0/443869782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa158102da0 0x7fa1581985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 >> 172.21.15.77:0/443869782 conn(0x7fa1580fc7a0 msgr2=0x7fa1580fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:52.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 shutdown_connections 2024-09-15T23:29:52.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52.152+0000 7fa160302640 1 -- 172.21.15.77:0/443869782 wait complete. 2024-09-15T23:29:52.827 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:52 smithi077 ceph-mon[30968]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:52.827 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:52 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/443869782' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:52.857 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T23:29:52.859 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:29:52.859 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:29:52.859 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T23:29:52.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:52.860 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-15T23:29:52.863 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:52 smithi155 ceph-mon[35631]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:52.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:52 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/443869782' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-15T23:29:52.876 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:29:52.877 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42290sec preferred_lft 42290sec 2024-09-15T23:29:52.878 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-15T23:29:52.878 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:29:52.878 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:29:52.879 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:29:52.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:29:52.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:52 smithi159 ceph-mon[35472]: pgmap v297: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:52.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:52 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/443869782' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:29:53.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:53.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:53.106 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:29:53.130 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-15T23:29:53.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:53.132 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-15T23:29:53.209 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-15T23:29:53.210 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:29:53.210 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:29:53.210 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:29:53.210 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:29:53.210 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:29:53.210 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:29:53.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:29:53.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:29:53.211 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:29:53.211 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:29:53.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:29:53.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:53.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:53.511 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-15T23:29:53.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:53.527 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-15T23:29:53.582 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:29:53.582 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:29:53.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:53.582 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T23:29:53.582 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:29:53.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:29:53.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:53.700 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T23:29:53.700 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:29:53.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:29:53.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:53.824 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:29:53.824 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:29:53.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-09-15T23:29:53.824 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:29:53.824 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:29:53.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:29:53.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:53.901 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T23:29:53.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:29:53.901 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:53.917 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T23:29:53.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:29:53.917 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:53.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-15T23:29:54.038 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:29:54.095 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-15T23:29:54.095 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-15T23:29:54.095 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-15T23:29:54.095 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-15T23:29:54.096 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-15T23:29:54.097 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ac6ad567a3c6212fcf7b6e5f4ad5ca19877750caa64d2e260457ba847396577d/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4b30f13429292b9e6818848f94b16a28afc5c2a614f8858578cfc73f6ca07118/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/0 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/0e565e71b2918705738e5bab809d406443b8d6ecd3e566868f38ecd9c31d9fc5/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/7810cb0abe6187b5e58124d33634300f5db94401bb4186dfa28debf69c6bf314/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/f6d7b24f708ad689ed22f112f1d5722724e390d0a17b93eb76a50c65086da01a/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/1909ed6d37b36df14c57e8647d1322830bd0a76b937004ab2e7df655c7455bc8/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/472cb69d2c0ea361169144acfa6c503bbe722736ae5292547090c98530808033/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4e0007f7fcaa1dfdce7abab6b7eb7b7c17092811960111d17806937b25910dc9/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/8f5c83ecd3b76a0a3b23c1461020d56b19320f9ae125a320b7789b0b0c5b41f4/merged 2024-09-15T23:29:54.098 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/789d02259da09fef9dadd7300884c675b7b44e3cc04c25823479ac27ab9bbc90/merged 2024-09-15T23:29:54.099 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-15T23:29:54.099 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:54.099 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:54.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:54.099 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-15T23:29:54.151 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T23:29:54.151 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T23:29:54.194 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-15T23:29:54.218 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-15T23:29:54.274 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:29:54.275 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ac6ad567a3c6212fcf7b6e5f4ad5ca19877750caa64d2e260457ba847396577d/merged 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4b30f13429292b9e6818848f94b16a28afc5c2a614f8858578cfc73f6ca07118/merged 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/0 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:54.276 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/0e565e71b2918705738e5bab809d406443b8d6ecd3e566868f38ecd9c31d9fc5/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/7810cb0abe6187b5e58124d33634300f5db94401bb4186dfa28debf69c6bf314/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/f6d7b24f708ad689ed22f112f1d5722724e390d0a17b93eb76a50c65086da01a/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/1909ed6d37b36df14c57e8647d1322830bd0a76b937004ab2e7df655c7455bc8/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/472cb69d2c0ea361169144acfa6c503bbe722736ae5292547090c98530808033/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4e0007f7fcaa1dfdce7abab6b7eb7b7c17092811960111d17806937b25910dc9/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/8f5c83ecd3b76a0a3b23c1461020d56b19320f9ae125a320b7789b0b0c5b41f4/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/789d02259da09fef9dadd7300884c675b7b44e3cc04c25823479ac27ab9bbc90/merged 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:54.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:54.278 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-15T23:29:54.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:2024-09-15T23:29:54.333+0000 7f6cd8f64480 -1 init, newargv = 0x564b9077e8f0 newargc=15 2024-09-15T23:29:54.334 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[75550]: starting ceph client 2024-09-15T23:29:54.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[75550]: starting fuse 2024-09-15T23:29:55.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:54 smithi155 ceph-mon[35631]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:55.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:54 smithi077 ceph-mon[30968]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:54 smithi159 ceph-mon[35472]: pgmap v298: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:55.430 DEBUG:teuthology.orchestra.run.smithi077:> sudo modprobe fuse 2024-09-15T23:29:55.460 DEBUG:teuthology.orchestra.run.smithi077:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T23:29:55.518 INFO:teuthology.orchestra.run.smithi077.stdout:/proc 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/dev 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/security 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/shm 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/pts 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/run 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/cgroup 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/pstore 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/bpf 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/ 2024-09-15T23:29:55.519 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/selinux 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/hugepages 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/dev/mqueue 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/debug 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/tracing 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/fs/fuse/connections 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-sysctl.service 2024-09-15T23:29:55.520 INFO:teuthology.orchestra.run.smithi077.stdout:/sys/kernel/config 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/nfs/rpc_pipefs 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/1000 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/ceph 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/ac6ad567a3c6212fcf7b6e5f4ad5ca19877750caa64d2e260457ba847396577d/merged 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4b30f13429292b9e6818848f94b16a28afc5c2a614f8858578cfc73f6ca07118/merged 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/run/user/0 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/0e565e71b2918705738e5bab809d406443b8d6ecd3e566868f38ecd9c31d9fc5/merged 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/7810cb0abe6187b5e58124d33634300f5db94401bb4186dfa28debf69c6bf314/merged 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/f6d7b24f708ad689ed22f112f1d5722724e390d0a17b93eb76a50c65086da01a/merged 2024-09-15T23:29:55.521 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/1909ed6d37b36df14c57e8647d1322830bd0a76b937004ab2e7df655c7455bc8/merged 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/472cb69d2c0ea361169144acfa6c503bbe722736ae5292547090c98530808033/merged 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/4e0007f7fcaa1dfdce7abab6b7eb7b7c17092811960111d17806937b25910dc9/merged 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/8f5c83ecd3b76a0a3b23c1461020d56b19320f9ae125a320b7789b0b0c5b41f4/merged 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/var/lib/containers/storage/overlay/789d02259da09fef9dadd7300884c675b7b44e3cc04c25823479ac27ab9bbc90/merged 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run.smithi077.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:55.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:55.522 DEBUG:teuthology.orchestra.run.smithi077:> ls /sys/fs/fuse/connections 2024-09-15T23:29:55.575 INFO:teuthology.orchestra.run.smithi077.stdout:120 2024-09-15T23:29:55.576 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> sudo stdin-killer -- python3 -c ' 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> import glob 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> import re 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> import os 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> import subprocess 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> def _find_admin_socket(client_name): 2024-09-15T23:29:55.576 DEBUG:teuthology.orchestra.run.smithi077:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> files = glob.glob(asok_path) 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> # Given a non-glob path, it better be there 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> if "*" not in asok_path: 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> assert(len(files) == 1) 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> return files[0] 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> for f in files: 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> contents = proc_f.read() 2024-09-15T23:29:55.577 DEBUG:teuthology.orchestra.run.smithi077:> if mountpoint in contents: 2024-09-15T23:29:55.578 DEBUG:teuthology.orchestra.run.smithi077:> return f 2024-09-15T23:29:55.578 DEBUG:teuthology.orchestra.run.smithi077:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T23:29:55.578 DEBUG:teuthology.orchestra.run.smithi077:> 2024-09-15T23:29:55.578 DEBUG:teuthology.orchestra.run.smithi077:> print(_find_admin_socket("client.admin")) 2024-09-15T23:29:55.578 DEBUG:teuthology.orchestra.run.smithi077:> ' 2024-09-15T23:29:55.697 INFO:teuthology.orchestra.run.smithi077.stdout:/var/run/ceph/ceph-client.admin.75550.asok 2024-09-15T23:29:55.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:55.707 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75550.asok 2024-09-15T23:29:55.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:55.708 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75550.asok status 2024-09-15T23:29:55.843 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:29:55.843 INFO:teuthology.orchestra.run.smithi077.stdout: "metadata": { 2024-09-15T23:29:55.843 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "entity_id": "admin", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": "smithi077", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "pid": "75550", 2024-09-15T23:29:55.844 INFO:teuthology.orchestra.run.smithi077.stdout: "root": "/" 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_count": 0, 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: "dentry_pinned_count": 0, 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 14721, 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: "inst": { 2024-09-15T23:29:55.845 INFO:teuthology.orchestra.run.smithi077.stdout: "name": { 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "client", 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: "num": 14721 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-15T23:29:55.846 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1924651360 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": { 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-15T23:29:55.847 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "192.168.0.1:0", 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 1924651360 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: "inst_str": "client.14721 192.168.0.1:0/1924651360", 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: "addr_str": "192.168.0.1:0/1924651360", 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: "inode_count": 1, 2024-09-15T23:29:55.848 INFO:teuthology.orchestra.run.smithi077.stdout: "mds_epoch": 17, 2024-09-15T23:29:55.849 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch": 89, 2024-09-15T23:29:55.849 INFO:teuthology.orchestra.run.smithi077.stdout: "osd_epoch_barrier": 0, 2024-09-15T23:29:55.849 INFO:teuthology.orchestra.run.smithi077.stdout: "blocklisted": false, 2024-09-15T23:29:55.849 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs" 2024-09-15T23:29:55.849 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:29:55.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:55.853 DEBUG:teuthology.orchestra.run.smithi077:> stat --file-system '--printf=%T 2024-09-15T23:29:55.853 DEBUG:teuthology.orchestra.run.smithi077:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:55.869 INFO:teuthology.orchestra.run.smithi077.stdout:fuseblk 2024-09-15T23:29:55.869 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:55.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:55.870 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:55.936 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T23:29:56.028 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:29:56.049 INFO:teuthology.orchestra.run.smithi077.stdout:# file: . 2024-09-15T23:29:56.049 INFO:teuthology.orchestra.run.smithi077.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T23:29:56.050 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:29:56.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:29:56.055 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:29:56.055 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:29:56.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:29:56.381 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 -- 172.21.15.77:0/1552533128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea81036e0 msgr2=0x7feea8107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 --2- 172.21.15.77:0/1552533128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea81036e0 0x7feea8107b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fee98009930 tx=0x7fee9802a420 comp rx=0 tx=0).stop 2024-09-15T23:29:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 -- 172.21.15.77:0/1552533128 shutdown_connections 2024-09-15T23:29:56.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 --2- 172.21.15.77:0/1552533128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81082a0 0x7feea810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 --2- 172.21.15.77:0/1552533128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea81036e0 0x7feea8107b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 --2- 172.21.15.77:0/1552533128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea8102d30 0x7feea8103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 -- 172.21.15.77:0/1552533128 >> 172.21.15.77:0/1552533128 conn(0x7feea80fc7d0 msgr2=0x7feea80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 -- 172.21.15.77:0/1552533128 shutdown_connections 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.843+0000 7feeb043f640 1 -- 172.21.15.77:0/1552533128 wait complete. 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 Processor -- start 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 -- start start 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81036e0 0x7feea8198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea81082a0 0x7feea819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feea81120e0 con 0x7feea8102d30 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feea8111f60 con 0x7feea81036e0 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeb043f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feea8112260 con 0x7feea81082a0 2024-09-15T23:29:56.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeae1db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeae1db640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41550/0 (socket says 172.21.15.77:41550) 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeae1db640 1 -- 172.21.15.77:0/1862449937 learned_addr learned my addr 172.21.15.77:0/1862449937 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feeae9dc640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea81082a0 0x7feea819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.844+0000 7feead9da640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81036e0 0x7feea8198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 -- 172.21.15.77:0/1862449937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea81082a0 msgr2=0x7feea819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea81082a0 0x7feea819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 -- 172.21.15.77:0/1862449937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81036e0 msgr2=0x7feea8198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81036e0 0x7feea8198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 -- 172.21.15.77:0/1862449937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea819d5f0 con 0x7feea8102d30 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeae1db640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feea400d770 tx=0x7feea400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4017070 con 0x7feea8102d30 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea819d8e0 con 0x7feea8102d30 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feea4005500 con 0x7feea8102d30 2024-09-15T23:29:56.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feea4004e00 con 0x7feea8102d30 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.845+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea81a51c0 con 0x7feea8102d30 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.846+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea806a850 con 0x7feea8102d30 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.847+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7feea4004fa0 con 0x7feea8102d30 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.848+0000 7fee9f7fe640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 0x7fee940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.849+0000 7feead9da640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 0x7fee940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.849+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7feea40cfa30 con 0x7feea8102d30 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.849+0000 7feead9da640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 0x7fee940a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee98005940 tx=0x7fee980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:56.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:56.852+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feea409bde0 con 0x7feea8102d30 2024-09-15T23:29:57.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.034+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7feea8103110 con 0x7feea8102d30 2024-09-15T23:29:57.036 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:56 smithi077 ceph-mon[30968]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.034+0000 7fee9f7fe640 1 -- 172.21.15.77:0/1862449937 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+583 (secure 0 0 0) 0x7feea8103110 con 0x7feea8102d30 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/21470712 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/152076836 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:57.036 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1758888302 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3827072978 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1375913164 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1069420314 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:57.037 INFO:teuthology.orchestra.run.smithi077.stderr:listed 10 entries 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.036+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 msgr2=0x7fee940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.036+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 0x7fee940a5700 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fee98005940 tx=0x7fee980058d0 comp rx=0 tx=0).stop 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.036+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 msgr2=0x7feea8198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.036+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feea400d770 tx=0x7feea400dc30 comp rx=0 tx=0).stop 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 shutdown_connections 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee940a3240 0x7fee940a5700 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feea81082a0 0x7feea819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feea81036e0 0x7feea8198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:57.038 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 --2- 172.21.15.77:0/1862449937 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feea8102d30 0x7feea8198640 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 >> 172.21.15.77:0/1862449937 conn(0x7feea80fc7d0 msgr2=0x7feea8105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 shutdown_connections 2024-09-15T23:29:57.039 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:57.037+0000 7feeb043f640 1 -- 172.21.15.77:0/1862449937 wait complete. 2024-09-15T23:29:57.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:56 smithi155 ceph-mon[35631]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:56 smithi159 ceph-mon[35472]: pgmap v299: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:57.790 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:29:57.791 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:29:57.809 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:29:58.101 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:29:58.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:57 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1862449937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:58.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:57 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1862449937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:57 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1862449937' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 -- 172.21.15.77:0/2565436718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864106f10 msgr2=0x7fc86410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2565436718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864106f10 0x7fc86410ea90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009ca0 tx=0x7fc85c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 -- 172.21.15.77:0/2565436718 shutdown_connections 2024-09-15T23:29:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2565436718 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864106f10 0x7fc86410ea90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2565436718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864102790 0x7fc8641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2565436718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864101de0 0x7fc8641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 -- 172.21.15.77:0/2565436718 >> 172.21.15.77:0/2565436718 conn(0x7fc8640fd8c0 msgr2=0x7fc8640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 -- 172.21.15.77:0/2565436718 shutdown_connections 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.538+0000 7fc869ae0640 1 -- 172.21.15.77:0/2565436718 wait complete. 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 Processor -- start 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 -- start start 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864101de0 0x7fc864198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 0x7fc86419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc864111f70 con 0x7fc864102790 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc864111df0 con 0x7fc864106f10 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.539+0000 7fc869ae0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641120f0 con 0x7fc864101de0 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46378/0 (socket says 172.21.15.77:46378) 2024-09-15T23:29:58.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 -- 172.21.15.77:0/2457070490 learned_addr learned my addr 172.21.15.77:0/2457070490 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc8637fe640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864101de0 0x7fc864198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc863fff640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 0x7fc86419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 -- 172.21.15.77:0/2457070490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864101de0 msgr2=0x7fc864198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864101de0 0x7fc864198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 -- 172.21.15.77:0/2457070490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 msgr2=0x7fc86419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 0x7fc86419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 -- 172.21.15.77:0/2457070490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86419d340 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc863fff640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 0x7fc86419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc862ffd640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c890 tx=0x7fc85800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc858004220 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8580043c0 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86419d630 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8580049e0 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.540+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8641a4f10 con 0x7fc864102790 2024-09-15T23:29:58.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.541+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8641021c0 con 0x7fc864102790 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.542+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc8580079b0 con 0x7fc864102790 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.543+0000 7fc860ff9640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 0x7fc84c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.543+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fc8580cfce0 con 0x7fc864102790 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.543+0000 7fc8637fe640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 0x7fc84c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.544+0000 7fc8637fe640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 0x7fc84c0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc8540058c0 tx=0x7fc85400a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:29:58.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.547+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc858014030 con 0x7fc864102790 2024-09-15T23:29:58.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.724+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc86402d7c0 con 0x7fc864102790 2024-09-15T23:29:58.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.724+0000 7fc860ff9640 1 -- 172.21.15.77:0/2457070490 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+583 (secure 0 0 0) 0x7fc85809c6e0 con 0x7fc864102790 2024-09-15T23:29:58.725 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/21470712 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/152076836 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1758888302 2024-09-16T23:22:35.713071+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3827072978 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1375913164 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1069420314 2024-09-16T23:22:13.033320+0000 2024-09-15T23:29:58.726 INFO:teuthology.orchestra.run.smithi077.stderr:listed 10 entries 2024-09-15T23:29:58.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 msgr2=0x7fc84c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:58.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 0x7fc84c0a5700 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc8540058c0 tx=0x7fc85400a4c0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 msgr2=0x7fc8641988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:29:58.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc85800c890 tx=0x7fc85800cd50 comp rx=0 tx=0).stop 2024-09-15T23:29:58.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 shutdown_connections 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc84c0a3240 0x7fc84c0a5700 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc864106f10 0x7fc86419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc864102790 0x7fc8641988d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 --2- 172.21.15.77:0/2457070490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc864101de0 0x7fc864198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 >> 172.21.15.77:0/2457070490 conn(0x7fc8640fd8c0 msgr2=0x7fc8640fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 shutdown_connections 2024-09-15T23:29:58.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:29:58.726+0000 7fc869ae0640 1 -- 172.21.15.77:0/2457070490 wait complete. 2024-09-15T23:29:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:58 smithi155 ceph-mon[35631]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:59.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:29:58 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2457070490' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:59.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:58 smithi077 ceph-mon[30968]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:59.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:29:58 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2457070490' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:58 smithi159 ceph-mon[35472]: pgmap v300: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:29:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:29:58 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2457070490' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:29:59.495 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi077.front.sepia.ceph.com... 2024-09-15T23:29:59.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:29:59.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T23:29:59.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi077.stderr:ceph-fuse[75550]: fuse finished with error 0 and tester_r 0 2024-09-15T23:29:59.524 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T23:30:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:00 smithi077 ceph-mon[30968]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:00 smithi077 ceph-mon[30968]: overall HEALTH_OK 2024-09-15T23:30:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:00 smithi159 ceph-mon[35472]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:00 smithi159 ceph-mon[35472]: overall HEALTH_OK 2024-09-15T23:30:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:00 smithi155 ceph-mon[35631]: pgmap v301: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:00 smithi155 ceph-mon[35631]: overall HEALTH_OK 2024-09-15T23:30:03.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:02 smithi077 ceph-mon[30968]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:02 smithi159 ceph-mon[35472]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:02 smithi155 ceph-mon[35631]: pgmap v302: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:04 smithi077 ceph-mon[30968]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:05.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:04 smithi159 ceph-mon[35472]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:05.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:04 smithi155 ceph-mon[35631]: pgmap v303: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-09-15T23:30:05.625 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:30:05.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:30:05.626 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T23:30:05.662 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:30:05.962 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 -- 172.21.15.77:0/1625893095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128102ef0 msgr2=0x7f712810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 --2- 172.21.15.77:0/1625893095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128102ef0 0x7f712810da40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7120009ca0 tx=0x7f712002a950 comp rx=0 tx=0).stop 2024-09-15T23:30:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 -- 172.21.15.77:0/1625893095 shutdown_connections 2024-09-15T23:30:06.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 --2- 172.21.15.77:0/1625893095 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128102ef0 0x7f712810da40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 --2- 172.21.15.77:0/1625893095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 0x7f71281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 --2- 172.21.15.77:0/1625893095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128100e20 0x7f7128101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 -- 172.21.15.77:0/1625893095 >> 172.21.15.77:0/1625893095 conn(0x7f71280fc7d0 msgr2=0x7f71280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 -- 172.21.15.77:0/1625893095 shutdown_connections 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.407+0000 7f712e055640 1 -- 172.21.15.77:0/1625893095 wait complete. 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 Processor -- start 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 -- start start 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 0x7f7128198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128102ef0 0x7f712819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7128110fd0 con 0x7f7128100e20 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7128110e50 con 0x7f7128102ef0 2024-09-15T23:30:06.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f712e055640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7128111150 con 0x7f7128102570 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46394/0 (socket says 172.21.15.77:46394) 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 -- 172.21.15.77:0/743247423 learned_addr learned my addr 172.21.15.77:0/743247423 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f7126ffd640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 0x7f7128198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f7127fff640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128102ef0 0x7f712819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 -- 172.21.15.77:0/743247423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 msgr2=0x7f7128198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 0x7f7128198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 -- 172.21.15.77:0/743247423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128102ef0 msgr2=0x7f712819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128102ef0 0x7f712819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.408+0000 7f71277fe640 1 -- 172.21.15.77:0/743247423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712819d4d0 con 0x7f7128100e20 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f71277fe640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f711800d950 tx=0x7f711800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7118017070 con 0x7f7128100e20 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712819d7c0 con 0x7f7128100e20 2024-09-15T23:30:06.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7118009c30 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711800f6b0 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.409+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71281a50a0 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.410+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7128101200 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.411+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f71180109d0 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.412+0000 7f7124ff9640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 0x7f71100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.412+0000 7f7126ffd640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 0x7f71100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.412+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f71180cf7f0 con 0x7f7128100e20 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.412+0000 7f7126ffd640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 0x7f71100a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71281052b0 tx=0x7f711c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:06.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.416+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f7118009de0 con 0x7f7128100e20 2024-09-15T23:30:06.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.583+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f712810a0a0 con 0x7f7128100e20 2024-09-15T23:30:06.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.584+0000 7f7124ff9640 1 -- 172.21.15.77:0/743247423 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f711809bba0 con 0x7f7128100e20 2024-09-15T23:30:06.586 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:06.586 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:30:06.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 msgr2=0x7f71100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:06.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 0x7f71100a5700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f71281052b0 tx=0x7f711c00b390 comp rx=0 tx=0).stop 2024-09-15T23:30:06.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 msgr2=0x7f7128198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f711800d950 tx=0x7f711800de10 comp rx=0 tx=0).stop 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 shutdown_connections 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71100a3240 0x7f71100a5700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7128102ef0 0x7f712819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7128102570 0x7f7128198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 --2- 172.21.15.77:0/743247423 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7128100e20 0x7f7128198520 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 >> 172.21.15.77:0/743247423 conn(0x7f71280fc7d0 msgr2=0x7f712806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 shutdown_connections 2024-09-15T23:30:06.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:06.586+0000 7f712e055640 1 -- 172.21.15.77:0/743247423 wait complete. 2024-09-15T23:30:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:06 smithi077 ceph-mon[30968]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:06 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/743247423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:06 smithi159 ceph-mon[35472]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:06 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/743247423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:07.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:30:07.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:06 smithi155 ceph-mon[35631]: pgmap v304: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:06 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/743247423' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:07.504 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 -- 172.21.15.77:0/2067963767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 msgr2=0x7fbf7c1063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 --2- 172.21.15.77:0/2067963767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c1063d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009ca0 tx=0x7fbf7402a940 comp rx=0 tx=0).stop 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 -- 172.21.15.77:0/2067963767 shutdown_connections 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 --2- 172.21.15.77:0/2067963767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c1063d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 --2- 172.21.15.77:0/2067963767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c101450 0x7fbf7c105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 --2- 172.21.15.77:0/2067963767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c100b30 0x7fbf7c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 -- 172.21.15.77:0/2067963767 >> 172.21.15.77:0/2067963767 conn(0x7fbf7c0fc7a0 msgr2=0x7fbf7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 -- 172.21.15.77:0/2067963767 shutdown_connections 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.009+0000 7fbf81168640 1 -- 172.21.15.77:0/2067963767 wait complete. 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 Processor -- start 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 -- start start 2024-09-15T23:30:08.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c100b30 0x7fbf7c1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 0x7fbf7c1a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c1185e0 con 0x7fbf7c105f40 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c118460 con 0x7fbf7c100b30 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.010+0000 7fbf81168640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7c118760 con 0x7fbf7c101450 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39116/0 (socket says 172.21.15.77:39116) 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 -- 172.21.15.77:0/252565107 learned_addr learned my addr 172.21.15.77:0/252565107 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7ad9d640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c100b30 0x7fbf7c1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7a59c640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 0x7fbf7c1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 -- 172.21.15.77:0/252565107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 msgr2=0x7fbf7c1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 0x7fbf7c1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.023 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 -- 172.21.15.77:0/252565107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c100b30 msgr2=0x7fbf7c1a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c100b30 0x7fbf7c1a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 -- 172.21.15.77:0/252565107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf7c19efc0 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7a59c640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 0x7fbf7c1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf7b59e640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009dc0 tx=0x7fbf7402fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74034040 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf7c19f250 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf74003e50 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf74039430 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.011+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf7c1ab5a0 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.012+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7c105920 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.013+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbf74037020 con 0x7fbf7c105f40 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.014+0000 7fbf63fff640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 0x7fbf640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.014+0000 7fbf7ad9d640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 0x7fbf640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:08.024 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.014+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fbf740f0fc0 con 0x7fbf7c105f40 2024-09-15T23:30:08.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.014+0000 7fbf7ad9d640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 0x7fbf640a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0058c0 tx=0x7fbf6c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:08.025 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.017+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf740bd9c0 con 0x7fbf7c105f40 2024-09-15T23:30:08.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.183+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbf7c1ab7a0 con 0x7fbf7c105f40 2024-09-15T23:30:08.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.185+0000 7fbf63fff640 1 -- 172.21.15.77:0/252565107 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7fbf740bd2c0 con 0x7fbf7c105f40 2024-09-15T23:30:08.186 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:08.187 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 msgr2=0x7fbf640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 0x7fbf640a5700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0058c0 tx=0x7fbf6c00a250 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 msgr2=0x7fbf7c19e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009dc0 tx=0x7fbf7402fb60 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 shutdown_connections 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3240 0x7fbf640a5700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf7c105f40 0x7fbf7c19e890 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf7c101450 0x7fbf7c1a4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 --2- 172.21.15.77:0/252565107 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf7c100b30 0x7fbf7c1a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.187+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 >> 172.21.15.77:0/252565107 conn(0x7fbf7c0fc7a0 msgr2=0x7fbf7c1038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.188+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 shutdown_connections 2024-09-15T23:30:08.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:08.188+0000 7fbf81168640 1 -- 172.21.15.77:0/252565107 wait complete. 2024-09-15T23:30:08.864 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-15T23:30:09.111 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:09.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:08 smithi077 ceph-mon[30968]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:09.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/252565107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:08 smithi159 ceph-mon[35472]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/252565107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:09.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:08 smithi155 ceph-mon[35631]: pgmap v305: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:09.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/252565107' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 -- 172.21.15.77:0/2619647251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844101de0 msgr2=0x7fb8441021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 --2- 172.21.15.77:0/2619647251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844101de0 0x7fb8441021c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb840009900 tx=0x7fb84002a410 comp rx=0 tx=0).stop 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 -- 172.21.15.77:0/2619647251 shutdown_connections 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 --2- 172.21.15.77:0/2619647251 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844106f10 0x7fb84410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 --2- 172.21.15.77:0/2619647251 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 0x7fb8441067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 --2- 172.21.15.77:0/2619647251 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844101de0 0x7fb8441021c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 -- 172.21.15.77:0/2619647251 >> 172.21.15.77:0/2619647251 conn(0x7fb8440fd8c0 msgr2=0x7fb8440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 -- 172.21.15.77:0/2619647251 shutdown_connections 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.586+0000 7fb84bc47640 1 -- 172.21.15.77:0/2619647251 wait complete. 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 Processor -- start 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 -- start start 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 0x7fb844198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 0x7fb844198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb844111f30 con 0x7fb844106f10 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb844111db0 con 0x7fb844102790 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84bc47640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb8441120b0 con 0x7fb844101de0 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84a1e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.587+0000 7fb84a1e4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39128/0 (socket says 172.21.15.77:39128) 2024-09-15T23:30:09.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 -- 172.21.15.77:0/1851930025 learned_addr learned my addr 172.21.15.77:0/1851930025 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb8491e2640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 0x7fb844198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb8499e3640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 0x7fb844198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 -- 172.21.15.77:0/1851930025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 msgr2=0x7fb844198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 0x7fb844198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 -- 172.21.15.77:0/1851930025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 msgr2=0x7fb844198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 0x7fb844198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 -- 172.21.15.77:0/1851930025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb84419d4c0 con 0x7fb844106f10 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb8499e3640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 0x7fb844198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84a1e4640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00eaa0 tx=0x7fb83c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00cdb0 con 0x7fb844106f10 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb84419d7b0 con 0x7fb844106f10 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb83c005020 con 0x7fb844106f10 2024-09-15T23:30:09.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0116b0 con 0x7fb844106f10 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.588+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8441a5090 con 0x7fb844106f10 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.589+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8441021c0 con 0x7fb844106f10 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.590+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb83c005560 con 0x7fb844106f10 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.591+0000 7fb83affd640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 0x7fb8300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.591+0000 7fb8499e3640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 0x7fb8300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.591+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fb83c0cfec0 con 0x7fb844106f10 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.591+0000 7fb8499e3640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 0x7fb8300a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb840000c00 tx=0x7fb840032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:09.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.595+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb83c016030 con 0x7fb844106f10 2024-09-15T23:30:09.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.801+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb84410a0f0 con 0x7fb844106f10 2024-09-15T23:30:09.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.882+0000 7fb83affd640 1 -- 172.21.15.77:0/1851930025 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fb83c09c8c0 con 0x7fb844106f10 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 msgr2=0x7fb8300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 0x7fb8300a5700 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb840000c00 tx=0x7fb840032c70 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 msgr2=0x7fb84419cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb83c00eaa0 tx=0x7fb83c00ef60 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 shutdown_connections 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb8300a3240 0x7fb8300a5700 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb844106f10 0x7fb84419cde0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb844102790 0x7fb844198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 --2- 172.21.15.77:0/1851930025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb844101de0 0x7fb844198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 >> 172.21.15.77:0/1851930025 conn(0x7fb8440fd8c0 msgr2=0x7fb8440fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:09.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 shutdown_connections 2024-09-15T23:30:09.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:09.884+0000 7fb84bc47640 1 -- 172.21.15.77:0/1851930025 wait complete. 2024-09-15T23:30:10.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:09 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:30:10.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:30:10.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:09 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-15T23:30:10.630 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 1, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-09-15T23:30:10.630 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-15T23:30:10.891 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:11.186 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:10 smithi077 ceph-mon[30968]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:11.186 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:10 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:30:11.187 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:10 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:10 smithi159 ceph-mon[35472]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:10 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:30:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:10 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:10 smithi155 ceph-mon[35631]: pgmap v306: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-09-15T23:30:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:10 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1851930025' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-15T23:30:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:10 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.425+0000 7fee55d08640 1 -- 172.21.15.77:0/212471019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50102570 msgr2=0x7fee501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.425+0000 7fee55d08640 1 --2- 172.21.15.77:0/212471019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50102570 0x7fee501029b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fee38009900 tx=0x7fee3802a480 comp rx=0 tx=0).stop 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.425+0000 7fee55d08640 1 -- 172.21.15.77:0/212471019 shutdown_connections 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.425+0000 7fee55d08640 1 --2- 172.21.15.77:0/212471019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102ef0 0x7fee5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 --2- 172.21.15.77:0/212471019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50102570 0x7fee501029b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 --2- 172.21.15.77:0/212471019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50100e20 0x7fee50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 -- 172.21.15.77:0/212471019 >> 172.21.15.77:0/212471019 conn(0x7fee500fc7d0 msgr2=0x7fee500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 -- 172.21.15.77:0/212471019 shutdown_connections 2024-09-15T23:30:11.450 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 -- 172.21.15.77:0/212471019 wait complete. 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 Processor -- start 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 -- start start 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.426+0000 7fee55d08640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102570 0x7fee50198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50102ef0 0x7fee5019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fee50110fa0 con 0x7fee50100e20 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fee50110e20 con 0x7fee50102570 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee50111120 con 0x7fee50102ef0 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39152/0 (socket says 172.21.15.77:39152) 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 -- 172.21.15.77:0/2079095169 learned_addr learned my addr 172.21.15.77:0/2079095169 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4ffff640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50102ef0 0x7fee5019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4effd640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102570 0x7fee50198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:11.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 -- 172.21.15.77:0/2079095169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50102ef0 msgr2=0x7fee5019ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50102ef0 0x7fee5019ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 -- 172.21.15.77:0/2079095169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102570 msgr2=0x7fee50198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102570 0x7fee50198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 -- 172.21.15.77:0/2079095169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee5019d510 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4f7fe640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee4000ba50 tx=0x7fee4000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40019070 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fee4000cbe0 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5019d800 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.427+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee400076e0 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.428+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee501a50e0 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.429+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee50101200 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.431+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fee4001c070 con 0x7fee50100e20 2024-09-15T23:30:11.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.431+0000 7fee4cff9640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 0x7fee3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.432+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fee400cf6d0 con 0x7fee50100e20 2024-09-15T23:30:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.431+0000 7fee4effd640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 0x7fee3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.432+0000 7fee4effd640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 0x7fee3c0a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee500fff50 tx=0x7fee38005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:11.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.434+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fee4009ba80 con 0x7fee50100e20 2024-09-15T23:30:11.646 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.645+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fee5010a0a0 con 0x7fee50100e20 2024-09-15T23:30:11.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.891+0000 7fee4cff9640 1 -- 172.21.15.77:0/2079095169 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7fee4009fd80 con 0x7fee50100e20 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 msgr2=0x7fee3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 0x7fee3c0a5700 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fee500fff50 tx=0x7fee38005a20 comp rx=0 tx=0).stop 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 msgr2=0x7fee50198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fee4000ba50 tx=0x7fee4000bf10 comp rx=0 tx=0).stop 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 shutdown_connections 2024-09-15T23:30:11.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fee3c0a3240 0x7fee3c0a5700 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50102ef0 0x7fee5019ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fee50102570 0x7fee50198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 --2- 172.21.15.77:0/2079095169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fee50100e20 0x7fee50198560 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.893+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 >> 172.21.15.77:0/2079095169 conn(0x7fee500fc7d0 msgr2=0x7fee5006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.894+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 shutdown_connections 2024-09-15T23:30:11.897 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:11.894+0000 7fee55d08640 1 -- 172.21.15.77:0/2079095169 wait complete. 2024-09-15T23:30:12.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:11 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:30:12.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:11 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:30:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:11 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-15T23:30:12.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-15T23:30:12.890 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:13.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:12 smithi077 ceph-mon[30968]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T23:30:13.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:12 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:30:13.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:12 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:13.150 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:12 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:12 smithi159 ceph-mon[35472]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T23:30:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:12 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:30:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:12 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:12 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:12 smithi155 ceph-mon[35631]: pgmap v307: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-09-15T23:30:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:12 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2079095169' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-15T23:30:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:12 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 11 up:standby 2024-09-15T23:30:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:12 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/42885676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4106a80 msgr2=0x7fa3b4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/42885676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4106a80 0x7fa3b4106e60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009930 tx=0x7fa3b002a420 comp rx=0 tx=0).stop 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/42885676 shutdown_connections 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/42885676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4101420 0x7fa3b410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/42885676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 0x7fa3b4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/42885676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4106a80 0x7fa3b4106e60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/42885676 >> 172.21.15.77:0/42885676 conn(0x7fa3b40fc7a0 msgr2=0x7fa3b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:13.392 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/42885676 shutdown_connections 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.373+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/42885676 wait complete. 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 Processor -- start 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 -- start start 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 0x7fa3b4199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4106a80 0x7fa3b41a4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4110ea0 con 0x7fa3b4101420 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4110d20 con 0x7fa3b4100a80 2024-09-15T23:30:13.393 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.374+0000 7fa3bc2d5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b4111020 con 0x7fa3b4106a80 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39170/0 (socket says 172.21.15.77:39170) 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 -- 172.21.15.77:0/2643732566 learned_addr learned my addr 172.21.15.77:0/2643732566 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3ba071640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 0x7fa3b4199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3ba872640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4106a80 0x7fa3b41a4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 -- 172.21.15.77:0/2643732566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4106a80 msgr2=0x7fa3b41a4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4106a80 0x7fa3b41a4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 -- 172.21.15.77:0/2643732566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 msgr2=0x7fa3b4199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 0x7fa3b4199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 -- 172.21.15.77:0/2643732566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b41a48d0 con 0x7fa3b4101420 2024-09-15T23:30:13.394 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3b9870640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c890 tx=0x7fa3a400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4004220 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b41a4aa0 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a40043c0 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4004a00 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.375+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b41a4fe0 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.377+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b4100ee0 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.377+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa3a40079b0 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.378+0000 7fa3ab7fe640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 0x7fa3a00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.378+0000 7fa3ba071640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 0x7fa3a00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.378+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fa3a40cf880 con 0x7fa3b4101420 2024-09-15T23:30:13.395 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.379+0000 7fa3ba071640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 0x7fa3a00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009900 tx=0x7fa3b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:13.396 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.382+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa3a4014030 con 0x7fa3b4101420 2024-09-15T23:30:13.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.581+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fa3b4108ff0 con 0x7fa3b4101420 2024-09-15T23:30:13.903 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.902+0000 7fa3ab7fe640 1 -- 172.21.15.77:0/2643732566 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7fa3a409bc30 con 0x7fa3b4101420 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 msgr2=0x7fa3a00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 0x7fa3a00a5700 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009900 tx=0x7fa3b00058d0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 msgr2=0x7fa3b4199850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c890 tx=0x7fa3a400cd50 comp rx=0 tx=0).stop 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 shutdown_connections 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa3a00a3240 0x7fa3a00a5700 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa3b4106a80 0x7fa3b41a4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa3b4101420 0x7fa3b4199850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 --2- 172.21.15.77:0/2643732566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3b4100a80 0x7fa3b4199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 >> 172.21.15.77:0/2643732566 conn(0x7fa3b40fc7a0 msgr2=0x7fa3b40fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 shutdown_connections 2024-09-15T23:30:13.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:13.904+0000 7fa3bc2d5640 1 -- 172.21.15.77:0/2643732566 wait complete. 2024-09-15T23:30:14.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:13 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:30:14.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:13 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:30:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:13 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-15T23:30:14.637 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-09-15T23:30:14.637 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-15T23:30:14.885 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:15.157 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:14 smithi077 ceph-mon[30968]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-15T23:30:15.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:14 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:30:15.158 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:14 smithi077 ceph-mon[30968]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:14 smithi159 ceph-mon[35472]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-15T23:30:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:14 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:30:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:14 smithi159 ceph-mon[35472]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- 172.21.15.77:0/3689071755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1410e500 msgr2=0x7f2c14110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3689071755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1410e500 0x7f2c14110910 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009ca0 tx=0x7f2c0c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- 172.21.15.77:0/3689071755 shutdown_connections 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3689071755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c1410e500 0x7f2c14110910 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3689071755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c14101440 0x7f2c1410df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3689071755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14100b20 0x7f2c14100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- 172.21.15.77:0/3689071755 >> 172.21.15.77:0/3689071755 conn(0x7f2c140fc7d0 msgr2=0x7f2c140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- 172.21.15.77:0/3689071755 shutdown_connections 2024-09-15T23:30:15.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- 172.21.15.77:0/3689071755 wait complete. 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 Processor -- start 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.350+0000 7f2c1b754640 1 -- start start 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 0x7f2c141a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c1410e500 0x7f2c1419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2c141142b0 con 0x7f2c14100b20 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14114130 con 0x7f2c1410e500 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2c14114430 con 0x7f2c14101440 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39184/0 (socket says 172.21.15.77:39184) 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 -- 172.21.15.77:0/3657791390 learned_addr learned my addr 172.21.15.77:0/3657791390 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c18cef640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 0x7f2c141a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:15.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c19cf1640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c1410e500 0x7f2c1419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 -- 172.21.15.77:0/3657791390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 msgr2=0x7f2c141a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 0x7f2c141a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 -- 172.21.15.77:0/3657791390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c1410e500 msgr2=0x7f2c1419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c1410e500 0x7f2c1419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 -- 172.21.15.77:0/3657791390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1419ad30 con 0x7f2c14100b20 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c18cef640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 0x7f2c141a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c194f0640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800b4a0 tx=0x7f2c0800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08014070 con 0x7f2c14100b20 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c08010af0 con 0x7f2c14100b20 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1419b020 con 0x7f2c14100b20 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08017d10 con 0x7f2c14100b20 2024-09-15T23:30:15.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.351+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c141a7310 con 0x7f2c14100b20 2024-09-15T23:30:15.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.352+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1406a850 con 0x7f2c14100b20 2024-09-15T23:30:15.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.353+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2c08017070 con 0x7f2c14100b20 2024-09-15T23:30:15.356 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.354+0000 7f2c067fc640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 0x7f2c000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:15.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.355+0000 7f2c18cef640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 0x7f2c000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:15.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.355+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f2c080cf4b0 con 0x7f2c14100b20 2024-09-15T23:30:15.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.355+0000 7f2c18cef640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 0x7f2c000a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c1410edd0 tx=0x7f2c1000a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:15.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.358+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2c0809be50 con 0x7f2c14100b20 2024-09-15T23:30:15.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:14 smithi155 ceph-mon[35631]: pgmap v308: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s rd, 85 B/s wr, 0 op/s 2024-09-15T23:30:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:14 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2643732566' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-15T23:30:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:14 smithi155 ceph-mon[35631]: fsmap cephfs:1 {0=i=up:active} 1 up:standby-replay 10 up:standby 2024-09-15T23:30:15.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.545+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2c14062630 con 0x7f2c000a32c0 2024-09-15T23:30:15.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.565+0000 7f2c067fc640 1 -- 172.21.15.77:0/3657791390 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c14062630 con 0x7f2c000a32c0 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 msgr2=0x7f2c000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 0x7f2c000a5780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c1410edd0 tx=0x7f2c1000a560 comp rx=0 tx=0).stop 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 msgr2=0x7f2c141a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800b4a0 tx=0x7f2c0800b960 comp rx=0 tx=0).stop 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 shutdown_connections 2024-09-15T23:30:15.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2c000a32c0 0x7f2c000a5780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c1410e500 0x7f2c1419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c14101440 0x7f2c141a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 --2- 172.21.15.77:0/3657791390 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2c14100b20 0x7f2c141a0440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 >> 172.21.15.77:0/3657791390 conn(0x7f2c140fc7d0 msgr2=0x7f2c140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 shutdown_connections 2024-09-15T23:30:15.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:15.567+0000 7f2c1b754640 1 -- 172.21.15.77:0/3657791390 wait complete. 2024-09-15T23:30:15.881 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:30:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:30:15.550+0000 7f7680418640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:30:15.881 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:30:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:30:15.550+0000 7f7680418640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:30:15.881 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:30:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:30:15.550+0000 7f7680418640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:30:15.881 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:30:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:30:15.550+0000 7f7680418640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:30:15.882 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:30:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:30:15.550+0000 7f7680418640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-15T23:30:16.217 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-15T23:30:16.461 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 -- 172.21.15.77:0/3212194236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8102790 msgr2=0x7f96c81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 --2- 172.21.15.77:0/3212194236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8102790 0x7f96c81067e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f96b0009900 tx=0x7f96b002a3f0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 -- 172.21.15.77:0/3212194236 shutdown_connections 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 --2- 172.21.15.77:0/3212194236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8106f10 0x7f96c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 --2- 172.21.15.77:0/3212194236 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8102790 0x7f96c81067e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 --2- 172.21.15.77:0/3212194236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 0x7f96c81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 -- 172.21.15.77:0/3212194236 >> 172.21.15.77:0/3212194236 conn(0x7f96c80fd8c0 msgr2=0x7f96c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:16.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 -- 172.21.15.77:0/3212194236 shutdown_connections 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.956+0000 7f96ced06640 1 -- 172.21.15.77:0/3212194236 wait complete. 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 Processor -- start 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 -- start start 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 0x7f96c81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 0x7f96c81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111f70 con 0x7f96c8106f10 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8111df0 con 0x7f96c8101de0 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ced06640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f96c81120f0 con 0x7f96c8102790 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:39210/0 (socket says 172.21.15.77:39210) 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 -- 172.21.15.77:0/2913214790 learned_addr learned my addr 172.21.15.77:0/2913214790 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96c7fff640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 0x7f96c81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:16.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96ccaa2640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 0x7f96c81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 -- 172.21.15.77:0/2913214790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 msgr2=0x7f96c81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 0x7f96c81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 -- 172.21.15.77:0/2913214790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 msgr2=0x7f96c81983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 0x7f96c81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 -- 172.21.15.77:0/2913214790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96c819d360 con 0x7f96c8106f10 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96c7fff640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 0x7f96c81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.957+0000 7f96cd2a3640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c970 tx=0x7f96c000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.958+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0007bb0 con 0x7f96c8106f10 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.958+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f96c0007d50 con 0x7f96c8106f10 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.958+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96c819d650 con 0x7f96c8106f10 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.958+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c0018800 con 0x7f96c8106f10 2024-09-15T23:30:16.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.958+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96c81a4f30 con 0x7f96c8106f10 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.959+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c81021c0 con 0x7f96c8106f10 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.960+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f96c000fa50 con 0x7f96c8106f10 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.961+0000 7f96c5ffb640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 0x7f96b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.961+0000 7f96ccaa2640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 0x7f96b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.961+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f96c00cfdc0 con 0x7f96c8106f10 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.961+0000 7f96ccaa2640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 0x7f96b40a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b8009810 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:16.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:16.965+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f96c0014030 con 0x7f96c8106f10 2024-09-15T23:30:17.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:16 smithi077 ceph-mon[30968]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:16 smithi077 ceph-mon[30968]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:30:17.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:16 smithi077 ceph-mon[30968]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:30:17.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.155+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f96c810a1b0 con 0x7f96b40a3350 2024-09-15T23:30:17.165 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:16 smithi155 ceph-mon[35631]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:17.165 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:16 smithi155 ceph-mon[35631]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:30:17.166 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:16 smithi155 ceph-mon[35631]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:30:17.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.179+0000 7f96c5ffb640 1 -- 172.21.15.77:0/2913214790 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f96c810a1b0 con 0x7f96b40a3350 2024-09-15T23:30:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 msgr2=0x7f96b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 0x7f96b40a5810 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005fd0 tx=0x7f96b8009810 comp rx=0 tx=0).stop 2024-09-15T23:30:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 msgr2=0x7f96c819cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f96c000c970 tx=0x7f96c000ce30 comp rx=0 tx=0).stop 2024-09-15T23:30:17.182 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 shutdown_connections 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96b40a3350 0x7f96b40a5810 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f96c8106f10 0x7f96c819cc80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96c8102790 0x7f96c81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 --2- 172.21.15.77:0/2913214790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96c8101de0 0x7f96c81983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 >> 172.21.15.77:0/2913214790 conn(0x7f96c80fd8c0 msgr2=0x7f96c80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 shutdown_connections 2024-09-15T23:30:17.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:17.181+0000 7f96ced06640 1 -- 172.21.15.77:0/2913214790 wait complete. 2024-09-15T23:30:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:16 smithi159 ceph-mon[35472]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:16 smithi159 ceph-mon[35472]: pgmap v309: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-09-15T23:30:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:16 smithi159 ceph-mon[35472]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-15T23:30:17.855 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-15T23:30:18.100 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 -- 172.21.15.77:0/1208506891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100310 msgr2=0x7f90141006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:18.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 --2- 172.21.15.77:0/1208506891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100310 0x7f90141006f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9004009900 tx=0x7f900402a410 comp rx=0 tx=0).stop 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 -- 172.21.15.77:0/1208506891 shutdown_connections 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 --2- 172.21.15.77:0/1208506891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 --2- 172.21.15.77:0/1208506891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100cc0 0x7f9014106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 --2- 172.21.15.77:0/1208506891 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100310 0x7f90141006f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 -- 172.21.15.77:0/1208506891 >> 172.21.15.77:0/1208506891 conn(0x7f9014077210 msgr2=0x7f90140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 -- 172.21.15.77:0/1208506891 shutdown_connections 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.598+0000 7f901a92a640 1 -- 172.21.15.77:0/1208506891 wait complete. 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 Processor -- start 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 -- start start 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100310 0x7f90141984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:18.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9014111fb0 con 0x7f9014100cc0 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9014111e30 con 0x7f9014106f30 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f901a92a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9014112130 con 0x7f9014100310 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f90137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f90137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45550/0 (socket says 172.21.15.77:45550) 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f90137fe640 1 -- 172.21.15.77:0/2513626163 learned_addr learned my addr 172.21.15.77:0/2513626163 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f9013fff640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100310 0x7f90141984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.599+0000 7f9018ec7640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 -- 172.21.15.77:0/2513626163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100310 msgr2=0x7f90141984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100310 0x7f90141984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 -- 172.21.15.77:0/2513626163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 msgr2=0x7f901419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 -- 172.21.15.77:0/2513626163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f901419d480 con 0x7f9014100cc0 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f9018ec7640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:18.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90137fe640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f900800b4a0 tx=0x7f900800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008014070 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9008010af0 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f901419d770 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9008017d10 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.600+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90141a5050 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.601+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90141006f0 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.602+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9008017070 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.602+0000 7f90117fa640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 0x7f8ffc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.603+0000 7f9013fff640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 0x7f8ffc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.603+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f90080cf0f0 con 0x7f9014100cc0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.603+0000 7f9013fff640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 0x7f8ffc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9004009230 tx=0x7f90040058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:18.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.607+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f900809baa0 con 0x7f9014100cc0 2024-09-15T23:30:18.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.802+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f9014062630 con 0x7f8ffc0a32d0 2024-09-15T23:30:18.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.807+0000 7f90117fa640 1 -- 172.21.15.77:0/2513626163 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f9014062630 con 0x7f8ffc0a32d0 2024-09-15T23:30:18.808 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/qa/sv_0/5e91be9b-f82c-4e90-8822-3fedeb073333 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 msgr2=0x7f8ffc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 0x7f8ffc0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9004009230 tx=0x7f90040058d0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 msgr2=0x7f9014198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f900800b4a0 tx=0x7f900800b960 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 shutdown_connections 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8ffc0a32d0 0x7f8ffc0a5790 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9014106f30 0x7f901419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9014100cc0 0x7f9014198a10 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 --2- 172.21.15.77:0/2513626163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9014100310 0x7f90141984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.809+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 >> 172.21.15.77:0/2513626163 conn(0x7f9014077210 msgr2=0x7f90140fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.810+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 shutdown_connections 2024-09-15T23:30:18.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:18.810+0000 7f901a92a640 1 -- 172.21.15.77:0/2513626163 wait complete. 2024-09-15T23:30:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:18 smithi077 ceph-mon[30968]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:19.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:18 smithi077 ceph-mon[30968]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T23:30:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:18 smithi159 ceph-mon[35472]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:18 smithi159 ceph-mon[35472]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T23:30:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:18 smithi155 ceph-mon[35631]: from='client.14781 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:18 smithi155 ceph-mon[35631]: pgmap v310: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-15T23:30:19.463 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-15T23:30:19.712 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:20.084 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:19 smithi077 ceph-mon[30968]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 -- 172.21.15.77:0/1674745641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8101420 msgr2=0x7f64b810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:20.183 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/1674745641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8101420 0x7f64b810d950 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f64b0009cd0 tx=0x7f64b002a8e0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 -- 172.21.15.77:0/1674745641 shutdown_connections 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/1674745641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8101420 0x7f64b810d950 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/1674745641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8100a80 0x7f64b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/1674745641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 0x7f64b8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 -- 172.21.15.77:0/1674745641 >> 172.21.15.77:0/1674745641 conn(0x7f64b80fc7a0 msgr2=0x7f64b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 -- 172.21.15.77:0/1674745641 shutdown_connections 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.166+0000 7f64bcf9f640 1 -- 172.21.15.77:0/1674745641 wait complete. 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 Processor -- start 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 -- start start 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8101420 0x7f64b8199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 0x7f64b81a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:20.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8110e80 con 0x7f64b8100a80 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8110d00 con 0x7f64b8101420 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64bcf9f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f64b8111000 con 0x7f64b8106a80 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64b659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64b659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45568/0 (socket says 172.21.15.77:45568) 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.167+0000 7f64b659c640 1 -- 172.21.15.77:0/2424295403 learned_addr learned my addr 172.21.15.77:0/2424295403 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b5d9b640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8101420 0x7f64b8199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b6d9d640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 0x7f64b81a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 -- 172.21.15.77:0/2424295403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 msgr2=0x7f64b81a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 0x7f64b81a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 -- 172.21.15.77:0/2424295403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8101420 msgr2=0x7f64b8199630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8101420 0x7f64b8199630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 -- 172.21.15.77:0/2424295403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b81a46b0 con 0x7f64b8100a80 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64b659c640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c920 tx=0x7f64a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:20.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8007c70 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64a8007e10 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b81a4880 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a8018890 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.168+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b81a4dc0 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.169+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b8100ee0 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.170+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f64a8018a70 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.171+0000 7f64a77fe640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 0x7f64a00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.171+0000 7f64b5d9b640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 0x7f64a00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.171+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f64a80cff40 con 0x7f64b8100a80 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.172+0000 7f64b5d9b640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 0x7f64a00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005e10 tx=0x7f64ac005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:20.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.175+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f64a8014030 con 0x7f64b8100a80 2024-09-15T23:30:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:19 smithi159 ceph-mon[35472]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:20.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:19 smithi155 ceph-mon[35631]: from='client.14787 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:20.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.367+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f64b80fe410 con 0x7f64a00a32d0 2024-09-15T23:30:20.398 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.396+0000 7f64a77fe640 1 -- 172.21.15.77:0/2424295403 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f64b80fe410 con 0x7f64a00a32d0 2024-09-15T23:30:20.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 msgr2=0x7f64a00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:20.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 0x7f64a00a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f64ac005e10 tx=0x7f64ac005da0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 msgr2=0x7f64b81990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:20.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f64a800c920 tx=0x7f64a800cde0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 shutdown_connections 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f64a00a32d0 0x7f64a00a5790 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f64b8106a80 0x7f64b81a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64b8101420 0x7f64b8199630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 --2- 172.21.15.77:0/2424295403 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f64b8100a80 0x7f64b81990f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.398+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 >> 172.21.15.77:0/2424295403 conn(0x7f64b80fc7a0 msgr2=0x7f64b80fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.399+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 shutdown_connections 2024-09-15T23:30:20.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:20.399+0000 7f64bcf9f640 1 -- 172.21.15.77:0/2424295403 wait complete. 2024-09-15T23:30:21.046 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:20 smithi077 ceph-mon[30968]: pgmap v311: 129 pgs: 129 active+clean; 601 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T23:30:21.075 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-15T23:30:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:20 smithi159 ceph-mon[35472]: pgmap v311: 129 pgs: 129 active+clean; 601 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T23:30:21.324 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:20 smithi155 ceph-mon[35631]: pgmap v311: 129 pgs: 129 active+clean; 601 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.2 KiB/s wr, 3 op/s 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- 172.21.15.77:0/3792806383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 msgr2=0x7fdaf810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3792806383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf810da40 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0009ca0 tx=0x7fdaf002a950 comp rx=0 tx=0).stop 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- 172.21.15.77:0/3792806383 shutdown_connections 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3792806383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf810da40 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3792806383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8102570 0x7fdaf81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3792806383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8100e20 0x7fdaf8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- 172.21.15.77:0/3792806383 >> 172.21.15.77:0/3792806383 conn(0x7fdaf80fc7d0 msgr2=0x7fdaf80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- 172.21.15.77:0/3792806383 shutdown_connections 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- 172.21.15.77:0/3792806383 wait complete. 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 Processor -- start 2024-09-15T23:30:21.784 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.766+0000 7fdafe91e640 1 -- start start 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 0x7fdaf81994b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 0x7fdaf81999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8111020 con 0x7fdaf8102ef0 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf8110ea0 con 0x7fdaf8102570 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafe91e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf81111a0 con 0x7fdaf8100e20 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45586/0 (socket says 172.21.15.77:45586) 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 -- 172.21.15.77:0/3781410197 learned_addr learned my addr 172.21.15.77:0/3781410197 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdaf7fff640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 0x7fdaf81994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdaf77fe640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 0x7fdaf81999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 -- 172.21.15.77:0/3781410197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 msgr2=0x7fdaf81994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:21.785 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 0x7fdaf81994b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 -- 172.21.15.77:0/3781410197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 msgr2=0x7fdaf81999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 0x7fdaf81999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 -- 172.21.15.77:0/3781410197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf81a4a70 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdaf7fff640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 0x7fdaf81994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdaf77fe640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 0x7fdaf81999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.767+0000 7fdafcebb640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006010 tx=0x7fdaf002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.768+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0034040 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.768+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdaf0003e00 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.768+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf81a4c40 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.768+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaf0045480 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.768+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf81a50f0 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.769+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf8101280 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.770+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdaf0037020 con 0x7fdaf8102ef0 2024-09-15T23:30:21.786 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.771+0000 7fdaf57fa640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 0x7fdae40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:21.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.771+0000 7fdaf7fff640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 0x7fdae40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:21.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.771+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fdaf00f0db0 con 0x7fdaf8102ef0 2024-09-15T23:30:21.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.771+0000 7fdaf7fff640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 0x7fdae40a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009930 tx=0x7fdae8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:21.787 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.774+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fdaf00443e0 con 0x7fdaf8102ef0 2024-09-15T23:30:21.969 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:21 smithi077 ceph-mon[30968]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:21.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.968+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fdaf8109100 con 0x7fdae40a3350 2024-09-15T23:30:21.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.974+0000 7fdaf57fa640 1 -- 172.21.15.77:0/3781410197 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fdae8009140 con 0x7fdae40a3350 2024-09-15T23:30:21.975 INFO:teuthology.orchestra.run.smithi077.stdout:/volumes/qa/sv_1/bfae9bf3-7de9-4f27-8020-9419b60ab028 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 msgr2=0x7fdae40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 0x7fdae40a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009930 tx=0x7fdae8008040 comp rx=0 tx=0).stop 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 msgr2=0x7fdaf81a4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0006010 tx=0x7fdaf002f6f0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 shutdown_connections 2024-09-15T23:30:21.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fdae40a3350 0x7fdae40a5810 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fdaf8102ef0 0x7fdaf81a4530 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdaf8102570 0x7fdaf81999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 --2- 172.21.15.77:0/3781410197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdaf8100e20 0x7fdaf81994b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 >> 172.21.15.77:0/3781410197 conn(0x7fdaf80fc7d0 msgr2=0x7fdaf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 shutdown_connections 2024-09-15T23:30:21.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:21.976+0000 7fdafe91e640 1 -- 172.21.15.77:0/3781410197 wait complete. 2024-09-15T23:30:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:21 smithi159 ceph-mon[35472]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:21 smithi155 ceph-mon[35631]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:22.601 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:30:22.846 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:22 smithi159 ceph-mon[35472]: pgmap v312: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:23.242 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:22 smithi077 ceph-mon[30968]: pgmap v312: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:23.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 -- 172.21.15.77:0/2511921682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 msgr2=0x7fb45c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:23.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 --2- 172.21.15.77:0/2511921682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c106e60 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb44c009930 tx=0x7fb44c02a420 comp rx=0 tx=0).stop 2024-09-15T23:30:23.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 -- 172.21.15.77:0/2511921682 shutdown_connections 2024-09-15T23:30:23.342 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 --2- 172.21.15.77:0/2511921682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c101420 0x7fb45c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 --2- 172.21.15.77:0/2511921682 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c100a80 0x7fb45c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 --2- 172.21.15.77:0/2511921682 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c106e60 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 -- 172.21.15.77:0/2511921682 >> 172.21.15.77:0/2511921682 conn(0x7fb45c0fc7a0 msgr2=0x7fb45c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 -- 172.21.15.77:0/2511921682 shutdown_connections 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.320+0000 7fb46195c640 1 -- 172.21.15.77:0/2511921682 wait complete. 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 Processor -- start 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 -- start start 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c100a80 0x7fb45c19a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 0x7fb45c19abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c110ea0 con 0x7fb45c106a80 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c110d20 con 0x7fb45c101420 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb46195c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c111020 con 0x7fb45c100a80 2024-09-15T23:30:23.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb45b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45592/0 (socket says 172.21.15.77:45592) 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb45b7fe640 1 -- 172.21.15.77:0/2253429671 learned_addr learned my addr 172.21.15.77:0/2253429671 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.321+0000 7fb4527fc640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 0x7fb45c19abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 -- 172.21.15.77:0/2253429671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c100a80 msgr2=0x7fb45c19a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45affd640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c100a80 0x7fb45c19a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c100a80 0x7fb45c19a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 -- 172.21.15.77:0/2253429671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 msgr2=0x7fb45c19abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 0x7fb45c19abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 -- 172.21.15.77:0/2253429671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c19f640 con 0x7fb45c106a80 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb4527fc640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 0x7fb45c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb45b7fe640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b970 tx=0x7fb45400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:23.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454019070 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c19f930 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb45400cb40 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454007650 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.322+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c1a7210 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.323+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c100ee0 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.324+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb45401c070 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.325+0000 7fb46095a640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 0x7fb4480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.325+0000 7fb45affd640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 0x7fb4480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.325+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fb4540cf330 con 0x7fb45c106a80 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.325+0000 7fb45affd640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 0x7fb4480a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0096c0 tx=0x7fb44c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:23.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.329+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb45409bce0 con 0x7fb45c106a80 2024-09-15T23:30:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:22 smithi155 ceph-mon[35631]: pgmap v312: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:23.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.531+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb45c1a7440 con 0x7fb45c106a80 2024-09-15T23:30:23.532 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.531+0000 7fb46095a640 1 -- 172.21.15.77:0/2253429671 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fb45409b5e0 con 0x7fb45c106a80 2024-09-15T23:30:23.533 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:23.533 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:30:23.533 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.533+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 msgr2=0x7fb4480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.533+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 0x7fb4480a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb44c0096c0 tx=0x7fb44c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.533+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 msgr2=0x7fb45c19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.533+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb45400b970 tx=0x7fb45400be30 comp rx=0 tx=0).stop 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 shutdown_connections 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb4480a32d0 0x7fb4480a5790 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb45c106a80 0x7fb45c19ef60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb45c101420 0x7fb45c19abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 --2- 172.21.15.77:0/2253429671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb45c100a80 0x7fb45c19a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:23.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 >> 172.21.15.77:0/2253429671 conn(0x7fb45c0fc7a0 msgr2=0x7fb45c06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:23.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 shutdown_connections 2024-09-15T23:30:23.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:23.534+0000 7fb46195c640 1 -- 172.21.15.77:0/2253429671 wait complete. 2024-09-15T23:30:24.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:23 smithi077 ceph-mon[30968]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:24.130 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:23 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2253429671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:30:24.159 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:30:24.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:23 smithi159 ceph-mon[35472]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:24.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:23 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2253429671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:30:24.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:23 smithi155 ceph-mon[35631]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:30:24.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:23 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2253429671' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:30:24.404 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 -- 172.21.15.77:0/4137937800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 msgr2=0x7fb36410bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/4137937800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb36410bbd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb34c009900 tx=0x7fb34c02a480 comp rx=0 tx=0).stop 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 -- 172.21.15.77:0/4137937800 shutdown_connections 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/4137937800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/4137937800 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb36410bbd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/4137937800 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 0x7fb3641031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 -- 172.21.15.77:0/4137937800 >> 172.21.15.77:0/4137937800 conn(0x7fb3640fc7a0 msgr2=0x7fb3640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 -- 172.21.15.77:0/4137937800 shutdown_connections 2024-09-15T23:30:24.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 -- 172.21.15.77:0/4137937800 wait complete. 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.871+0000 7fb36a1b7640 1 Processor -- start 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 -- start start 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 0x7fb3641983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36419cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb364111f70 con 0x7fb3641036e0 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb364111df0 con 0x7fb36410c1a0 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb36a1b7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641120f0 con 0x7fb364102dc0 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45616/0 (socket says 172.21.15.77:45616) 2024-09-15T23:30:24.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 -- 172.21.15.77:0/1223175928 learned_addr learned my addr 172.21.15.77:0/1223175928 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb3637fe640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 0x7fb3641983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb363fff640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36419cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 -- 172.21.15.77:0/1223175928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 msgr2=0x7fb3641983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 0x7fb3641983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 -- 172.21.15.77:0/1223175928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 msgr2=0x7fb36419cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36419cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 -- 172.21.15.77:0/1223175928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36419d380 con 0x7fb3641036e0 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb363fff640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.872+0000 7fb35bfff640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb34c006010 tx=0x7fb34c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.873+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c03f030 con 0x7fb3641036e0 2024-09-15T23:30:24.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.873+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb34c003ce0 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.873+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb36419d610 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.873+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c035070 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.873+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3641a4f50 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.874+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3641031a0 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.875+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb34c042030 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.876+0000 7fb3617fa640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 0x7fb3500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.876+0000 7fb3637fe640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 0x7fb3500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.876+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fb34c0f0480 con 0x7fb3641036e0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.876+0000 7fb3637fe640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 0x7fb3500a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb354005fd0 tx=0x7fb35400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:24.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:24.880+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb34c0bcde0 con 0x7fb3641036e0 2024-09-15T23:30:25.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.050+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3641071e0 con 0x7fb3641036e0 2024-09-15T23:30:25.052 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:24 smithi077 ceph-mon[30968]: pgmap v313: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:25.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.052+0000 7fb3617fa640 1 -- 172.21.15.77:0/1223175928 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7fb34c0bc6e0 con 0x7fb3641036e0 2024-09-15T23:30:25.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:25.054 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 msgr2=0x7fb3500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 0x7fb3500a5790 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb354005fd0 tx=0x7fb35400b390 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 msgr2=0x7fb364198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb34c006010 tx=0x7fb34c0042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 shutdown_connections 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3500a32d0 0x7fb3500a5790 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb36410c1a0 0x7fb36419cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3641036e0 0x7fb364198910 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 --2- 172.21.15.77:0/1223175928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb364102dc0 0x7fb3641983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.054+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 >> 172.21.15.77:0/1223175928 conn(0x7fb3640fc7a0 msgr2=0x7fb3640fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.055+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 shutdown_connections 2024-09-15T23:30:25.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:25.055+0000 7fb36a1b7640 1 -- 172.21.15.77:0/1223175928 wait complete. 2024-09-15T23:30:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:24 smithi159 ceph-mon[35472]: pgmap v313: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:24 smithi155 ceph-mon[35631]: pgmap v313: 129 pgs: 129 active+clean; 602 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 2.3 KiB/s wr, 3 op/s 2024-09-15T23:30:25.708 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T23:30:25.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:30:25.963 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:26.201 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:25 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1223175928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:26.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:25 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1223175928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:25 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1223175928' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:26.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 -- 172.21.15.77:0/431353966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634102570 msgr2=0x7f26341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:26.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 --2- 172.21.15.77:0/431353966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634102570 0x7f26341029b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f261c009900 tx=0x7f261c02a480 comp rx=0 tx=0).stop 2024-09-15T23:30:26.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 -- 172.21.15.77:0/431353966 shutdown_connections 2024-09-15T23:30:26.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 --2- 172.21.15.77:0/431353966 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102ef0 0x7f263410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 --2- 172.21.15.77:0/431353966 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634102570 0x7f26341029b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 --2- 172.21.15.77:0/431353966 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634100e20 0x7f2634101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 -- 172.21.15.77:0/431353966 >> 172.21.15.77:0/431353966 conn(0x7f26340fc7d0 msgr2=0x7f26340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:26.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 -- 172.21.15.77:0/431353966 shutdown_connections 2024-09-15T23:30:26.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.421+0000 7f2638bc3640 1 -- 172.21.15.77:0/431353966 wait complete. 2024-09-15T23:30:26.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 Processor -- start 2024-09-15T23:30:26.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 -- start start 2024-09-15T23:30:26.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:26.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102570 0x7f2634197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 0x7f263419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2634111020 con 0x7f2634100e20 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2634110ea0 con 0x7f2634102570 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2638bc3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f26341111a0 con 0x7f2634102ef0 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45638/0 (socket says 172.21.15.77:45638) 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 -- 172.21.15.77:0/2561345503 learned_addr learned my addr 172.21.15.77:0/2561345503 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2631d9b640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102570 0x7f2634197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2632d9d640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 0x7f263419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 -- 172.21.15.77:0/2561345503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 msgr2=0x7f263419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 0x7f263419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 -- 172.21.15.77:0/2561345503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102570 msgr2=0x7f2634197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102570 0x7f2634197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f263259c640 1 -- 172.21.15.77:0/2561345503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263419c4f0 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.422+0000 7f2632d9d640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 0x7f263419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f263259c640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f262c00ba50 tx=0x7f262c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c019070 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263419c7e0 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f262c00cbe0 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c0076e0 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.423+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26341a40c0 con 0x7f2634100e20 2024-09-15T23:30:26.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.424+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2634101280 con 0x7f2634100e20 2024-09-15T23:30:26.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.425+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f262c01c070 con 0x7f2634100e20 2024-09-15T23:30:26.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.426+0000 7f262b7fe640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 0x7f26200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:26.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.426+0000 7f2631d9b640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 0x7f26200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:26.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.426+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f262c0cf2e0 con 0x7f2634100e20 2024-09-15T23:30:26.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.426+0000 7f2631d9b640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 0x7f26200a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26340ffe70 tx=0x7f261c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:26.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.430+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f262c09bd30 con 0x7f2634100e20 2024-09-15T23:30:26.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.594+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2634062630 con 0x7f26200a32d0 2024-09-15T23:30:26.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.603+0000 7f262b7fe640 1 -- 172.21.15.77:0/2561345503 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340274 (secure 0 0 0) 0x7f2634062630 con 0x7f26200a32d0 2024-09-15T23:30:26.607 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:26.609 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:30:26.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 msgr2=0x7f26200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:26.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 0x7f26200a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f26340ffe70 tx=0x7f261c005a20 comp rx=0 tx=0).stop 2024-09-15T23:30:26.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 msgr2=0x7f2634197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:26.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f262c00ba50 tx=0x7f262c00bf10 comp rx=0 tx=0).stop 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 shutdown_connections 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f26200a32d0 0x7f26200a5790 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2634102ef0 0x7f263419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2634102570 0x7f2634197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 --2- 172.21.15.77:0/2561345503 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2634100e20 0x7f2634197540 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 >> 172.21.15.77:0/2561345503 conn(0x7f26340fc7d0 msgr2=0x7f26340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 shutdown_connections 2024-09-15T23:30:26.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:26.606+0000 7f2638bc3640 1 -- 172.21.15.77:0/2561345503 wait complete. 2024-09-15T23:30:27.198 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:26 smithi077 ceph-mon[30968]: pgmap v314: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-15T23:30:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:26 smithi159 ceph-mon[35472]: pgmap v314: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-15T23:30:27.227 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-09-15T23:30:25.808257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":178,"num_write":255,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383668,"kb_used_data":13608,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558156,"statfs":{"total":1151940427776,"available":1151547551744,"internally_reserved":0,"allocated":13934592,"data_stored":7796687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45488,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":68,"num_write":25,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003183"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758198+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:29:40.758198+0000","last_peered":"2024-09-15T23:29:40.758198+0000","last_clean":"2024-09-15T23:29:40.758198+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:29:40.758198+0000","last_undegraded":"2024-09-15T23:29:40.758198+0000","last_fullsized":"2024-09-15T23:29:40.758198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757924+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:29:40.757924+0000","last_peered":"2024-09-15T23:29:40.757924+0000","last_clean":"2024-09-15T23:29:40.757924+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:29:40.757924+0000","last_undegraded":"2024-09-15T23:29:40.757924+0000","last_fullsized":"2024-09-15T23:29:40.757924+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762079+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:29:40.762079+0000","last_peered":"2024-09-15T23:29:40.762079+0000","last_clean":"2024-09-15T23:29:40.762079+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:29:40.762079+0000","last_undegraded":"2024-09-15T23:29:40.762079+0000","last_fullsized":"2024-09-15T23:29:40.762079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498248+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:29:41.498248+0000","last_peered":"2024-09-15T23:29:41.498248+0000","last_clean":"2024-09-15T23:29:41.498248+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:29:41.498248+0000","last_undegraded":"2024-09-15T23:29:41.498248+0000","last_fullsized":"2024-09-15T23:29:41.498248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497513+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:29:41.497513+0000","last_peered":"2024-09-15T23:29:41.497513+0000","last_clean":"2024-09-15T23:29:41.497513+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:29:41.497513+0000","last_undegraded":"2024-09-15T23:29:41.497513+0000","last_fullsized":"2024-09-15T23:29:41.497513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497528+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:29:41.497528+0000","last_peered":"2024-09-15T23:29:41.497528+0000","last_clean":"2024-09-15T23:29:41.497528+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:29:41.497528+0000","last_undegraded":"2024-09-15T23:29:41.497528+0000","last_fullsized":"2024-09-15T23:29:41.497528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962385+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:29:40.962385+0000","last_peered":"2024-09-15T23:29:40.962385+0000","last_clean":"2024-09-15T23:29:40.962385+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:29:40.962385+0000","last_undegraded":"2024-09-15T23:29:40.962385+0000","last_fullsized":"2024-09-15T23:29:40.962385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497999+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:29:41.497999+0000","last_peered":"2024-09-15T23:29:41.497999+0000","last_clean":"2024-09-15T23:29:41.497999+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:29:41.497999+0000","last_undegraded":"2024-09-15T23:29:41.497999+0000","last_fullsized":"2024-09-15T23:29:41.497999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499116+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:29:41.499116+0000","last_peered":"2024-09-15T23:29:41.499116+0000","last_clean":"2024-09-15T23:29:41.499116+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:29:41.499116+0000","last_undegraded":"2024-09-15T23:29:41.499116+0000","last_fullsized":"2024-09-15T23:29:41.499116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962445+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:29:40.962445+0000","last_peered":"2024-09-15T23:29:40.962445+0000","last_clean":"2024-09-15T23:29:40.962445+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:29:40.962445+0000","last_undegraded":"2024-09-15T23:29:40.962445+0000","last_fullsized":"2024-09-15T23:29:40.962445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942736+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:29:40.942736+0000","last_peered":"2024-09-15T23:29:40.942736+0000","last_clean":"2024-09-15T23:29:40.942736+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:29:40.942736+0000","last_undegraded":"2024-09-15T23:29:40.942736+0000","last_fullsized":"2024-09-15T23:29:40.942736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498010+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:29:41.498010+0000","last_peered":"2024-09-15T23:29:41.498010+0000","last_clean":"2024-09-15T23:29:41.498010+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:29:41.498010+0000","last_undegraded":"2024-09-15T23:29:41.498010+0000","last_fullsized":"2024-09-15T23:29:41.498010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760259+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:29:40.760259+0000","last_peered":"2024-09-15T23:29:40.760259+0000","last_clean":"2024-09-15T23:29:40.760259+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:29:40.760259+0000","last_undegraded":"2024-09-15T23:29:40.760259+0000","last_fullsized":"2024-09-15T23:29:40.760259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497493+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:29:41.497493+0000","last_peered":"2024-09-15T23:29:41.497493+0000","last_clean":"2024-09-15T23:29:41.497493+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:29:41.497493+0000","last_undegraded":"2024-09-15T23:29:41.497493+0000","last_fullsized":"2024-09-15T23:29:41.497493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498275+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:29:41.498275+0000","last_peered":"2024-09-15T23:29:41.498275+0000","last_clean":"2024-09-15T23:29:41.498275+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:29:41.498275+0000","last_undegraded":"2024-09-15T23:29:41.498275+0000","last_fullsized":"2024-09-15T23:29:41.498275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497583+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:29:41.497583+0000","last_peered":"2024-09-15T23:29:41.497583+0000","last_clean":"2024-09-15T23:29:41.497583+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:29:41.497583+0000","last_undegraded":"2024-09-15T23:29:41.497583+0000","last_fullsized":"2024-09-15T23:29:41.497583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762228+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:29:40.762228+0000","last_peered":"2024-09-15T23:29:40.762228+0000","last_clean":"2024-09-15T23:29:40.762228+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:29:40.762228+0000","last_undegraded":"2024-09-15T23:29:40.762228+0000","last_fullsized":"2024-09-15T23:29:40.762228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499339+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:29:41.499339+0000","last_peered":"2024-09-15T23:29:41.499339+0000","last_clean":"2024-09-15T23:29:41.499339+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:29:41.499339+0000","last_undegraded":"2024-09-15T23:29:41.499339+0000","last_fullsized":"2024-09-15T23:29:41.499339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497477+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:29:41.497477+0000","last_peered":"2024-09-15T23:29:41.497477+0000","last_clean":"2024-09-15T23:29:41.497477+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:29:41.497477+0000","last_undegraded":"2024-09-15T23:29:41.497477+0000","last_fullsized":"2024-09-15T23:29:41.497477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498139+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:29:41.498139+0000","last_peered":"2024-09-15T23:29:41.498139+0000","last_clean":"2024-09-15T23:29:41.498139+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:29:41.498139+0000","last_undegraded":"2024-09-15T23:29:41.498139+0000","last_fullsized":"2024-09-15T23:29:41.498139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758044+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:29:40.758044+0000","last_peered":"2024-09-15T23:29:40.758044+0000","last_clean":"2024-09-15T23:29:40.758044+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:29:40.758044+0000","last_undegraded":"2024-09-15T23:29:40.758044+0000","last_fullsized":"2024-09-15T23:29:40.758044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.961898+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:29:40.961898+0000","last_peered":"2024-09-15T23:29:40.961898+0000","last_clean":"2024-09-15T23:29:40.961898+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:29:40.961898+0000","last_undegraded":"2024-09-15T23:29:40.961898+0000","last_fullsized":"2024-09-15T23:29:40.961898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497712+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:29:41.497712+0000","last_peered":"2024-09-15T23:29:41.497712+0000","last_clean":"2024-09-15T23:29:41.497712+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:29:41.497712+0000","last_undegraded":"2024-09-15T23:29:41.497712+0000","last_fullsized":"2024-09-15T23:29:41.497712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498021+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:29:41.498021+0000","last_peered":"2024-09-15T23:29:41.498021+0000","last_clean":"2024-09-15T23:29:41.498021+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:29:41.498021+0000","last_undegraded":"2024-09-15T23:29:41.498021+0000","last_fullsized":"2024-09-15T23:29:41.498021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497967+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:29:41.497967+0000","last_peered":"2024-09-15T23:29:41.497967+0000","last_clean":"2024-09-15T23:29:41.497967+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:29:41.497967+0000","last_undegraded":"2024-09-15T23:29:41.497967+0000","last_fullsized":"2024-09-15T23:29:41.497967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499064+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:29:41.499064+0000","last_peered":"2024-09-15T23:29:41.499064+0000","last_clean":"2024-09-15T23:29:41.499064+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:29:41.499064+0000","last_undegraded":"2024-09-15T23:29:41.499064+0000","last_fullsized":"2024-09-15T23:29:41.499064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762494+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:29:40.762494+0000","last_peered":"2024-09-15T23:29:40.762494+0000","last_clean":"2024-09-15T23:29:40.762494+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:29:40.762494+0000","last_undegraded":"2024-09-15T23:29:40.762494+0000","last_fullsized":"2024-09-15T23:29:40.762494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498362+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:29:41.498362+0000","last_peered":"2024-09-15T23:29:41.498362+0000","last_clean":"2024-09-15T23:29:41.498362+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:29:41.498362+0000","last_undegraded":"2024-09-15T23:29:41.498362+0000","last_fullsized":"2024-09-15T23:29:41.498362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:30:20.707850+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:30:20.707850+0000","last_peered":"2024-09-15T23:30:20.707850+0000","last_clean":"2024-09-15T23:30:20.707850+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:30:20.707850+0000","last_undegraded":"2024-09-15T23:30:20.707850+0000","last_fullsized":"2024-09-15T23:30:20.707850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497352+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:29:41.497352+0000","last_peered":"2024-09-15T23:29:41.497352+0000","last_clean":"2024-09-15T23:29:41.497352+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:29:41.497352+0000","last_undegraded":"2024-09-15T23:29:41.497352+0000","last_fullsized":"2024-09-15T23:29:41.497352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911884+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:29:40.911884+0000","last_peered":"2024-09-15T23:29:40.911884+0000","last_clean":"2024-09-15T23:29:40.911884+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:29:40.911884+0000","last_undegraded":"2024-09-15T23:29:40.911884+0000","last_fullsized":"2024-09-15T23:29:40.911884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962393+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:29:40.962393+0000","last_peered":"2024-09-15T23:29:40.962393+0000","last_clean":"2024-09-15T23:29:40.962393+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:29:40.962393+0000","last_undegraded":"2024-09-15T23:29:40.962393+0000","last_fullsized":"2024-09-15T23:29:40.962393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497645+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:29:41.497645+0000","last_peered":"2024-09-15T23:29:41.497645+0000","last_clean":"2024-09-15T23:29:41.497645+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:29:41.497645+0000","last_undegraded":"2024-09-15T23:29:41.497645+0000","last_fullsized":"2024-09-15T23:29:41.497645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498592+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:29:41.498592+0000","last_peered":"2024-09-15T23:29:41.498592+0000","last_clean":"2024-09-15T23:29:41.498592+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:29:41.498592+0000","last_undegraded":"2024-09-15T23:29:41.498592+0000","last_fullsized":"2024-09-15T23:29:41.498592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757915+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:29:40.757915+0000","last_peered":"2024-09-15T23:29:40.757915+0000","last_clean":"2024-09-15T23:29:40.757915+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:29:40.757915+0000","last_undegraded":"2024-09-15T23:29:40.757915+0000","last_fullsized":"2024-09-15T23:29:40.757915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962015+0000","last_change":"2024-09-15T23:29:38.299421+0000","last_active":"2024-09-15T23:29:40.962015+0000","last_peered":"2024-09-15T23:29:40.962015+0000","last_clean":"2024-09-15T23:29:40.962015+0000","last_became_active":"2024-09-15T23:29:38.298992+0000","last_became_peered":"2024-09-15T23:29:38.298992+0000","last_unstale":"2024-09-15T23:29:40.962015+0000","last_undegraded":"2024-09-15T23:29:40.962015+0000","last_fullsized":"2024-09-15T23:29:40.962015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:11.235582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498766+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:29:41.498766+0000","last_peered":"2024-09-15T23:29:41.498766+0000","last_clean":"2024-09-15T23:29:41.498766+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:29:41.498766+0000","last_undegraded":"2024-09-15T23:29:41.498766+0000","last_fullsized":"2024-09-15T23:29:41.498766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760446+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:29:40.760446+0000","last_peered":"2024-09-15T23:29:40.760446+0000","last_clean":"2024-09-15T23:29:40.760446+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:29:40.760446+0000","last_undegraded":"2024-09-15T23:29:40.760446+0000","last_fullsized":"2024-09-15T23:29:40.760446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911780+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:29:40.911780+0000","last_peered":"2024-09-15T23:29:40.911780+0000","last_clean":"2024-09-15T23:29:40.911780+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:29:40.911780+0000","last_undegraded":"2024-09-15T23:29:40.911780+0000","last_fullsized":"2024-09-15T23:29:40.911780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942468+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:29:40.942468+0000","last_peered":"2024-09-15T23:29:40.942468+0000","last_clean":"2024-09-15T23:29:40.942468+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:29:40.942468+0000","last_undegraded":"2024-09-15T23:29:40.942468+0000","last_fullsized":"2024-09-15T23:29:40.942468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911564+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:29:40.911564+0000","last_peered":"2024-09-15T23:29:40.911564+0000","last_clean":"2024-09-15T23:29:40.911564+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:29:40.911564+0000","last_undegraded":"2024-09-15T23:29:40.911564+0000","last_fullsized":"2024-09-15T23:29:40.911564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911844+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:29:40.911844+0000","last_peered":"2024-09-15T23:29:40.911844+0000","last_clean":"2024-09-15T23:29:40.911844+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:29:40.911844+0000","last_undegraded":"2024-09-15T23:29:40.911844+0000","last_fullsized":"2024-09-15T23:29:40.911844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911452+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:29:40.911452+0000","last_peered":"2024-09-15T23:29:40.911452+0000","last_clean":"2024-09-15T23:29:40.911452+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:29:40.911452+0000","last_undegraded":"2024-09-15T23:29:40.911452+0000","last_fullsized":"2024-09-15T23:29:40.911452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760297+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:29:40.760297+0000","last_peered":"2024-09-15T23:29:40.760297+0000","last_clean":"2024-09-15T23:29:40.760297+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:29:40.760297+0000","last_undegraded":"2024-09-15T23:29:40.760297+0000","last_fullsized":"2024-09-15T23:29:40.760297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942969+0000","last_change":"2024-09-15T23:29:38.300131+0000","last_active":"2024-09-15T23:29:40.942969+0000","last_peered":"2024-09-15T23:29:40.942969+0000","last_clean":"2024-09-15T23:29:40.942969+0000","last_became_active":"2024-09-15T23:29:38.299499+0000","last_became_peered":"2024-09-15T23:29:38.299499+0000","last_unstale":"2024-09-15T23:29:40.942969+0000","last_undegraded":"2024-09-15T23:29:40.942969+0000","last_fullsized":"2024-09-15T23:29:40.942969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:18.015836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757528+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:29:40.757528+0000","last_peered":"2024-09-15T23:29:40.757528+0000","last_clean":"2024-09-15T23:29:40.757528+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:29:40.757528+0000","last_undegraded":"2024-09-15T23:29:40.757528+0000","last_fullsized":"2024-09-15T23:29:40.757528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499239+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:29:41.499239+0000","last_peered":"2024-09-15T23:29:41.499239+0000","last_clean":"2024-09-15T23:29:41.499239+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:29:41.499239+0000","last_undegraded":"2024-09-15T23:29:41.499239+0000","last_fullsized":"2024-09-15T23:29:41.499239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760491+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:29:40.760491+0000","last_peered":"2024-09-15T23:29:40.760491+0000","last_clean":"2024-09-15T23:29:40.760491+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:29:40.760491+0000","last_undegraded":"2024-09-15T23:29:40.760491+0000","last_fullsized":"2024-09-15T23:29:40.760491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760845+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:29:40.760845+0000","last_peered":"2024-09-15T23:29:40.760845+0000","last_clean":"2024-09-15T23:29:40.760845+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:29:40.760845+0000","last_undegraded":"2024-09-15T23:29:40.760845+0000","last_fullsized":"2024-09-15T23:29:40.760845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760909+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:29:40.760909+0000","last_peered":"2024-09-15T23:29:40.760909+0000","last_clean":"2024-09-15T23:29:40.760909+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:29:40.760909+0000","last_undegraded":"2024-09-15T23:29:40.760909+0000","last_fullsized":"2024-09-15T23:29:40.760909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762711+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:29:40.762711+0000","last_peered":"2024-09-15T23:29:40.762711+0000","last_clean":"2024-09-15T23:29:40.762711+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:29:40.762711+0000","last_undegraded":"2024-09-15T23:29:40.762711+0000","last_fullsized":"2024-09-15T23:29:40.762711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497942+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:29:41.497942+0000","last_peered":"2024-09-15T23:29:41.497942+0000","last_clean":"2024-09-15T23:29:41.497942+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:29:41.497942+0000","last_undegraded":"2024-09-15T23:29:41.497942+0000","last_fullsized":"2024-09-15T23:29:41.497942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760810+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:29:40.760810+0000","last_peered":"2024-09-15T23:29:40.760810+0000","last_clean":"2024-09-15T23:29:40.760810+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:29:40.760810+0000","last_undegraded":"2024-09-15T23:29:40.760810+0000","last_fullsized":"2024-09-15T23:29:40.760810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.943170+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:29:40.943170+0000","last_peered":"2024-09-15T23:29:40.943170+0000","last_clean":"2024-09-15T23:29:40.943170+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:29:40.943170+0000","last_undegraded":"2024-09-15T23:29:40.943170+0000","last_fullsized":"2024-09-15T23:29:40.943170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497909+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:29:41.497909+0000","last_peered":"2024-09-15T23:29:41.497909+0000","last_clean":"2024-09-15T23:29:41.497909+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:29:41.497909+0000","last_undegraded":"2024-09-15T23:29:41.497909+0000","last_fullsized":"2024-09-15T23:29:41.497909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760648+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:29:40.760648+0000","last_peered":"2024-09-15T23:29:40.760648+0000","last_clean":"2024-09-15T23:29:40.760648+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:29:40.760648+0000","last_undegraded":"2024-09-15T23:29:40.760648+0000","last_fullsized":"2024-09-15T23:29:40.760648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.912005+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:29:40.912005+0000","last_peered":"2024-09-15T23:29:40.912005+0000","last_clean":"2024-09-15T23:29:40.912005+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:29:40.912005+0000","last_undegraded":"2024-09-15T23:29:40.912005+0000","last_fullsized":"2024-09-15T23:29:40.912005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942302+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:29:40.942302+0000","last_peered":"2024-09-15T23:29:40.942302+0000","last_clean":"2024-09-15T23:29:40.942302+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:29:40.942302+0000","last_undegraded":"2024-09-15T23:29:40.942302+0000","last_fullsized":"2024-09-15T23:29:40.942302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497855+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:29:41.497855+0000","last_peered":"2024-09-15T23:29:41.497855+0000","last_clean":"2024-09-15T23:29:41.497855+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:29:41.497855+0000","last_undegraded":"2024-09-15T23:29:41.497855+0000","last_fullsized":"2024-09-15T23:29:41.497855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962393+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:29:40.962393+0000","last_peered":"2024-09-15T23:29:40.962393+0000","last_clean":"2024-09-15T23:29:40.962393+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:29:40.962393+0000","last_undegraded":"2024-09-15T23:29:40.962393+0000","last_fullsized":"2024-09-15T23:29:40.962393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942303+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:29:40.942303+0000","last_peered":"2024-09-15T23:29:40.942303+0000","last_clean":"2024-09-15T23:29:40.942303+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:29:40.942303+0000","last_undegraded":"2024-09-15T23:29:40.942303+0000","last_fullsized":"2024-09-15T23:29:40.942303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942548+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:29:40.942548+0000","last_peered":"2024-09-15T23:29:40.942548+0000","last_clean":"2024-09-15T23:29:40.942548+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:29:40.942548+0000","last_undegraded":"2024-09-15T23:29:40.942548+0000","last_fullsized":"2024-09-15T23:29:40.942548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.961931+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:29:40.961931+0000","last_peered":"2024-09-15T23:29:40.961931+0000","last_clean":"2024-09-15T23:29:40.961931+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:29:40.961931+0000","last_undegraded":"2024-09-15T23:29:40.961931+0000","last_fullsized":"2024-09-15T23:29:40.961931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911961+0000","last_change":"2024-09-15T23:29:37.759907+0000","last_active":"2024-09-15T23:29:40.911961+0000","last_peered":"2024-09-15T23:29:40.911961+0000","last_clean":"2024-09-15T23:29:40.911961+0000","last_became_active":"2024-09-15T23:29:37.759425+0000","last_became_peered":"2024-09-15T23:29:37.759425+0000","last_unstale":"2024-09-15T23:29:40.911961+0000","last_undegraded":"2024-09-15T23:29:40.911961+0000","last_fullsized":"2024-09-15T23:29:40.911961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:35.209476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760172+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:29:40.760172+0000","last_peered":"2024-09-15T23:29:40.760172+0000","last_clean":"2024-09-15T23:29:40.760172+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:29:40.760172+0000","last_undegraded":"2024-09-15T23:29:40.760172+0000","last_fullsized":"2024-09-15T23:29:40.760172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498748+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:29:41.498748+0000","last_peered":"2024-09-15T23:29:41.498748+0000","last_clean":"2024-09-15T23:29:41.498748+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:29:41.498748+0000","last_undegraded":"2024-09-15T23:29:41.498748+0000","last_fullsized":"2024-09-15T23:29:41.498748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758048+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:29:40.758048+0000","last_peered":"2024-09-15T23:29:40.758048+0000","last_clean":"2024-09-15T23:29:40.758048+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:29:40.758048+0000","last_undegraded":"2024-09-15T23:29:40.758048+0000","last_fullsized":"2024-09-15T23:29:40.758048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760580+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:29:40.760580+0000","last_peered":"2024-09-15T23:29:40.760580+0000","last_clean":"2024-09-15T23:29:40.760580+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:29:40.760580+0000","last_undegraded":"2024-09-15T23:29:40.760580+0000","last_fullsized":"2024-09-15T23:29:40.760580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942724+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:29:40.942724+0000","last_peered":"2024-09-15T23:29:40.942724+0000","last_clean":"2024-09-15T23:29:40.942724+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:29:40.942724+0000","last_undegraded":"2024-09-15T23:29:40.942724+0000","last_fullsized":"2024-09-15T23:29:40.942724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497667+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:29:41.497667+0000","last_peered":"2024-09-15T23:29:41.497667+0000","last_clean":"2024-09-15T23:29:41.497667+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:29:41.497667+0000","last_undegraded":"2024-09-15T23:29:41.497667+0000","last_fullsized":"2024-09-15T23:29:41.497667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911591+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:29:40.911591+0000","last_peered":"2024-09-15T23:29:40.911591+0000","last_clean":"2024-09-15T23:29:40.911591+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:29:40.911591+0000","last_undegraded":"2024-09-15T23:29:40.911591+0000","last_fullsized":"2024-09-15T23:29:40.911591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762555+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:29:40.762555+0000","last_peered":"2024-09-15T23:29:40.762555+0000","last_clean":"2024-09-15T23:29:40.762555+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:29:40.762555+0000","last_undegraded":"2024-09-15T23:29:40.762555+0000","last_fullsized":"2024-09-15T23:29:40.762555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942904+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:29:40.942904+0000","last_peered":"2024-09-15T23:29:40.942904+0000","last_clean":"2024-09-15T23:29:40.942904+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:29:40.942904+0000","last_undegraded":"2024-09-15T23:29:40.942904+0000","last_fullsized":"2024-09-15T23:29:40.942904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962189+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:29:40.962189+0000","last_peered":"2024-09-15T23:29:40.962189+0000","last_clean":"2024-09-15T23:29:40.962189+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:29:40.962189+0000","last_undegraded":"2024-09-15T23:29:40.962189+0000","last_fullsized":"2024-09-15T23:29:40.962189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'24","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:30:22.926963+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:30:22.926963+0000","last_peered":"2024-09-15T23:30:22.926963+0000","last_clean":"2024-09-15T23:30:22.926963+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:30:22.926963+0000","last_undegraded":"2024-09-15T23:30:22.926963+0000","last_fullsized":"2024-09-15T23:30:22.926963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757697+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:29:40.757697+0000","last_peered":"2024-09-15T23:29:40.757697+0000","last_clean":"2024-09-15T23:29:40.757697+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:29:40.757697+0000","last_undegraded":"2024-09-15T23:29:40.757697+0000","last_fullsized":"2024-09-15T23:29:40.757697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498037+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:29:41.498037+0000","last_peered":"2024-09-15T23:29:41.498037+0000","last_clean":"2024-09-15T23:29:41.498037+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:29:41.498037+0000","last_undegraded":"2024-09-15T23:29:41.498037+0000","last_fullsized":"2024-09-15T23:29:41.498037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.943092+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:29:40.943092+0000","last_peered":"2024-09-15T23:29:40.943092+0000","last_clean":"2024-09-15T23:29:40.943092+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:29:40.943092+0000","last_undegraded":"2024-09-15T23:29:40.943092+0000","last_fullsized":"2024-09-15T23:29:40.943092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498796+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:29:41.498796+0000","last_peered":"2024-09-15T23:29:41.498796+0000","last_clean":"2024-09-15T23:29:41.498796+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:29:41.498796+0000","last_undegraded":"2024-09-15T23:29:41.498796+0000","last_fullsized":"2024-09-15T23:29:41.498796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497608+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:29:41.497608+0000","last_peered":"2024-09-15T23:29:41.497608+0000","last_clean":"2024-09-15T23:29:41.497608+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:29:41.497608+0000","last_undegraded":"2024-09-15T23:29:41.497608+0000","last_fullsized":"2024-09-15T23:29:41.497608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760509+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:29:40.760509+0000","last_peered":"2024-09-15T23:29:40.760509+0000","last_clean":"2024-09-15T23:29:40.760509+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:29:40.760509+0000","last_undegraded":"2024-09-15T23:29:40.760509+0000","last_fullsized":"2024-09-15T23:29:40.760509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757869+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:29:40.757869+0000","last_peered":"2024-09-15T23:29:40.757869+0000","last_clean":"2024-09-15T23:29:40.757869+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:29:40.757869+0000","last_undegraded":"2024-09-15T23:29:40.757869+0000","last_fullsized":"2024-09-15T23:29:40.757869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498297+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:29:41.498297+0000","last_peered":"2024-09-15T23:29:41.498297+0000","last_clean":"2024-09-15T23:29:41.498297+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:29:41.498297+0000","last_undegraded":"2024-09-15T23:29:41.498297+0000","last_fullsized":"2024-09-15T23:29:41.498297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499083+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:29:41.499083+0000","last_peered":"2024-09-15T23:29:41.499083+0000","last_clean":"2024-09-15T23:29:41.499083+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:29:41.499083+0000","last_undegraded":"2024-09-15T23:29:41.499083+0000","last_fullsized":"2024-09-15T23:29:41.499083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497884+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:29:41.497884+0000","last_peered":"2024-09-15T23:29:41.497884+0000","last_clean":"2024-09-15T23:29:41.497884+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:29:41.497884+0000","last_undegraded":"2024-09-15T23:29:41.497884+0000","last_fullsized":"2024-09-15T23:29:41.497884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497785+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:29:41.497785+0000","last_peered":"2024-09-15T23:29:41.497785+0000","last_clean":"2024-09-15T23:29:41.497785+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:29:41.497785+0000","last_undegraded":"2024-09-15T23:29:41.497785+0000","last_fullsized":"2024-09-15T23:29:41.497785+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757545+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:29:40.757545+0000","last_peered":"2024-09-15T23:29:40.757545+0000","last_clean":"2024-09-15T23:29:40.757545+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:29:40.757545+0000","last_undegraded":"2024-09-15T23:29:40.757545+0000","last_fullsized":"2024-09-15T23:29:40.757545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942707+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:29:40.942707+0000","last_peered":"2024-09-15T23:29:40.942707+0000","last_clean":"2024-09-15T23:29:40.942707+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:29:40.942707+0000","last_undegraded":"2024-09-15T23:29:40.942707+0000","last_fullsized":"2024-09-15T23:29:40.942707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497929+0000","last_change":"2024-09-15T23:29:37.760930+0000","last_active":"2024-09-15T23:29:41.497929+0000","last_peered":"2024-09-15T23:29:41.497929+0000","last_clean":"2024-09-15T23:29:41.497929+0000","last_became_active":"2024-09-15T23:29:37.760456+0000","last_became_peered":"2024-09-15T23:29:37.760456+0000","last_unstale":"2024-09-15T23:29:41.497929+0000","last_undegraded":"2024-09-15T23:29:41.497929+0000","last_fullsized":"2024-09-15T23:29:41.497929+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.876570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498297+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:29:41.498297+0000","last_peered":"2024-09-15T23:29:41.498297+0000","last_clean":"2024-09-15T23:29:41.498297+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:29:41.498297+0000","last_undegraded":"2024-09-15T23:29:41.498297+0000","last_fullsized":"2024-09-15T23:29:41.498297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911455+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:29:40.911455+0000","last_peered":"2024-09-15T23:29:40.911455+0000","last_clean":"2024-09-15T23:29:40.911455+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:29:40.911455+0000","last_undegraded":"2024-09-15T23:29:40.911455+0000","last_fullsized":"2024-09-15T23:29:40.911455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498575+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:29:41.498575+0000","last_peered":"2024-09-15T23:29:41.498575+0000","last_clean":"2024-09-15T23:29:41.498575+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:29:41.498575+0000","last_undegraded":"2024-09-15T23:29:41.498575+0000","last_fullsized":"2024-09-15T23:29:41.498575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942744+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:29:40.942744+0000","last_peered":"2024-09-15T23:29:40.942744+0000","last_clean":"2024-09-15T23:29:40.942744+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:29:40.942744+0000","last_undegraded":"2024-09-15T23:29:40.942744+0000","last_fullsized":"2024-09-15T23:29:40.942744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762226+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:29:40.762226+0000","last_peered":"2024-09-15T23:29:40.762226+0000","last_clean":"2024-09-15T23:29:40.762226+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:29:40.762226+0000","last_undegraded":"2024-09-15T23:29:40.762226+0000","last_fullsized":"2024-09-15T23:29:40.762226+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942882+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:29:40.942882+0000","last_peered":"2024-09-15T23:29:40.942882+0000","last_clean":"2024-09-15T23:29:40.942882+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:29:40.942882+0000","last_undegraded":"2024-09-15T23:29:40.942882+0000","last_fullsized":"2024-09-15T23:29:40.942882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962027+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:29:40.962027+0000","last_peered":"2024-09-15T23:29:40.962027+0000","last_clean":"2024-09-15T23:29:40.962027+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:29:40.962027+0000","last_undegraded":"2024-09-15T23:29:40.962027+0000","last_fullsized":"2024-09-15T23:29:40.962027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762675+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:29:40.762675+0000","last_peered":"2024-09-15T23:29:40.762675+0000","last_clean":"2024-09-15T23:29:40.762675+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:29:40.762675+0000","last_undegraded":"2024-09-15T23:29:40.762675+0000","last_fullsized":"2024-09-15T23:29:40.762675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497416+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:29:41.497416+0000","last_peered":"2024-09-15T23:29:41.497416+0000","last_clean":"2024-09-15T23:29:41.497416+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:29:41.497416+0000","last_undegraded":"2024-09-15T23:29:41.497416+0000","last_fullsized":"2024-09-15T23:29:41.497416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762662+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:29:40.762662+0000","last_peered":"2024-09-15T23:29:40.762662+0000","last_clean":"2024-09-15T23:29:40.762662+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:29:40.762662+0000","last_undegraded":"2024-09-15T23:29:40.762662+0000","last_fullsized":"2024-09-15T23:29:40.762662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762059+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:29:40.762059+0000","last_peered":"2024-09-15T23:29:40.762059+0000","last_clean":"2024-09-15T23:29:40.762059+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:29:40.762059+0000","last_undegraded":"2024-09-15T23:29:40.762059+0000","last_fullsized":"2024-09-15T23:29:40.762059+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497925+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:29:41.497925+0000","last_peered":"2024-09-15T23:29:41.497925+0000","last_clean":"2024-09-15T23:29:41.497925+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:29:41.497925+0000","last_undegraded":"2024-09-15T23:29:41.497925+0000","last_fullsized":"2024-09-15T23:29:41.497925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911823+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:29:40.911823+0000","last_peered":"2024-09-15T23:29:40.911823+0000","last_clean":"2024-09-15T23:29:40.911823+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:29:40.911823+0000","last_undegraded":"2024-09-15T23:29:40.911823+0000","last_fullsized":"2024-09-15T23:29:40.911823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497762+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:29:41.497762+0000","last_peered":"2024-09-15T23:29:41.497762+0000","last_clean":"2024-09-15T23:29:41.497762+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:29:41.497762+0000","last_undegraded":"2024-09-15T23:29:41.497762+0000","last_fullsized":"2024-09-15T23:29:41.497762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762409+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:29:40.762409+0000","last_peered":"2024-09-15T23:29:40.762409+0000","last_clean":"2024-09-15T23:29:40.762409+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:29:40.762409+0000","last_undegraded":"2024-09-15T23:29:40.762409+0000","last_fullsized":"2024-09-15T23:29:40.762409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498327+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:29:41.498327+0000","last_peered":"2024-09-15T23:29:41.498327+0000","last_clean":"2024-09-15T23:29:41.498327+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:29:41.498327+0000","last_undegraded":"2024-09-15T23:29:41.498327+0000","last_fullsized":"2024-09-15T23:29:41.498327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942347+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:29:40.942347+0000","last_peered":"2024-09-15T23:29:40.942347+0000","last_clean":"2024-09-15T23:29:40.942347+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:29:40.942347+0000","last_undegraded":"2024-09-15T23:29:40.942347+0000","last_fullsized":"2024-09-15T23:29:40.942347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498071+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:29:41.498071+0000","last_peered":"2024-09-15T23:29:41.498071+0000","last_clean":"2024-09-15T23:29:41.498071+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:29:41.498071+0000","last_undegraded":"2024-09-15T23:29:41.498071+0000","last_fullsized":"2024-09-15T23:29:41.498071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498128+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:29:41.498128+0000","last_peered":"2024-09-15T23:29:41.498128+0000","last_clean":"2024-09-15T23:29:41.498128+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:29:41.498128+0000","last_undegraded":"2024-09-15T23:29:41.498128+0000","last_fullsized":"2024-09-15T23:29:41.498128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911739+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:29:40.911739+0000","last_peered":"2024-09-15T23:29:40.911739+0000","last_clean":"2024-09-15T23:29:40.911739+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:29:40.911739+0000","last_undegraded":"2024-09-15T23:29:40.911739+0000","last_fullsized":"2024-09-15T23:29:40.911739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497643+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:29:41.497643+0000","last_peered":"2024-09-15T23:29:41.497643+0000","last_clean":"2024-09-15T23:29:41.497643+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:29:41.497643+0000","last_undegraded":"2024-09-15T23:29:41.497643+0000","last_fullsized":"2024-09-15T23:29:41.497643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762643+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:29:40.762643+0000","last_peered":"2024-09-15T23:29:40.762643+0000","last_clean":"2024-09-15T23:29:40.762643+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:29:40.762643+0000","last_undegraded":"2024-09-15T23:29:40.762643+0000","last_fullsized":"2024-09-15T23:29:40.762643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758030+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:29:40.758030+0000","last_peered":"2024-09-15T23:29:40.758030+0000","last_clean":"2024-09-15T23:29:40.758030+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:29:40.758030+0000","last_undegraded":"2024-09-15T23:29:40.758030+0000","last_fullsized":"2024-09-15T23:29:40.758030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498008+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:29:41.498008+0000","last_peered":"2024-09-15T23:29:41.498008+0000","last_clean":"2024-09-15T23:29:41.498008+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:29:41.498008+0000","last_undegraded":"2024-09-15T23:29:41.498008+0000","last_fullsized":"2024-09-15T23:29:41.498008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497496+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:29:41.497496+0000","last_peered":"2024-09-15T23:29:41.497496+0000","last_clean":"2024-09-15T23:29:41.497496+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:29:41.497496+0000","last_undegraded":"2024-09-15T23:29:41.497496+0000","last_fullsized":"2024-09-15T23:29:41.497496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497153+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:29:41.497153+0000","last_peered":"2024-09-15T23:29:41.497153+0000","last_clean":"2024-09-15T23:29:41.497153+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:29:41.497153+0000","last_undegraded":"2024-09-15T23:29:41.497153+0000","last_fullsized":"2024-09-15T23:29:41.497153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497392+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:29:41.497392+0000","last_peered":"2024-09-15T23:29:41.497392+0000","last_clean":"2024-09-15T23:29:41.497392+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:29:41.497392+0000","last_undegraded":"2024-09-15T23:29:41.497392+0000","last_fullsized":"2024-09-15T23:29:41.497392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911680+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:29:40.911680+0000","last_peered":"2024-09-15T23:29:40.911680+0000","last_clean":"2024-09-15T23:29:40.911680+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:29:40.911680+0000","last_undegraded":"2024-09-15T23:29:40.911680+0000","last_fullsized":"2024-09-15T23:29:40.911680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757817+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:29:40.757817+0000","last_peered":"2024-09-15T23:29:40.757817+0000","last_clean":"2024-09-15T23:29:40.757817+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:29:40.757817+0000","last_undegraded":"2024-09-15T23:29:40.757817+0000","last_fullsized":"2024-09-15T23:29:40.757817+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760842+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:29:40.760842+0000","last_peered":"2024-09-15T23:29:40.760842+0000","last_clean":"2024-09-15T23:29:40.760842+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:29:40.760842+0000","last_undegraded":"2024-09-15T23:29:40.760842+0000","last_fullsized":"2024-09-15T23:29:40.760842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498986+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:29:41.498986+0000","last_peered":"2024-09-15T23:29:41.498986+0000","last_clean":"2024-09-15T23:29:41.498986+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:29:41.498986+0000","last_undegraded":"2024-09-15T23:29:41.498986+0000","last_fullsized":"2024-09-15T23:29:41.498986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498085+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:29:41.498085+0000","last_peered":"2024-09-15T23:29:41.498085+0000","last_clean":"2024-09-15T23:29:41.498085+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:29:41.498085+0000","last_undegraded":"2024-09-15T23:29:41.498085+0000","last_fullsized":"2024-09-15T23:29:41.498085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497519+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:29:41.497519+0000","last_peered":"2024-09-15T23:29:41.497519+0000","last_clean":"2024-09-15T23:29:41.497519+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:29:41.497519+0000","last_undegraded":"2024-09-15T23:29:41.497519+0000","last_fullsized":"2024-09-15T23:29:41.497519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760559+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:29:40.760559+0000","last_peered":"2024-09-15T23:29:40.760559+0000","last_clean":"2024-09-15T23:29:40.760559+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:29:40.760559+0000","last_undegraded":"2024-09-15T23:29:40.760559+0000","last_fullsized":"2024-09-15T23:29:40.760559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498441+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:29:41.498441+0000","last_peered":"2024-09-15T23:29:41.498441+0000","last_clean":"2024-09-15T23:29:41.498441+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:29:41.498441+0000","last_undegraded":"2024-09-15T23:29:41.498441+0000","last_fullsized":"2024-09-15T23:29:41.498441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962002+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:29:40.962002+0000","last_peered":"2024-09-15T23:29:40.962002+0000","last_clean":"2024-09-15T23:29:40.962002+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:29:40.962002+0000","last_undegraded":"2024-09-15T23:29:40.962002+0000","last_fullsized":"2024-09-15T23:29:40.962002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499182+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:29:41.499182+0000","last_peered":"2024-09-15T23:29:41.499182+0000","last_clean":"2024-09-15T23:29:41.499182+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:29:41.499182+0000","last_undegraded":"2024-09-15T23:29:41.499182+0000","last_fullsized":"2024-09-15T23:29:41.499182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497511+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:29:41.497511+0000","last_peered":"2024-09-15T23:29:41.497511+0000","last_clean":"2024-09-15T23:29:41.497511+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:29:41.497511+0000","last_undegraded":"2024-09-15T23:29:41.497511+0000","last_fullsized":"2024-09-15T23:29:41.497511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497873+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:29:41.497873+0000","last_peered":"2024-09-15T23:29:41.497873+0000","last_clean":"2024-09-15T23:29:41.497873+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:29:41.497873+0000","last_undegraded":"2024-09-15T23:29:41.497873+0000","last_fullsized":"2024-09-15T23:29:41.497873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497997+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:29:41.497997+0000","last_peered":"2024-09-15T23:29:41.497997+0000","last_clean":"2024-09-15T23:29:41.497997+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:29:41.497997+0000","last_undegraded":"2024-09-15T23:29:41.497997+0000","last_fullsized":"2024-09-15T23:29:41.497997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":72,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":143935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481816,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":491844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710748,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1127408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874274,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":496522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103207,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32744,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712408,"statfs":{"total":95995035648,"available":95961505792,"internally_reserved":0,"allocated":1597440,"data_stored":1086890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":487748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1082394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953531,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":995328,"data_stored":487770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":487852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":536880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1044480,"data_stored":531093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":487838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":43345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":49132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:30:27.235 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:30:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:26 smithi155 ceph-mon[35631]: pgmap v314: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.7 KiB/s wr, 4 op/s 2024-09-15T23:30:28.125 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:28.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:27 smithi077 ceph-mon[30968]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:28.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:27 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:30:28.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:27 smithi159 ceph-mon[35472]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:28.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:27 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:30:28.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:27 smithi155 ceph-mon[35631]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:28.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:27 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:30:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 -- 172.21.15.77:0/1106407162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 msgr2=0x7feb681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 --2- 172.21.15.77:0/1106407162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb681021c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7feb60009900 tx=0x7feb6002a410 comp rx=0 tx=0).stop 2024-09-15T23:30:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 -- 172.21.15.77:0/1106407162 shutdown_connections 2024-09-15T23:30:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 --2- 172.21.15.77:0/1106407162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 0x7feb6810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 --2- 172.21.15.77:0/1106407162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 --2- 172.21.15.77:0/1106407162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb681021c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 -- 172.21.15.77:0/1106407162 >> 172.21.15.77:0/1106407162 conn(0x7feb680fd8c0 msgr2=0x7feb680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 -- 172.21.15.77:0/1106407162 shutdown_connections 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.636+0000 7feb70691640 1 -- 172.21.15.77:0/1106407162 wait complete. 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 Processor -- start 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 -- start start 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb68198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 0x7feb6819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7feb68111f30 con 0x7feb68101de0 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb68111db0 con 0x7feb68102790 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb70691640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feb681120b0 con 0x7feb68106f10 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:28.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44532/0 (socket says 172.21.15.77:44532) 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 -- 172.21.15.77:0/738467479 learned_addr learned my addr 172.21.15.77:0/738467479 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6dc2c640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb68198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6ec2e640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 0x7feb6819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 -- 172.21.15.77:0/738467479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 msgr2=0x7feb6819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 0x7feb6819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 -- 172.21.15.77:0/738467479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 msgr2=0x7feb68198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.637+0000 7feb6e42d640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb68198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb6e42d640 1 -- 172.21.15.77:0/738467479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6819d3b0 con 0x7feb68101de0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb6dc2c640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb68198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb6e42d640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb60006010 tx=0x7feb600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6003f030 con 0x7feb68101de0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6819d640 con 0x7feb68101de0 2024-09-15T23:30:28.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb60003ce0 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb60035070 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.638+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb681a4f80 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.639+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb681021c0 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.640+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7feb60042030 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.640+0000 7feb677fe640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 0x7feb500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.641+0000 7feb6dc2c640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 0x7feb500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.641+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7feb600f03f0 con 0x7feb68101de0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.641+0000 7feb6dc2c640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 0x7feb500a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb680fdce0 tx=0x7feb5c009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:28.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.645+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7feb600bcd50 con 0x7feb68101de0 2024-09-15T23:30:28.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.820+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb68062630 con 0x7feb500a32d0 2024-09-15T23:30:28.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.837+0000 7feb677fe640 1 -- 172.21.15.77:0/738467479 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340274 (secure 0 0 0) 0x7feb68062630 con 0x7feb500a32d0 2024-09-15T23:30:28.843 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:28.844 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:30:28.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 msgr2=0x7feb500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 0x7feb500a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7feb680fdce0 tx=0x7feb5c009520 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 msgr2=0x7feb68198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7feb60006010 tx=0x7feb600042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 shutdown_connections 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7feb500a32d0 0x7feb500a5790 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb68106f10 0x7feb6819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb68102790 0x7feb68198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 --2- 172.21.15.77:0/738467479 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7feb68101de0 0x7feb68198400 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 >> 172.21.15.77:0/738467479 conn(0x7feb680fd8c0 msgr2=0x7feb680fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 shutdown_connections 2024-09-15T23:30:28.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:28.841+0000 7feb70691640 1 -- 172.21.15.77:0/738467479 wait complete. 2024-09-15T23:30:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:28 smithi077 ceph-mon[30968]: pgmap v315: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-15T23:30:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:28 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:28 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:28 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:28 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:28 smithi159 ceph-mon[35472]: pgmap v315: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-15T23:30:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:28 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:28 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:28 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:28 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:28 smithi155 ceph-mon[35631]: pgmap v315: 129 pgs: 129 active+clean; 625 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 4.7 KiB/s wr, 3 op/s 2024-09-15T23:30:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:28 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:28 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:28 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:28 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:29.481 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":315,"stamp":"2024-09-15T23:30:27.808792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":640498,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":162,"num_read_kb":178,"num_write":255,"num_write_kb":3014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":383672,"kb_used_data":13616,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124558152,"statfs":{"total":1151940427776,"available":1151547547648,"internally_reserved":0,"allocated":13942784,"data_stored":7806536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":378713403},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":45488,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":55,"num_write":25,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003232"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758198+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:29:40.758198+0000","last_peered":"2024-09-15T23:29:40.758198+0000","last_clean":"2024-09-15T23:29:40.758198+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:29:40.758198+0000","last_undegraded":"2024-09-15T23:29:40.758198+0000","last_fullsized":"2024-09-15T23:29:40.758198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757924+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:29:40.757924+0000","last_peered":"2024-09-15T23:29:40.757924+0000","last_clean":"2024-09-15T23:29:40.757924+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:29:40.757924+0000","last_undegraded":"2024-09-15T23:29:40.757924+0000","last_fullsized":"2024-09-15T23:29:40.757924+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762079+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:29:40.762079+0000","last_peered":"2024-09-15T23:29:40.762079+0000","last_clean":"2024-09-15T23:29:40.762079+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:29:40.762079+0000","last_undegraded":"2024-09-15T23:29:40.762079+0000","last_fullsized":"2024-09-15T23:29:40.762079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498248+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:29:41.498248+0000","last_peered":"2024-09-15T23:29:41.498248+0000","last_clean":"2024-09-15T23:29:41.498248+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:29:41.498248+0000","last_undegraded":"2024-09-15T23:29:41.498248+0000","last_fullsized":"2024-09-15T23:29:41.498248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497513+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:29:41.497513+0000","last_peered":"2024-09-15T23:29:41.497513+0000","last_clean":"2024-09-15T23:29:41.497513+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:29:41.497513+0000","last_undegraded":"2024-09-15T23:29:41.497513+0000","last_fullsized":"2024-09-15T23:29:41.497513+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497528+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:29:41.497528+0000","last_peered":"2024-09-15T23:29:41.497528+0000","last_clean":"2024-09-15T23:29:41.497528+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:29:41.497528+0000","last_undegraded":"2024-09-15T23:29:41.497528+0000","last_fullsized":"2024-09-15T23:29:41.497528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962385+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:29:40.962385+0000","last_peered":"2024-09-15T23:29:40.962385+0000","last_clean":"2024-09-15T23:29:40.962385+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:29:40.962385+0000","last_undegraded":"2024-09-15T23:29:40.962385+0000","last_fullsized":"2024-09-15T23:29:40.962385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497999+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:29:41.497999+0000","last_peered":"2024-09-15T23:29:41.497999+0000","last_clean":"2024-09-15T23:29:41.497999+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:29:41.497999+0000","last_undegraded":"2024-09-15T23:29:41.497999+0000","last_fullsized":"2024-09-15T23:29:41.497999+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499116+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:29:41.499116+0000","last_peered":"2024-09-15T23:29:41.499116+0000","last_clean":"2024-09-15T23:29:41.499116+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:29:41.499116+0000","last_undegraded":"2024-09-15T23:29:41.499116+0000","last_fullsized":"2024-09-15T23:29:41.499116+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962445+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:29:40.962445+0000","last_peered":"2024-09-15T23:29:40.962445+0000","last_clean":"2024-09-15T23:29:40.962445+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:29:40.962445+0000","last_undegraded":"2024-09-15T23:29:40.962445+0000","last_fullsized":"2024-09-15T23:29:40.962445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942736+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:29:40.942736+0000","last_peered":"2024-09-15T23:29:40.942736+0000","last_clean":"2024-09-15T23:29:40.942736+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:29:40.942736+0000","last_undegraded":"2024-09-15T23:29:40.942736+0000","last_fullsized":"2024-09-15T23:29:40.942736+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498010+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:29:41.498010+0000","last_peered":"2024-09-15T23:29:41.498010+0000","last_clean":"2024-09-15T23:29:41.498010+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:29:41.498010+0000","last_undegraded":"2024-09-15T23:29:41.498010+0000","last_fullsized":"2024-09-15T23:29:41.498010+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760259+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:29:40.760259+0000","last_peered":"2024-09-15T23:29:40.760259+0000","last_clean":"2024-09-15T23:29:40.760259+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:29:40.760259+0000","last_undegraded":"2024-09-15T23:29:40.760259+0000","last_fullsized":"2024-09-15T23:29:40.760259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":20,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497493+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:29:41.497493+0000","last_peered":"2024-09-15T23:29:41.497493+0000","last_clean":"2024-09-15T23:29:41.497493+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:29:41.497493+0000","last_undegraded":"2024-09-15T23:29:41.497493+0000","last_fullsized":"2024-09-15T23:29:41.497493+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498275+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:29:41.498275+0000","last_peered":"2024-09-15T23:29:41.498275+0000","last_clean":"2024-09-15T23:29:41.498275+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:29:41.498275+0000","last_undegraded":"2024-09-15T23:29:41.498275+0000","last_fullsized":"2024-09-15T23:29:41.498275+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497583+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:29:41.497583+0000","last_peered":"2024-09-15T23:29:41.497583+0000","last_clean":"2024-09-15T23:29:41.497583+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:29:41.497583+0000","last_undegraded":"2024-09-15T23:29:41.497583+0000","last_fullsized":"2024-09-15T23:29:41.497583+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762228+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:29:40.762228+0000","last_peered":"2024-09-15T23:29:40.762228+0000","last_clean":"2024-09-15T23:29:40.762228+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:29:40.762228+0000","last_undegraded":"2024-09-15T23:29:40.762228+0000","last_fullsized":"2024-09-15T23:29:40.762228+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499339+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:29:41.499339+0000","last_peered":"2024-09-15T23:29:41.499339+0000","last_clean":"2024-09-15T23:29:41.499339+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:29:41.499339+0000","last_undegraded":"2024-09-15T23:29:41.499339+0000","last_fullsized":"2024-09-15T23:29:41.499339+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497477+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:29:41.497477+0000","last_peered":"2024-09-15T23:29:41.497477+0000","last_clean":"2024-09-15T23:29:41.497477+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:29:41.497477+0000","last_undegraded":"2024-09-15T23:29:41.497477+0000","last_fullsized":"2024-09-15T23:29:41.497477+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498139+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:29:41.498139+0000","last_peered":"2024-09-15T23:29:41.498139+0000","last_clean":"2024-09-15T23:29:41.498139+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:29:41.498139+0000","last_undegraded":"2024-09-15T23:29:41.498139+0000","last_fullsized":"2024-09-15T23:29:41.498139+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758044+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:29:40.758044+0000","last_peered":"2024-09-15T23:29:40.758044+0000","last_clean":"2024-09-15T23:29:40.758044+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:29:40.758044+0000","last_undegraded":"2024-09-15T23:29:40.758044+0000","last_fullsized":"2024-09-15T23:29:40.758044+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.961898+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:29:40.961898+0000","last_peered":"2024-09-15T23:29:40.961898+0000","last_clean":"2024-09-15T23:29:40.961898+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:29:40.961898+0000","last_undegraded":"2024-09-15T23:29:40.961898+0000","last_fullsized":"2024-09-15T23:29:40.961898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497712+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:29:41.497712+0000","last_peered":"2024-09-15T23:29:41.497712+0000","last_clean":"2024-09-15T23:29:41.497712+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:29:41.497712+0000","last_undegraded":"2024-09-15T23:29:41.497712+0000","last_fullsized":"2024-09-15T23:29:41.497712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498021+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:29:41.498021+0000","last_peered":"2024-09-15T23:29:41.498021+0000","last_clean":"2024-09-15T23:29:41.498021+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:29:41.498021+0000","last_undegraded":"2024-09-15T23:29:41.498021+0000","last_fullsized":"2024-09-15T23:29:41.498021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497967+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:29:41.497967+0000","last_peered":"2024-09-15T23:29:41.497967+0000","last_clean":"2024-09-15T23:29:41.497967+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:29:41.497967+0000","last_undegraded":"2024-09-15T23:29:41.497967+0000","last_fullsized":"2024-09-15T23:29:41.497967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499064+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:29:41.499064+0000","last_peered":"2024-09-15T23:29:41.499064+0000","last_clean":"2024-09-15T23:29:41.499064+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:29:41.499064+0000","last_undegraded":"2024-09-15T23:29:41.499064+0000","last_fullsized":"2024-09-15T23:29:41.499064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762494+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:29:40.762494+0000","last_peered":"2024-09-15T23:29:40.762494+0000","last_clean":"2024-09-15T23:29:40.762494+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:29:40.762494+0000","last_undegraded":"2024-09-15T23:29:40.762494+0000","last_fullsized":"2024-09-15T23:29:40.762494+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498362+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:29:41.498362+0000","last_peered":"2024-09-15T23:29:41.498362+0000","last_clean":"2024-09-15T23:29:41.498362+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:29:41.498362+0000","last_undegraded":"2024-09-15T23:29:41.498362+0000","last_fullsized":"2024-09-15T23:29:41.498362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'5","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:30:20.707850+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:30:20.707850+0000","last_peered":"2024-09-15T23:30:20.707850+0000","last_clean":"2024-09-15T23:30:20.707850+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:30:20.707850+0000","last_undegraded":"2024-09-15T23:30:20.707850+0000","last_fullsized":"2024-09-15T23:30:20.707850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497352+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:29:41.497352+0000","last_peered":"2024-09-15T23:29:41.497352+0000","last_clean":"2024-09-15T23:29:41.497352+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:29:41.497352+0000","last_undegraded":"2024-09-15T23:29:41.497352+0000","last_fullsized":"2024-09-15T23:29:41.497352+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911884+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:29:40.911884+0000","last_peered":"2024-09-15T23:29:40.911884+0000","last_clean":"2024-09-15T23:29:40.911884+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:29:40.911884+0000","last_undegraded":"2024-09-15T23:29:40.911884+0000","last_fullsized":"2024-09-15T23:29:40.911884+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962393+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:29:40.962393+0000","last_peered":"2024-09-15T23:29:40.962393+0000","last_clean":"2024-09-15T23:29:40.962393+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:29:40.962393+0000","last_undegraded":"2024-09-15T23:29:40.962393+0000","last_fullsized":"2024-09-15T23:29:40.962393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497645+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:29:41.497645+0000","last_peered":"2024-09-15T23:29:41.497645+0000","last_clean":"2024-09-15T23:29:41.497645+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:29:41.497645+0000","last_undegraded":"2024-09-15T23:29:41.497645+0000","last_fullsized":"2024-09-15T23:29:41.497645+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498592+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:29:41.498592+0000","last_peered":"2024-09-15T23:29:41.498592+0000","last_clean":"2024-09-15T23:29:41.498592+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:29:41.498592+0000","last_undegraded":"2024-09-15T23:29:41.498592+0000","last_fullsized":"2024-09-15T23:29:41.498592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757915+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:29:40.757915+0000","last_peered":"2024-09-15T23:29:40.757915+0000","last_clean":"2024-09-15T23:29:40.757915+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:29:40.757915+0000","last_undegraded":"2024-09-15T23:29:40.757915+0000","last_fullsized":"2024-09-15T23:29:40.757915+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962015+0000","last_change":"2024-09-15T23:29:38.299421+0000","last_active":"2024-09-15T23:29:40.962015+0000","last_peered":"2024-09-15T23:29:40.962015+0000","last_clean":"2024-09-15T23:29:40.962015+0000","last_became_active":"2024-09-15T23:29:38.298992+0000","last_became_peered":"2024-09-15T23:29:38.298992+0000","last_unstale":"2024-09-15T23:29:40.962015+0000","last_undegraded":"2024-09-15T23:29:40.962015+0000","last_fullsized":"2024-09-15T23:29:40.962015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:11.235582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498766+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:29:41.498766+0000","last_peered":"2024-09-15T23:29:41.498766+0000","last_clean":"2024-09-15T23:29:41.498766+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:29:41.498766+0000","last_undegraded":"2024-09-15T23:29:41.498766+0000","last_fullsized":"2024-09-15T23:29:41.498766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760446+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:29:40.760446+0000","last_peered":"2024-09-15T23:29:40.760446+0000","last_clean":"2024-09-15T23:29:40.760446+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:29:40.760446+0000","last_undegraded":"2024-09-15T23:29:40.760446+0000","last_fullsized":"2024-09-15T23:29:40.760446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911780+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:29:40.911780+0000","last_peered":"2024-09-15T23:29:40.911780+0000","last_clean":"2024-09-15T23:29:40.911780+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:29:40.911780+0000","last_undegraded":"2024-09-15T23:29:40.911780+0000","last_fullsized":"2024-09-15T23:29:40.911780+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942468+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:29:40.942468+0000","last_peered":"2024-09-15T23:29:40.942468+0000","last_clean":"2024-09-15T23:29:40.942468+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:29:40.942468+0000","last_undegraded":"2024-09-15T23:29:40.942468+0000","last_fullsized":"2024-09-15T23:29:40.942468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911564+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:29:40.911564+0000","last_peered":"2024-09-15T23:29:40.911564+0000","last_clean":"2024-09-15T23:29:40.911564+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:29:40.911564+0000","last_undegraded":"2024-09-15T23:29:40.911564+0000","last_fullsized":"2024-09-15T23:29:40.911564+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911844+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:29:40.911844+0000","last_peered":"2024-09-15T23:29:40.911844+0000","last_clean":"2024-09-15T23:29:40.911844+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:29:40.911844+0000","last_undegraded":"2024-09-15T23:29:40.911844+0000","last_fullsized":"2024-09-15T23:29:40.911844+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911452+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:29:40.911452+0000","last_peered":"2024-09-15T23:29:40.911452+0000","last_clean":"2024-09-15T23:29:40.911452+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:29:40.911452+0000","last_undegraded":"2024-09-15T23:29:40.911452+0000","last_fullsized":"2024-09-15T23:29:40.911452+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760297+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:29:40.760297+0000","last_peered":"2024-09-15T23:29:40.760297+0000","last_clean":"2024-09-15T23:29:40.760297+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:29:40.760297+0000","last_undegraded":"2024-09-15T23:29:40.760297+0000","last_fullsized":"2024-09-15T23:29:40.760297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942969+0000","last_change":"2024-09-15T23:29:38.300131+0000","last_active":"2024-09-15T23:29:40.942969+0000","last_peered":"2024-09-15T23:29:40.942969+0000","last_clean":"2024-09-15T23:29:40.942969+0000","last_became_active":"2024-09-15T23:29:38.299499+0000","last_became_peered":"2024-09-15T23:29:38.299499+0000","last_unstale":"2024-09-15T23:29:40.942969+0000","last_undegraded":"2024-09-15T23:29:40.942969+0000","last_fullsized":"2024-09-15T23:29:40.942969+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:20:18.015836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757528+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:29:40.757528+0000","last_peered":"2024-09-15T23:29:40.757528+0000","last_clean":"2024-09-15T23:29:40.757528+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:29:40.757528+0000","last_undegraded":"2024-09-15T23:29:40.757528+0000","last_fullsized":"2024-09-15T23:29:40.757528+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499239+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:29:41.499239+0000","last_peered":"2024-09-15T23:29:41.499239+0000","last_clean":"2024-09-15T23:29:41.499239+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:29:41.499239+0000","last_undegraded":"2024-09-15T23:29:41.499239+0000","last_fullsized":"2024-09-15T23:29:41.499239+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":344,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760491+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:29:40.760491+0000","last_peered":"2024-09-15T23:29:40.760491+0000","last_clean":"2024-09-15T23:29:40.760491+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:29:40.760491+0000","last_undegraded":"2024-09-15T23:29:40.760491+0000","last_fullsized":"2024-09-15T23:29:40.760491+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":18,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760845+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:29:40.760845+0000","last_peered":"2024-09-15T23:29:40.760845+0000","last_clean":"2024-09-15T23:29:40.760845+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:29:40.760845+0000","last_undegraded":"2024-09-15T23:29:40.760845+0000","last_fullsized":"2024-09-15T23:29:40.760845+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760909+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:29:40.760909+0000","last_peered":"2024-09-15T23:29:40.760909+0000","last_clean":"2024-09-15T23:29:40.760909+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:29:40.760909+0000","last_undegraded":"2024-09-15T23:29:40.760909+0000","last_fullsized":"2024-09-15T23:29:40.760909+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762711+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:29:40.762711+0000","last_peered":"2024-09-15T23:29:40.762711+0000","last_clean":"2024-09-15T23:29:40.762711+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:29:40.762711+0000","last_undegraded":"2024-09-15T23:29:40.762711+0000","last_fullsized":"2024-09-15T23:29:40.762711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497942+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:29:41.497942+0000","last_peered":"2024-09-15T23:29:41.497942+0000","last_clean":"2024-09-15T23:29:41.497942+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:29:41.497942+0000","last_undegraded":"2024-09-15T23:29:41.497942+0000","last_fullsized":"2024-09-15T23:29:41.497942+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760810+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:29:40.760810+0000","last_peered":"2024-09-15T23:29:40.760810+0000","last_clean":"2024-09-15T23:29:40.760810+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:29:40.760810+0000","last_undegraded":"2024-09-15T23:29:40.760810+0000","last_fullsized":"2024-09-15T23:29:40.760810+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.943170+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:29:40.943170+0000","last_peered":"2024-09-15T23:29:40.943170+0000","last_clean":"2024-09-15T23:29:40.943170+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:29:40.943170+0000","last_undegraded":"2024-09-15T23:29:40.943170+0000","last_fullsized":"2024-09-15T23:29:40.943170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497909+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:29:41.497909+0000","last_peered":"2024-09-15T23:29:41.497909+0000","last_clean":"2024-09-15T23:29:41.497909+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:29:41.497909+0000","last_undegraded":"2024-09-15T23:29:41.497909+0000","last_fullsized":"2024-09-15T23:29:41.497909+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760648+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:29:40.760648+0000","last_peered":"2024-09-15T23:29:40.760648+0000","last_clean":"2024-09-15T23:29:40.760648+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:29:40.760648+0000","last_undegraded":"2024-09-15T23:29:40.760648+0000","last_fullsized":"2024-09-15T23:29:40.760648+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.912005+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:29:40.912005+0000","last_peered":"2024-09-15T23:29:40.912005+0000","last_clean":"2024-09-15T23:29:40.912005+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:29:40.912005+0000","last_undegraded":"2024-09-15T23:29:40.912005+0000","last_fullsized":"2024-09-15T23:29:40.912005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942302+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:29:40.942302+0000","last_peered":"2024-09-15T23:29:40.942302+0000","last_clean":"2024-09-15T23:29:40.942302+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:29:40.942302+0000","last_undegraded":"2024-09-15T23:29:40.942302+0000","last_fullsized":"2024-09-15T23:29:40.942302+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497855+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:29:41.497855+0000","last_peered":"2024-09-15T23:29:41.497855+0000","last_clean":"2024-09-15T23:29:41.497855+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:29:41.497855+0000","last_undegraded":"2024-09-15T23:29:41.497855+0000","last_fullsized":"2024-09-15T23:29:41.497855+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":32,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962393+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:29:40.962393+0000","last_peered":"2024-09-15T23:29:40.962393+0000","last_clean":"2024-09-15T23:29:40.962393+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:29:40.962393+0000","last_undegraded":"2024-09-15T23:29:40.962393+0000","last_fullsized":"2024-09-15T23:29:40.962393+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942303+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:29:40.942303+0000","last_peered":"2024-09-15T23:29:40.942303+0000","last_clean":"2024-09-15T23:29:40.942303+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:29:40.942303+0000","last_undegraded":"2024-09-15T23:29:40.942303+0000","last_fullsized":"2024-09-15T23:29:40.942303+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942548+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:29:40.942548+0000","last_peered":"2024-09-15T23:29:40.942548+0000","last_clean":"2024-09-15T23:29:40.942548+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:29:40.942548+0000","last_undegraded":"2024-09-15T23:29:40.942548+0000","last_fullsized":"2024-09-15T23:29:40.942548+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.961931+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:29:40.961931+0000","last_peered":"2024-09-15T23:29:40.961931+0000","last_clean":"2024-09-15T23:29:40.961931+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:29:40.961931+0000","last_undegraded":"2024-09-15T23:29:40.961931+0000","last_fullsized":"2024-09-15T23:29:40.961931+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911961+0000","last_change":"2024-09-15T23:29:37.759907+0000","last_active":"2024-09-15T23:29:40.911961+0000","last_peered":"2024-09-15T23:29:40.911961+0000","last_clean":"2024-09-15T23:29:40.911961+0000","last_became_active":"2024-09-15T23:29:37.759425+0000","last_became_peered":"2024-09-15T23:29:37.759425+0000","last_unstale":"2024-09-15T23:29:40.911961+0000","last_undegraded":"2024-09-15T23:29:40.911961+0000","last_fullsized":"2024-09-15T23:29:40.911961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:35.209476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760172+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:29:40.760172+0000","last_peered":"2024-09-15T23:29:40.760172+0000","last_clean":"2024-09-15T23:29:40.760172+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:29:40.760172+0000","last_undegraded":"2024-09-15T23:29:40.760172+0000","last_fullsized":"2024-09-15T23:29:40.760172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498748+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:29:41.498748+0000","last_peered":"2024-09-15T23:29:41.498748+0000","last_clean":"2024-09-15T23:29:41.498748+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:29:41.498748+0000","last_undegraded":"2024-09-15T23:29:41.498748+0000","last_fullsized":"2024-09-15T23:29:41.498748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758048+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:29:40.758048+0000","last_peered":"2024-09-15T23:29:40.758048+0000","last_clean":"2024-09-15T23:29:40.758048+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:29:40.758048+0000","last_undegraded":"2024-09-15T23:29:40.758048+0000","last_fullsized":"2024-09-15T23:29:40.758048+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760580+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:29:40.760580+0000","last_peered":"2024-09-15T23:29:40.760580+0000","last_clean":"2024-09-15T23:29:40.760580+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:29:40.760580+0000","last_undegraded":"2024-09-15T23:29:40.760580+0000","last_fullsized":"2024-09-15T23:29:40.760580+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942724+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:29:40.942724+0000","last_peered":"2024-09-15T23:29:40.942724+0000","last_clean":"2024-09-15T23:29:40.942724+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:29:40.942724+0000","last_undegraded":"2024-09-15T23:29:40.942724+0000","last_fullsized":"2024-09-15T23:29:40.942724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497667+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:29:41.497667+0000","last_peered":"2024-09-15T23:29:41.497667+0000","last_clean":"2024-09-15T23:29:41.497667+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:29:41.497667+0000","last_undegraded":"2024-09-15T23:29:41.497667+0000","last_fullsized":"2024-09-15T23:29:41.497667+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911591+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:29:40.911591+0000","last_peered":"2024-09-15T23:29:40.911591+0000","last_clean":"2024-09-15T23:29:40.911591+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:29:40.911591+0000","last_undegraded":"2024-09-15T23:29:40.911591+0000","last_fullsized":"2024-09-15T23:29:40.911591+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762555+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:29:40.762555+0000","last_peered":"2024-09-15T23:29:40.762555+0000","last_clean":"2024-09-15T23:29:40.762555+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:29:40.762555+0000","last_undegraded":"2024-09-15T23:29:40.762555+0000","last_fullsized":"2024-09-15T23:29:40.762555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942904+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:29:40.942904+0000","last_peered":"2024-09-15T23:29:40.942904+0000","last_clean":"2024-09-15T23:29:40.942904+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:29:40.942904+0000","last_undegraded":"2024-09-15T23:29:40.942904+0000","last_fullsized":"2024-09-15T23:29:40.942904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962189+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:29:40.962189+0000","last_peered":"2024-09-15T23:29:40.962189+0000","last_clean":"2024-09-15T23:29:40.962189+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:29:40.962189+0000","last_undegraded":"2024-09-15T23:29:40.962189+0000","last_fullsized":"2024-09-15T23:29:40.962189+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'24","reported_seq":84,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:30:22.926963+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:30:22.926963+0000","last_peered":"2024-09-15T23:30:22.926963+0000","last_clean":"2024-09-15T23:30:22.926963+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:30:22.926963+0000","last_undegraded":"2024-09-15T23:30:22.926963+0000","last_fullsized":"2024-09-15T23:30:22.926963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49098,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":63,"num_write":24,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757697+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:29:40.757697+0000","last_peered":"2024-09-15T23:29:40.757697+0000","last_clean":"2024-09-15T23:29:40.757697+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:29:40.757697+0000","last_undegraded":"2024-09-15T23:29:40.757697+0000","last_fullsized":"2024-09-15T23:29:40.757697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498037+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:29:41.498037+0000","last_peered":"2024-09-15T23:29:41.498037+0000","last_clean":"2024-09-15T23:29:41.498037+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:29:41.498037+0000","last_undegraded":"2024-09-15T23:29:41.498037+0000","last_fullsized":"2024-09-15T23:29:41.498037+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":33,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.943092+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:29:40.943092+0000","last_peered":"2024-09-15T23:29:40.943092+0000","last_clean":"2024-09-15T23:29:40.943092+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:29:40.943092+0000","last_undegraded":"2024-09-15T23:29:40.943092+0000","last_fullsized":"2024-09-15T23:29:40.943092+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498796+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:29:41.498796+0000","last_peered":"2024-09-15T23:29:41.498796+0000","last_clean":"2024-09-15T23:29:41.498796+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:29:41.498796+0000","last_undegraded":"2024-09-15T23:29:41.498796+0000","last_fullsized":"2024-09-15T23:29:41.498796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497608+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:29:41.497608+0000","last_peered":"2024-09-15T23:29:41.497608+0000","last_clean":"2024-09-15T23:29:41.497608+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:29:41.497608+0000","last_undegraded":"2024-09-15T23:29:41.497608+0000","last_fullsized":"2024-09-15T23:29:41.497608+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760509+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:29:40.760509+0000","last_peered":"2024-09-15T23:29:40.760509+0000","last_clean":"2024-09-15T23:29:40.760509+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:29:40.760509+0000","last_undegraded":"2024-09-15T23:29:40.760509+0000","last_fullsized":"2024-09-15T23:29:40.760509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757869+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:29:40.757869+0000","last_peered":"2024-09-15T23:29:40.757869+0000","last_clean":"2024-09-15T23:29:40.757869+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:29:40.757869+0000","last_undegraded":"2024-09-15T23:29:40.757869+0000","last_fullsized":"2024-09-15T23:29:40.757869+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498297+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:29:41.498297+0000","last_peered":"2024-09-15T23:29:41.498297+0000","last_clean":"2024-09-15T23:29:41.498297+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:29:41.498297+0000","last_undegraded":"2024-09-15T23:29:41.498297+0000","last_fullsized":"2024-09-15T23:29:41.498297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499083+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:29:41.499083+0000","last_peered":"2024-09-15T23:29:41.499083+0000","last_clean":"2024-09-15T23:29:41.499083+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:29:41.499083+0000","last_undegraded":"2024-09-15T23:29:41.499083+0000","last_fullsized":"2024-09-15T23:29:41.499083+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497884+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:29:41.497884+0000","last_peered":"2024-09-15T23:29:41.497884+0000","last_clean":"2024-09-15T23:29:41.497884+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:29:41.497884+0000","last_undegraded":"2024-09-15T23:29:41.497884+0000","last_fullsized":"2024-09-15T23:29:41.497884+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497785+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:29:41.497785+0000","last_peered":"2024-09-15T23:29:41.497785+0000","last_clean":"2024-09-15T23:29:41.497785+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:29:41.497785+0000","last_undegraded":"2024-09-15T23:29:41.497785+0000","last_fullsized":"2024-09-15T23:29:41.497785+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757545+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:29:40.757545+0000","last_peered":"2024-09-15T23:29:40.757545+0000","last_clean":"2024-09-15T23:29:40.757545+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:29:40.757545+0000","last_undegraded":"2024-09-15T23:29:40.757545+0000","last_fullsized":"2024-09-15T23:29:40.757545+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942707+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:29:40.942707+0000","last_peered":"2024-09-15T23:29:40.942707+0000","last_clean":"2024-09-15T23:29:40.942707+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:29:40.942707+0000","last_undegraded":"2024-09-15T23:29:40.942707+0000","last_fullsized":"2024-09-15T23:29:40.942707+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497929+0000","last_change":"2024-09-15T23:29:37.760930+0000","last_active":"2024-09-15T23:29:41.497929+0000","last_peered":"2024-09-15T23:29:41.497929+0000","last_clean":"2024-09-15T23:29:41.497929+0000","last_became_active":"2024-09-15T23:29:37.760456+0000","last_became_peered":"2024-09-15T23:29:37.760456+0000","last_unstale":"2024-09-15T23:29:41.497929+0000","last_undegraded":"2024-09-15T23:29:41.497929+0000","last_fullsized":"2024-09-15T23:29:41.497929+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:02:32.876570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498297+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:29:41.498297+0000","last_peered":"2024-09-15T23:29:41.498297+0000","last_clean":"2024-09-15T23:29:41.498297+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:29:41.498297+0000","last_undegraded":"2024-09-15T23:29:41.498297+0000","last_fullsized":"2024-09-15T23:29:41.498297+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":30,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911455+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:29:40.911455+0000","last_peered":"2024-09-15T23:29:40.911455+0000","last_clean":"2024-09-15T23:29:40.911455+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:29:40.911455+0000","last_undegraded":"2024-09-15T23:29:40.911455+0000","last_fullsized":"2024-09-15T23:29:40.911455+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498575+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:29:41.498575+0000","last_peered":"2024-09-15T23:29:41.498575+0000","last_clean":"2024-09-15T23:29:41.498575+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:29:41.498575+0000","last_undegraded":"2024-09-15T23:29:41.498575+0000","last_fullsized":"2024-09-15T23:29:41.498575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942744+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:29:40.942744+0000","last_peered":"2024-09-15T23:29:40.942744+0000","last_clean":"2024-09-15T23:29:40.942744+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:29:40.942744+0000","last_undegraded":"2024-09-15T23:29:40.942744+0000","last_fullsized":"2024-09-15T23:29:40.942744+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762226+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:29:40.762226+0000","last_peered":"2024-09-15T23:29:40.762226+0000","last_clean":"2024-09-15T23:29:40.762226+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:29:40.762226+0000","last_undegraded":"2024-09-15T23:29:40.762226+0000","last_fullsized":"2024-09-15T23:29:40.762226+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942882+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:29:40.942882+0000","last_peered":"2024-09-15T23:29:40.942882+0000","last_clean":"2024-09-15T23:29:40.942882+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:29:40.942882+0000","last_undegraded":"2024-09-15T23:29:40.942882+0000","last_fullsized":"2024-09-15T23:29:40.942882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962027+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:29:40.962027+0000","last_peered":"2024-09-15T23:29:40.962027+0000","last_clean":"2024-09-15T23:29:40.962027+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:29:40.962027+0000","last_undegraded":"2024-09-15T23:29:40.962027+0000","last_fullsized":"2024-09-15T23:29:40.962027+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762675+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:29:40.762675+0000","last_peered":"2024-09-15T23:29:40.762675+0000","last_clean":"2024-09-15T23:29:40.762675+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:29:40.762675+0000","last_undegraded":"2024-09-15T23:29:40.762675+0000","last_fullsized":"2024-09-15T23:29:40.762675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497416+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:29:41.497416+0000","last_peered":"2024-09-15T23:29:41.497416+0000","last_clean":"2024-09-15T23:29:41.497416+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:29:41.497416+0000","last_undegraded":"2024-09-15T23:29:41.497416+0000","last_fullsized":"2024-09-15T23:29:41.497416+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762662+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:29:40.762662+0000","last_peered":"2024-09-15T23:29:40.762662+0000","last_clean":"2024-09-15T23:29:40.762662+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:29:40.762662+0000","last_undegraded":"2024-09-15T23:29:40.762662+0000","last_fullsized":"2024-09-15T23:29:40.762662+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762059+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:29:40.762059+0000","last_peered":"2024-09-15T23:29:40.762059+0000","last_clean":"2024-09-15T23:29:40.762059+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:29:40.762059+0000","last_undegraded":"2024-09-15T23:29:40.762059+0000","last_fullsized":"2024-09-15T23:29:40.762059+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497925+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:29:41.497925+0000","last_peered":"2024-09-15T23:29:41.497925+0000","last_clean":"2024-09-15T23:29:41.497925+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:29:41.497925+0000","last_undegraded":"2024-09-15T23:29:41.497925+0000","last_fullsized":"2024-09-15T23:29:41.497925+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911823+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:29:40.911823+0000","last_peered":"2024-09-15T23:29:40.911823+0000","last_clean":"2024-09-15T23:29:40.911823+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:29:40.911823+0000","last_undegraded":"2024-09-15T23:29:40.911823+0000","last_fullsized":"2024-09-15T23:29:40.911823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497762+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:29:41.497762+0000","last_peered":"2024-09-15T23:29:41.497762+0000","last_clean":"2024-09-15T23:29:41.497762+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:29:41.497762+0000","last_undegraded":"2024-09-15T23:29:41.497762+0000","last_fullsized":"2024-09-15T23:29:41.497762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762409+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:29:40.762409+0000","last_peered":"2024-09-15T23:29:40.762409+0000","last_clean":"2024-09-15T23:29:40.762409+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:29:40.762409+0000","last_undegraded":"2024-09-15T23:29:40.762409+0000","last_fullsized":"2024-09-15T23:29:40.762409+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498327+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:29:41.498327+0000","last_peered":"2024-09-15T23:29:41.498327+0000","last_clean":"2024-09-15T23:29:41.498327+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:29:41.498327+0000","last_undegraded":"2024-09-15T23:29:41.498327+0000","last_fullsized":"2024-09-15T23:29:41.498327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.942347+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:29:40.942347+0000","last_peered":"2024-09-15T23:29:40.942347+0000","last_clean":"2024-09-15T23:29:40.942347+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:29:40.942347+0000","last_undegraded":"2024-09-15T23:29:40.942347+0000","last_fullsized":"2024-09-15T23:29:40.942347+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498071+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:29:41.498071+0000","last_peered":"2024-09-15T23:29:41.498071+0000","last_clean":"2024-09-15T23:29:41.498071+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:29:41.498071+0000","last_undegraded":"2024-09-15T23:29:41.498071+0000","last_fullsized":"2024-09-15T23:29:41.498071+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498128+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:29:41.498128+0000","last_peered":"2024-09-15T23:29:41.498128+0000","last_clean":"2024-09-15T23:29:41.498128+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:29:41.498128+0000","last_undegraded":"2024-09-15T23:29:41.498128+0000","last_fullsized":"2024-09-15T23:29:41.498128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911739+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:29:40.911739+0000","last_peered":"2024-09-15T23:29:40.911739+0000","last_clean":"2024-09-15T23:29:40.911739+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:29:40.911739+0000","last_undegraded":"2024-09-15T23:29:40.911739+0000","last_fullsized":"2024-09-15T23:29:40.911739+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497643+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:29:41.497643+0000","last_peered":"2024-09-15T23:29:41.497643+0000","last_clean":"2024-09-15T23:29:41.497643+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:29:41.497643+0000","last_undegraded":"2024-09-15T23:29:41.497643+0000","last_fullsized":"2024-09-15T23:29:41.497643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.762643+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:29:40.762643+0000","last_peered":"2024-09-15T23:29:40.762643+0000","last_clean":"2024-09-15T23:29:40.762643+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:29:40.762643+0000","last_undegraded":"2024-09-15T23:29:40.762643+0000","last_fullsized":"2024-09-15T23:29:40.762643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.758030+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:29:40.758030+0000","last_peered":"2024-09-15T23:29:40.758030+0000","last_clean":"2024-09-15T23:29:40.758030+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:29:40.758030+0000","last_undegraded":"2024-09-15T23:29:40.758030+0000","last_fullsized":"2024-09-15T23:29:40.758030+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498008+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:29:41.498008+0000","last_peered":"2024-09-15T23:29:41.498008+0000","last_clean":"2024-09-15T23:29:41.498008+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:29:41.498008+0000","last_undegraded":"2024-09-15T23:29:41.498008+0000","last_fullsized":"2024-09-15T23:29:41.498008+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497496+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:29:41.497496+0000","last_peered":"2024-09-15T23:29:41.497496+0000","last_clean":"2024-09-15T23:29:41.497496+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:29:41.497496+0000","last_undegraded":"2024-09-15T23:29:41.497496+0000","last_fullsized":"2024-09-15T23:29:41.497496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497153+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:29:41.497153+0000","last_peered":"2024-09-15T23:29:41.497153+0000","last_clean":"2024-09-15T23:29:41.497153+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:29:41.497153+0000","last_undegraded":"2024-09-15T23:29:41.497153+0000","last_fullsized":"2024-09-15T23:29:41.497153+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497392+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:29:41.497392+0000","last_peered":"2024-09-15T23:29:41.497392+0000","last_clean":"2024-09-15T23:29:41.497392+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:29:41.497392+0000","last_undegraded":"2024-09-15T23:29:41.497392+0000","last_fullsized":"2024-09-15T23:29:41.497392+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.911680+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:29:40.911680+0000","last_peered":"2024-09-15T23:29:40.911680+0000","last_clean":"2024-09-15T23:29:40.911680+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:29:40.911680+0000","last_undegraded":"2024-09-15T23:29:40.911680+0000","last_fullsized":"2024-09-15T23:29:40.911680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.757817+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:29:40.757817+0000","last_peered":"2024-09-15T23:29:40.757817+0000","last_clean":"2024-09-15T23:29:40.757817+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:29:40.757817+0000","last_undegraded":"2024-09-15T23:29:40.757817+0000","last_fullsized":"2024-09-15T23:29:40.757817+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760842+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:29:40.760842+0000","last_peered":"2024-09-15T23:29:40.760842+0000","last_clean":"2024-09-15T23:29:40.760842+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:29:40.760842+0000","last_undegraded":"2024-09-15T23:29:40.760842+0000","last_fullsized":"2024-09-15T23:29:40.760842+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498986+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:29:41.498986+0000","last_peered":"2024-09-15T23:29:41.498986+0000","last_clean":"2024-09-15T23:29:41.498986+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:29:41.498986+0000","last_undegraded":"2024-09-15T23:29:41.498986+0000","last_fullsized":"2024-09-15T23:29:41.498986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":31,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498085+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:29:41.498085+0000","last_peered":"2024-09-15T23:29:41.498085+0000","last_clean":"2024-09-15T23:29:41.498085+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:29:41.498085+0000","last_undegraded":"2024-09-15T23:29:41.498085+0000","last_fullsized":"2024-09-15T23:29:41.498085+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497519+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:29:41.497519+0000","last_peered":"2024-09-15T23:29:41.497519+0000","last_clean":"2024-09-15T23:29:41.497519+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:29:41.497519+0000","last_undegraded":"2024-09-15T23:29:41.497519+0000","last_fullsized":"2024-09-15T23:29:41.497519+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.760559+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:29:40.760559+0000","last_peered":"2024-09-15T23:29:40.760559+0000","last_clean":"2024-09-15T23:29:40.760559+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:29:40.760559+0000","last_undegraded":"2024-09-15T23:29:40.760559+0000","last_fullsized":"2024-09-15T23:29:40.760559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.498441+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:29:41.498441+0000","last_peered":"2024-09-15T23:29:41.498441+0000","last_clean":"2024-09-15T23:29:41.498441+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:29:41.498441+0000","last_undegraded":"2024-09-15T23:29:41.498441+0000","last_fullsized":"2024-09-15T23:29:41.498441+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:40.962002+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:29:40.962002+0000","last_peered":"2024-09-15T23:29:40.962002+0000","last_clean":"2024-09-15T23:29:40.962002+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:29:40.962002+0000","last_undegraded":"2024-09-15T23:29:40.962002+0000","last_fullsized":"2024-09-15T23:29:40.962002+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.499182+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:29:41.499182+0000","last_peered":"2024-09-15T23:29:41.499182+0000","last_clean":"2024-09-15T23:29:41.499182+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:29:41.499182+0000","last_undegraded":"2024-09-15T23:29:41.499182+0000","last_fullsized":"2024-09-15T23:29:41.499182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497511+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:29:41.497511+0000","last_peered":"2024-09-15T23:29:41.497511+0000","last_clean":"2024-09-15T23:29:41.497511+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:29:41.497511+0000","last_undegraded":"2024-09-15T23:29:41.497511+0000","last_fullsized":"2024-09-15T23:29:41.497511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497873+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:29:41.497873+0000","last_peered":"2024-09-15T23:29:41.497873+0000","last_clean":"2024-09-15T23:29:41.497873+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:29:41.497873+0000","last_undegraded":"2024-09-15T23:29:41.497873+0000","last_fullsized":"2024-09-15T23:29:41.497873+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":25,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-09-15T23:29:41.497997+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:29:41.497997+0000","last_peered":"2024-09-15T23:29:41.497997+0000","last_clean":"2024-09-15T23:29:41.497997+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:29:41.497997+0000","last_undegraded":"2024-09-15T23:29:41.497997+0000","last_fullsized":"2024-09-15T23:29:41.497997+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":49896,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":36,"num_read_kb":69,"num_write":72,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":149688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481816,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":995328,"data_stored":491844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710748,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28640,"kb_used_data":1616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716512,"statfs":{"total":95995035648,"available":95965708288,"internally_reserved":0,"allocated":1654784,"data_stored":1127408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874274,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1003520,"data_stored":496522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103207,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32164,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712988,"statfs":{"total":95995035648,"available":95962099712,"internally_reserved":0,"allocated":1003520,"data_stored":492448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32744,"kb_used_data":1560,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712408,"statfs":{"total":95995035648,"available":95961505792,"internally_reserved":0,"allocated":1597440,"data_stored":1086890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561073,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32156,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712996,"statfs":{"total":95995035648,"available":95962107904,"internally_reserved":0,"allocated":991232,"data_stored":487748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790006,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36908,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708244,"statfs":{"total":95995035648,"available":95957241856,"internally_reserved":0,"allocated":1601536,"data_stored":1082394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":491866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":999424,"data_stored":487852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1052672,"data_stored":536880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574922,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717104,"statfs":{"total":95995035648,"available":95966314496,"internally_reserved":0,"allocated":1048576,"data_stored":536846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36320,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708832,"statfs":{"total":95995035648,"available":95957843968,"internally_reserved":0,"allocated":995328,"data_stored":487838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":49098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":49132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":49292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:30:29.491 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T23:30:29.491 INFO:tasks.cephadm:Setting up client nodes... 2024-09-15T23:30:29.491 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-15T23:30:29.761 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:30.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:29 smithi077 ceph-mon[30968]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:30.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:29 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:29 smithi159 ceph-mon[35472]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:29 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- 172.21.15.77:0/760653174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 msgr2=0x7ff35c104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 --2- 172.21.15.77:0/760653174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c104a50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff358009900 tx=0x7ff35802a410 comp rx=0 tx=0).stop 2024-09-15T23:30:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- 172.21.15.77:0/760653174 shutdown_connections 2024-09-15T23:30:30.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 --2- 172.21.15.77:0/760653174 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c1078c0 0x7ff35c109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 --2- 172.21.15.77:0/760653174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c104f90 0x7ff35c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 --2- 172.21.15.77:0/760653174 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c104a50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- 172.21.15.77:0/760653174 >> 172.21.15.77:0/760653174 conn(0x7ff35c0fc280 msgr2=0x7ff35c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- 172.21.15.77:0/760653174 shutdown_connections 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- 172.21.15.77:0/760653174 wait complete. 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 Processor -- start 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.250+0000 7ff36354e640 1 -- start start 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c104f90 0x7ff35c19a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 0x7ff35c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10d890 con 0x7ff35c102660 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10d710 con 0x7ff35c1078c0 2024-09-15T23:30:30.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff35c10da10 con 0x7ff35c104f90 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44548/0 (socket says 172.21.15.77:44548) 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 -- 172.21.15.77:0/86909014 learned_addr learned my addr 172.21.15.77:0/86909014 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff360ae9640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c104f90 0x7ff35c19a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff361aeb640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 0x7ff35c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 -- 172.21.15.77:0/86909014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c104f90 msgr2=0x7ff35c19a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c104f90 0x7ff35c19a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 -- 172.21.15.77:0/86909014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 msgr2=0x7ff35c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 0x7ff35c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 -- 172.21.15.77:0/86909014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff35c1a1d70 con 0x7ff35c102660 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff361aeb640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 0x7ff35c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3612ea640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff358009230 tx=0x7ff358004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:30.260 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35803f030 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff35c1a2000 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff358003ce0 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358035070 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.251+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff35c1a2530 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.253+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff35c109410 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.254+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff358042030 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.254+0000 7ff3527fc640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 0x7ff3480a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.255+0000 7ff360ae9640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 0x7ff3480a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.255+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7ff3580f04f0 con 0x7ff35c102660 2024-09-15T23:30:30.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.255+0000 7ff360ae9640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 0x7ff3480a57c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005d00 tx=0x7ff34c005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:30.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.259+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff3580bcd90 con 0x7ff35c102660 2024-09-15T23:30:30.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:29 smithi155 ceph-mon[35631]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:30:30.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:29 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:30.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.487+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7ff35c02d7c0 con 0x7ff35c102660 2024-09-15T23:30:30.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.489+0000 7ff3527fc640 1 -- 172.21.15.77:0/86909014 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7ff3580bc690 con 0x7ff35c102660 2024-09-15T23:30:30.490 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-15T23:30:30.491 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAWbudmnzcfHRAAG/oSJqb5k1c0Ky8wWUH/hA== 2024-09-15T23:30:30.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 msgr2=0x7ff3480a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 0x7ff3480a57c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff34c005d00 tx=0x7ff34c005c50 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 msgr2=0x7ff35c19a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff358009230 tx=0x7ff358004360 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 shutdown_connections 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3480a3300 0x7ff3480a57c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff35c1078c0 0x7ff35c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff35c104f90 0x7ff35c19a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 --2- 172.21.15.77:0/86909014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff35c102660 0x7ff35c19a140 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.491+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 >> 172.21.15.77:0/86909014 conn(0x7ff35c0fc280 msgr2=0x7ff35c101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.492+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 shutdown_connections 2024-09-15T23:30:30.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:30.492+0000 7ff36354e640 1 -- 172.21.15.77:0/86909014 wait complete. 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: pgmap v316: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:30:31.088 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:30 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:30:31.114 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:30:31.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-15T23:30:31.114 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T23:30:31.150 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T23:30:31.150 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-15T23:30:31.151 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: pgmap v316: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:30:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:30 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: pgmap v316: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.7 KiB/s wr, 5 op/s 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-15T23:30:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:30 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/86909014' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-15T23:30:31.436 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- 172.21.15.77:0/96013859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 msgr2=0x7fd1d4100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 --2- 172.21.15.77:0/96013859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4100840 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd1c400aa10 tx=0x7fd1c402b720 comp rx=0 tx=0).stop 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- 172.21.15.77:0/96013859 shutdown_connections 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 --2- 172.21.15.77:0/96013859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4105590 0x7fd1d410d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 --2- 172.21.15.77:0/96013859 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4100e10 0x7fd1d4104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 --2- 172.21.15.77:0/96013859 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4100840 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- 172.21.15.77:0/96013859 >> 172.21.15.77:0/96013859 conn(0x7fd1d40fbee0 msgr2=0x7fd1d40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- 172.21.15.77:0/96013859 shutdown_connections 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- 172.21.15.77:0/96013859 wait complete. 2024-09-15T23:30:31.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 Processor -- start 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.889+0000 7fd1db19d640 1 -- start start 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4100e10 0x7fd1d4102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4105590 0x7fd1d4102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d410fd70 con 0x7fd1d4100460 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d410fbf0 con 0x7fd1d4100e10 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d410fef0 con 0x7fd1d4105590 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44570/0 (socket says 172.21.15.77:44570) 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 -- 172.21.15.77:0/711357308 learned_addr learned my addr 172.21.15.77:0/711357308 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4100e10 0x7fd1d4102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d973a640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4105590 0x7fd1d4102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 -- 172.21.15.77:0/711357308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4105590 msgr2=0x7fd1d4102980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:31.893 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4105590 0x7fd1d4102980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 -- 172.21.15.77:0/711357308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4100e10 msgr2=0x7fd1d4102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4100e10 0x7fd1d4102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 -- 172.21.15.77:0/711357308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d41a68f0 con 0x7fd1d4100460 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d8f39640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006010 tx=0x7fd1c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c403f070 con 0x7fd1d4100460 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d41a6b80 con 0x7fd1d4100460 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd1c4032400 con 0x7fd1d4100460 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.890+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4036040 con 0x7fd1d4100460 2024-09-15T23:30:31.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.891+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d41a70b0 con 0x7fd1d4100460 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.892+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d4100840 con 0x7fd1d4100460 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.893+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd1c4042070 con 0x7fd1d4100460 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.893+0000 7fd1d1ffb640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 0x7fd1bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.893+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 0x7fd1bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.893+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7fd1c40f04c0 con 0x7fd1d4100460 2024-09-15T23:30:31.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.894+0000 7fd1d3fff640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 0x7fd1bc0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4103990 tx=0x7fd1c800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:31.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:31.898+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd1c40bc6b0 con 0x7fd1d4100460 2024-09-15T23:30:32.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.108+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd1d410a780 con 0x7fd1d4100460 2024-09-15T23:30:32.113 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.112+0000 7fd1d1ffb640 1 -- 172.21.15.77:0/711357308 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264047 (secure 0 0 0) 0x7fd1c40c09b0 con 0x7fd1d4100460 2024-09-15T23:30:32.117 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:32.118 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 msgr2=0x7fd1bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 0x7fd1bc0a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd1d4103990 tx=0x7fd1c800b390 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 msgr2=0x7fd1d4101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4006010 tx=0x7fd1c40042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 shutdown_connections 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd1bc0a32d0 0x7fd1bc0a5790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd1d4105590 0x7fd1d4102980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd1d4100e10 0x7fd1d4102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 --2- 172.21.15.77:0/711357308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd1d4100460 0x7fd1d4101f00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 >> 172.21.15.77:0/711357308 conn(0x7fd1d40fbee0 msgr2=0x7fd1d40fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 shutdown_connections 2024-09-15T23:30:32.119 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:32.115+0000 7fd1db19d640 1 -- 172.21.15.77:0/711357308 wait complete. 2024-09-15T23:30:32.845 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":2029887224},{"type":"v1","addr":"172.21.15.77:6801","nonce":2029887224}]},"active_addr":"172.21.15.77:6801/2029887224","active_change":"2024-09-15T23:22:35.713181+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.77:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":4130067691}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":885637672}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2061299221}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2698479441}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":17594966}]}]} 2024-09-15T23:30:32.851 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-15T23:30:32.851 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-15T23:30:32.852 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:30:33.101 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:33.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:32 smithi077 ceph-mon[30968]: pgmap v317: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:30:33.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:32 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/711357308' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:30:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:32 smithi159 ceph-mon[35472]: pgmap v317: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:30:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:32 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/711357308' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:30:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:32 smithi155 ceph-mon[35631]: pgmap v317: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.5 KiB/s wr, 3 op/s 2024-09-15T23:30:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:32 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/711357308' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 -- 172.21.15.77:0/793902427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288106f10 msgr2=0x7f628810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 --2- 172.21.15.77:0/793902427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288106f10 0x7f628810ea90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6280009ca0 tx=0x7f628002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 -- 172.21.15.77:0/793902427 shutdown_connections 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 --2- 172.21.15.77:0/793902427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288106f10 0x7f628810ea90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 --2- 172.21.15.77:0/793902427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 0x7f62881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 --2- 172.21.15.77:0/793902427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288101de0 0x7f62881021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 -- 172.21.15.77:0/793902427 >> 172.21.15.77:0/793902427 conn(0x7f62880fd880 msgr2=0x7f62880ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 -- 172.21.15.77:0/793902427 shutdown_connections 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.614+0000 7f628e859640 1 -- 172.21.15.77:0/793902427 wait complete. 2024-09-15T23:30:33.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 Processor -- start 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 -- start start 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 0x7f62881988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 0x7f628819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6288111f90 con 0x7f6288101de0 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6288111e10 con 0x7f6288106f10 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628e859640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6288112110 con 0x7f6288102790 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44588/0 (socket says 172.21.15.77:44588) 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 -- 172.21.15.77:0/1264224965 learned_addr learned my addr 172.21.15.77:0/1264224965 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628cdf6640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 0x7f628819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:33.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 -- 172.21.15.77:0/1264224965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 msgr2=0x7f62881988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f627ffff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 0x7f62881988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 0x7f62881988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 -- 172.21.15.77:0/1264224965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 msgr2=0x7f628819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 0x7f628819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 -- 172.21.15.77:0/1264224965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628819d360 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f628cdf6640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 0x7f628819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.615+0000 7f6287fff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f627800c920 tx=0x7f627800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.616+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278007c70 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.616+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6278007e10 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.616+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278018890 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.616+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f628819d650 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.616+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62881a4f30 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.617+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62881021c0 con 0x7f6288101de0 2024-09-15T23:30:33.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.618+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6278018a70 con 0x7f6288101de0 2024-09-15T23:30:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.619+0000 7f6285ffb640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 0x7f62740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.619+0000 7f627ffff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 0x7f62740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.619+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f62780cffc0 con 0x7f6288101de0 2024-09-15T23:30:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.619+0000 7f627ffff640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 0x7f62740a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62880fdca0 tx=0x7f6270008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:33.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.623+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6278014030 con 0x7f6288101de0 2024-09-15T23:30:33.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.793+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f628810a0f0 con 0x7f6288101de0 2024-09-15T23:30:33.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.795+0000 7f6285ffb640 1 -- 172.21.15.77:0/1264224965 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f627800de20 con 0x7f6288101de0 2024-09-15T23:30:33.796 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:33.796 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 msgr2=0x7f62740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 0x7f62740a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f62880fdca0 tx=0x7f6270008040 comp rx=0 tx=0).stop 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 msgr2=0x7f62881983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f627800c920 tx=0x7f627800cde0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 shutdown_connections 2024-09-15T23:30:33.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62740a32d0 0x7f62740a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6288106f10 0x7f628819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6288102790 0x7f62881988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 --2- 172.21.15.77:0/1264224965 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6288101de0 0x7f62881983b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 >> 172.21.15.77:0/1264224965 conn(0x7f62880fd880 msgr2=0x7f62880feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 shutdown_connections 2024-09-15T23:30:33.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:33.797+0000 7f628e859640 1 -- 172.21.15.77:0/1264224965 wait complete. 2024-09-15T23:30:34.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:33 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1264224965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:33 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1264224965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:34.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:33 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1264224965' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:34.554 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-15T23:30:34.554 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:30:34.802 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:35.236 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:34 smithi077 ceph-mon[30968]: pgmap v318: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-15T23:30:35.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.239+0000 7f3f17b09640 1 -- 172.21.15.77:0/4175059431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 msgr2=0x7f3f1010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.239+0000 7f3f17b09640 1 --2- 172.21.15.77:0/4175059431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1010da40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009900 tx=0x7f3f0002a480 comp rx=0 tx=0).stop 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 -- 172.21.15.77:0/4175059431 shutdown_connections 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 --2- 172.21.15.77:0/4175059431 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1010da40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 --2- 172.21.15.77:0/4175059431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 --2- 172.21.15.77:0/4175059431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 0x7f3f10101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 -- 172.21.15.77:0/4175059431 >> 172.21.15.77:0/4175059431 conn(0x7f3f100fc7d0 msgr2=0x7f3f100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 -- 172.21.15.77:0/4175059431 shutdown_connections 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 -- 172.21.15.77:0/4175059431 wait complete. 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 Processor -- start 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 -- start start 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.240+0000 7f3f17b09640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 0x7f3f101985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:35.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f10198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10111020 con 0x7f3f10102ef0 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10110ea0 con 0x7f3f10102570 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101111a0 con 0x7f3f10100e20 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44614/0 (socket says 172.21.15.77:44614) 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 -- 172.21.15.77:0/499308324 learned_addr learned my addr 172.21.15.77:0/499308324 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f158a5640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 0x7f3f101985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f150a4640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f10198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 -- 172.21.15.77:0/499308324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 msgr2=0x7f3f101985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 0x7f3f101985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 -- 172.21.15.77:0/499308324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 msgr2=0x7f3f10198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f10198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 -- 172.21.15.77:0/499308324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1019d590 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f150a4640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f10198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f160a6640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f00005ab0 tx=0x7f3f00003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0003f070 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1019d820 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3f00031e30 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00035030 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.241+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101a5160 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.242+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f10101280 con 0x7f3f10102ef0 2024-09-15T23:30:35.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.244+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3f00042070 con 0x7f3f10102ef0 2024-09-15T23:30:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.244+0000 7f3f0effd640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 0x7f3ef80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.244+0000 7f3f158a5640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 0x7f3ef80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.244+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9034+0+0 (secure 0 0 0) 0x7f3f000f0e10 con 0x7f3f10102ef0 2024-09-15T23:30:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.245+0000 7f3f158a5640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 0x7f3ef80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009990 tx=0x7f3f08009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:35.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.247+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3f000bd650 con 0x7f3f10102ef0 2024-09-15T23:30:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:34 smithi155 ceph-mon[35631]: pgmap v318: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-15T23:30:35.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.413+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3f1010a0a0 con 0x7f3f10102ef0 2024-09-15T23:30:35.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.415+0000 7f3f0effd640 1 -- 172.21.15.77:0/499308324 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24661 (secure 0 0 0) 0x7f3f00003e20 con 0x7f3f10102ef0 2024-09-15T23:30:35.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:30:35.417 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":89,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:29:40.411528+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:30:35.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 msgr2=0x7f3ef80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:35.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 0x7f3ef80a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f08009990 tx=0x7f3f08009110 comp rx=0 tx=0).stop 2024-09-15T23:30:35.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 msgr2=0x7f3f1019ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:35.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f00005ab0 tx=0x7f3f00003c30 comp rx=0 tx=0).stop 2024-09-15T23:30:35.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 shutdown_connections 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3ef80a32d0 0x7f3ef80a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3f10102ef0 0x7f3f1019ceb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3f10102570 0x7f3f10198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 --2- 172.21.15.77:0/499308324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f10100e20 0x7f3f101985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 >> 172.21.15.77:0/499308324 conn(0x7f3f100fc7d0 msgr2=0x7f3f1006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 shutdown_connections 2024-09-15T23:30:35.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:35.417+0000 7f3f17b09640 1 -- 172.21.15.77:0/499308324 wait complete. 2024-09-15T23:30:35.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:34 smithi159 ceph-mon[35472]: pgmap v318: 129 pgs: 129 active+clean; 635 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 3.4 KiB/s wr, 3 op/s 2024-09-15T23:30:36.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-15T23:30:36.087 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-15T23:30:36.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-15T23:30:36.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-15T23:30:36.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-15T23:30:36.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-15T23:30:36.089 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-15T23:30:36.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-15T23:30:36.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-15T23:30:36.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-15T23:30:36.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-15T23:30:36.091 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-15T23:30:36.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:35 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/499308324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:36.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:35 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/499308324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:36.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:35 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/499308324' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:30:36.741 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:36.747 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:36.750 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:36.754 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:37.196 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:36 smithi077 ceph-mon[30968]: pgmap v319: 129 pgs: 129 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-15T23:30:37.197 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T23:30:37.197 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-15T23:30:37.197 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.197 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:36 smithi155 ceph-mon[35631]: pgmap v319: 129 pgs: 129 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-15T23:30:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T23:30:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-15T23:30:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:36 smithi159 ceph-mon[35472]: pgmap v319: 129 pgs: 129 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 3.8 KiB/s wr, 4 op/s 2024-09-15T23:30:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]: dispatch 2024-09-15T23:30:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]: dispatch 2024-09-15T23:30:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 -- 172.21.15.77:0/296453762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 msgr2=0x7f10c81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/296453762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81031c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f10bc009900 tx=0x7f10bc02a480 comp rx=0 tx=0).stop 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 -- 172.21.15.77:0/296453762 shutdown_connections 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/296453762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c810c180 0x7f10c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/296453762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 0x7f10c810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/296453762 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81031c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.776 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 -- 172.21.15.77:0/296453762 >> 172.21.15.77:0/296453762 conn(0x7f10c80fc7a0 msgr2=0x7f10c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 -- 172.21.15.77:0/296453762 shutdown_connections 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.759+0000 7f10ceb9d640 1 -- 172.21.15.77:0/296453762 wait complete. 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 Processor -- start 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 -- start start 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 0x7f10c8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c810c180 0x7f10c819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8111f70 con 0x7f10c8102de0 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10c8111df0 con 0x7f10c8103700 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10ceb9d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f10c81120f0 con 0x7f10c810c180 2024-09-15T23:30:37.777 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46482/0 (socket says 172.21.15.77:46482) 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 -- 172.21.15.77:0/1280618327 learned_addr learned my addr 172.21.15.77:0/1280618327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10c7fff640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 0x7f10c8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 -- 172.21.15.77:0/1280618327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c810c180 msgr2=0x7f10c819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10c810c180 0x7f10c819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 -- 172.21.15.77:0/1280618327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 msgr2=0x7f10c8198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 0x7f10c8198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10cc939640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10c819d370 con 0x7f10c8102de0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.760+0000 7f10c7fff640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10c8103700 0x7f10c8198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10cc939640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81983c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10bc005ab0 tx=0x7f10bc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc03f030 con 0x7f10c8102de0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f10bc003ce0 con 0x7f10c8102de0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10c819d600 con 0x7f10c8102de0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10bc035070 con 0x7f10c8102de0 2024-09-15T23:30:37.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.761+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10c81a4f40 con 0x7f10c8102de0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.762+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10c8062900 con 0x7f10c8102de0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.763+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f10bc042030 con 0x7f10c8102de0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c5ffb640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10b80a3350 0x7f10b80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c7fff640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10b80a3350 0x7f10b80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9150+0+0 (secure 0 0 0) 0x7f10bc0f0a20 con 0x7f10c8102de0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c5ffb640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] conn(0x7f10b80ae620 0x7f10b80b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10bc001d30 con 0x7f10b80ae620 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f10bc0f0e70 con 0x7f10c8102de0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10cd13a640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] conn(0x7f10b80ae620 0x7f10b80b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10c7fff640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10b80a3350 0x7f10b80a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10c810d5d0 tx=0x7f10b400a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.764+0000 7f10cd13a640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] conn(0x7f10b80ae620 0x7f10b80b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:37.779 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.765+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== osd.6 v2:172.21.15.77:6818/2986107738 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10bc001d30 con 0x7f10b80ae620 2024-09-15T23:30:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 --> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10c8062d00 con 0x7f10b80ae620 2024-09-15T23:30:37.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10c5ffb640 1 -- 172.21.15.77:0/1280618327 <== osd.6 v2:172.21.15.77:6818/2986107738 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f10c8062d00 con 0x7f10b80ae620 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] conn(0x7f10b80ae620 msgr2=0x7f10b80b0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] conn(0x7f10b80ae620 0x7f10b80b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10b80a3350 msgr2=0x7f10b80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.779+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10b80a3350 0x7f10b80a5810 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f10c810d5d0 tx=0x7f10b400a5c0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 msgr2=0x7f10c81983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 --2- 172.21.15.77:0/1280618327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10c8102de0 0x7f10c81983c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10bc005ab0 tx=0x7f10bc0042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10cd13a640 1 -- 172.21.15.77:0/1280618327 reap_dead start 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 shutdown_connections 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 >> 172.21.15.77:0/1280618327 conn(0x7f10c80fc7a0 msgr2=0x7f10c80fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 shutdown_connections 2024-09-15T23:30:37.781 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.780+0000 7f10ceb9d640 1 -- 172.21.15.77:0/1280618327 wait complete. 2024-09-15T23:30:38.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 -- 172.21.15.77:0/3271786848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad881008c0 msgr2=0x7fad88100ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.002 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/3271786848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad881008c0 0x7fad88100ca0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fad84009900 tx=0x7fad8402a410 comp rx=0 tx=0).stop 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 -- 172.21.15.77:0/3271786848 shutdown_connections 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/3271786848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad88105ec0 0x7fad88106340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/3271786848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad881011e0 0x7fad88105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/3271786848 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad881008c0 0x7fad88100ca0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.982+0000 7fad8f9ec640 1 -- 172.21.15.77:0/3271786848 >> 172.21.15.77:0/3271786848 conn(0x7fad880fc7d0 msgr2=0x7fad880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.983+0000 7fad8f9ec640 1 -- 172.21.15.77:0/3271786848 shutdown_connections 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.983+0000 7fad8f9ec640 1 -- 172.21.15.77:0/3271786848 wait complete. 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.983+0000 7fad8f9ec640 1 Processor -- start 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.983+0000 7fad8f9ec640 1 -- start start 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad881008c0 0x7fad8819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 0x7fad8819f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:38.003 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad88105ec0 0x7fad881a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad88118710 con 0x7fad88105ec0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad88118590 con 0x7fad881008c0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8f9ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad88118890 con 0x7fad881011e0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 0x7fad8819f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 0x7fad8819f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:45962/0 (socket says 172.21.15.77:45962) 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 -- 172.21.15.77:0/792954772 learned_addr learned my addr 172.21.15.77:0/792954772 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8d788640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad881008c0 0x7fad8819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8df89640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad88105ec0 0x7fad881a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 -- 172.21.15.77:0/792954772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad881008c0 msgr2=0x7fad8819ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad881008c0 0x7fad8819ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 -- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad88105ec0 msgr2=0x7fad881a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad88105ec0 0x7fad881a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.004 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad881a3ce0 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8df89640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad88105ec0 0x7fad881a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.984+0000 7fad8cf87640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 0x7fad8819f270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad7800b4a0 tx=0x7fad7800b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.985+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78014070 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.985+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad78010af0 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.985+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad881a3fd0 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.985+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad78017d10 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.985+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad881ab8b0 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.986+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fad880fe420 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.988+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fad78017070 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad7e7fc640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad740a3350 0x7fad740a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad8d788640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad740a3350 0x7fad740a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9150+0+0 (secure 0 0 0) 0x7fad780cf2a0 con 0x7fad881011e0 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad7e7fc640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] conn(0x7fad740ae5a0 0x7fad740b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:38.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fad740b1110 con 0x7fad740ae5a0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.989+0000 7fad8df89640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] conn(0x7fad740ae5a0 0x7fad740b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.990+0000 7fad8d788640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad740a3350 0x7fad740a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad84000c00 tx=0x7fad840058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.990+0000 7fad8df89640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] conn(0x7fad740ae5a0 0x7fad740b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.991+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== osd.3 v2:172.21.15.77:6810/3522993793 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fad740b1110 con 0x7fad740ae5a0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:37.998+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== mon.1 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fad780977d0 con 0x7fad881011e0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.005+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 --> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fad8806a850 con 0x7fad740ae5a0 2024-09-15T23:30:38.006 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.005+0000 7fad7e7fc640 1 -- 172.21.15.77:0/792954772 <== osd.3 v2:172.21.15.77:6810/3522993793 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fad8806a850 con 0x7fad740ae5a0 2024-09-15T23:30:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] conn(0x7fad740ae5a0 msgr2=0x7fad740b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] conn(0x7fad740ae5a0 0x7fad740b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad740a3350 msgr2=0x7fad740a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad740a3350 0x7fad740a5810 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fad84000c00 tx=0x7fad840058d0 comp rx=0 tx=0).stop 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 msgr2=0x7fad8819f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 --2- 172.21.15.77:0/792954772 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad881011e0 0x7fad8819f270 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fad7800b4a0 tx=0x7fad7800b960 comp rx=0 tx=0).stop 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8df89640 1 -- 172.21.15.77:0/792954772 reap_dead start 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 shutdown_connections 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 >> 172.21.15.77:0/792954772 conn(0x7fad880fc7d0 msgr2=0x7fad880fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 shutdown_connections 2024-09-15T23:30:38.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:38.006+0000 7fad8f9ec640 1 -- 172.21.15.77:0/792954772 wait complete. 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:30:38.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:37 smithi077 ceph-mon[30968]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:30:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:37 smithi155 ceph-mon[35631]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [9, 1]}]': finished 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [5, 8]}]': finished 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 8]}]': finished 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: osdmap e90: 12 total, 12 up, 12 in 2024-09-15T23:30:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:37 smithi159 ceph-mon[35472]: pgmap v321: 129 pgs: 1 peering, 128 active+clean; 639 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-09-15T23:30:39.171 INFO:teuthology.orchestra.run.smithi077.stdout:188978561076 2024-09-15T23:30:39.172 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-15T23:30:39.194 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:38 smithi077 ceph-mon[30968]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:30:39.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:38 smithi155 ceph-mon[35631]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 -- 172.21.15.77:0/86610839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 msgr2=0x7f312410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 --2- 172.21.15.77:0/86610839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410da40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f311c009ca0 tx=0x7f311c02a950 comp rx=0 tx=0).stop 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 -- 172.21.15.77:0/86610839 shutdown_connections 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 --2- 172.21.15.77:0/86610839 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410da40 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 --2- 172.21.15.77:0/86610839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124102570 0x7f31241029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 --2- 172.21.15.77:0/86610839 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3124100e20 0x7f3124101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 -- 172.21.15.77:0/86610839 >> 172.21.15.77:0/86610839 conn(0x7f31240fc7d0 msgr2=0x7f31240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 -- 172.21.15.77:0/86610839 shutdown_connections 2024-09-15T23:30:39.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.377+0000 7f3128d78640 1 -- 172.21.15.77:0/86610839 wait complete. 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 Processor -- start 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 -- start start 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124100e20 0x7f312410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3124102570 0x7f312410ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3124112120 con 0x7f3124102ef0 2024-09-15T23:30:39.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3124111fa0 con 0x7f3124100e20 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.378+0000 7f3128d78640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f31241122a0 con 0x7f3124102570 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46520/0 (socket says 172.21.15.77:46520) 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 -- 172.21.15.77:0/183197453 learned_addr learned my addr 172.21.15.77:0/183197453 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3121d9b640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3124102570 0x7f312410ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f312259c640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124100e20 0x7f312410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 -- 172.21.15.77:0/183197453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3124102570 msgr2=0x7f312410ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3124102570 0x7f312410ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 -- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124100e20 msgr2=0x7f312410e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124100e20 0x7f312410e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31241a6aa0 con 0x7f3124102ef0 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f312259c640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3124100e20 0x7f312410e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:39.382 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3122d9d640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410ef50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f311c006010 tx=0x7f311c02f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c034040 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31241a6d30 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f311c003e00 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f311c045480 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.379+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31241a7260 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.380+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3124062940 con 0x7f3124102ef0 2024-09-15T23:30:39.383 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.382+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f311c037020 con 0x7f3124102ef0 2024-09-15T23:30:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f31137fe640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f310c0a32d0 0x7f310c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f312259c640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f310c0a32d0 0x7f310c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f311c0f0e60 con 0x7f3124102ef0 2024-09-15T23:30:39.384 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f31137fe640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] conn(0x7f310c0ae5a0 0x7f310c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f311c00b150 con 0x7f310c0ae5a0 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f311c0f3520 con 0x7f3124102ef0 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f312259c640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f310c0a32d0 0x7f310c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3114009930 tx=0x7f3114008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.383+0000 7f3121d9b640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] conn(0x7f310c0ae5a0 0x7f310c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.384+0000 7f3121d9b640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] conn(0x7f310c0ae5a0 0x7f310c0b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:39.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.385+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== osd.4 v2:172.21.15.155:6808/1067866253 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f311c00b150 con 0x7f310c0ae5a0 2024-09-15T23:30:39.400 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.399+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 --> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3124062d70 con 0x7f310c0ae5a0 2024-09-15T23:30:39.401 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f31137fe640 1 -- 172.21.15.77:0/183197453 <== osd.4 v2:172.21.15.155:6808/1067866253 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3124062d70 con 0x7f310c0ae5a0 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] conn(0x7f310c0ae5a0 msgr2=0x7f310c0b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] conn(0x7f310c0ae5a0 0x7f310c0b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f310c0a32d0 msgr2=0x7f310c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f310c0a32d0 0x7f310c0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3114009930 tx=0x7f3114008040 comp rx=0 tx=0).stop 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 msgr2=0x7f312410ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 --2- 172.21.15.77:0/183197453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3124102ef0 0x7f312410ef50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f311c006010 tx=0x7f311c02f6f0 comp rx=0 tx=0).stop 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3122d9d640 1 -- 172.21.15.77:0/183197453 reap_dead start 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 shutdown_connections 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 >> 172.21.15.77:0/183197453 conn(0x7f31240fc7d0 msgr2=0x7f31240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 shutdown_connections 2024-09-15T23:30:39.402 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:39.400+0000 7f3128d78640 1 -- 172.21.15.77:0/183197453 wait complete. 2024-09-15T23:30:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:39.416 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:39.464 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:38 smithi159 ceph-mon[35472]: osdmap e91: 12 total, 12 up, 12 in 2024-09-15T23:30:40.048 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:40.069 INFO:teuthology.orchestra.run.smithi077.stdout:107374182468 2024-09-15T23:30:40.070 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-15T23:30:40.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:39 smithi155 ceph-mon[35631]: pgmap v323: 129 pgs: 3 peering, 126 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:40.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:39 smithi077 ceph-mon[30968]: pgmap v323: 129 pgs: 3 peering, 126 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:40.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:39 smithi159 ceph-mon[35472]: pgmap v323: 129 pgs: 3 peering, 126 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:40.484 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:40.485 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:40.486 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:40.522 INFO:teuthology.orchestra.run.smithi077.stdout:137438953535 2024-09-15T23:30:40.522 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 -- 172.21.15.77:0/2221596168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8106a60 msgr2=0x7f05e8106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 --2- 172.21.15.77:0/2221596168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8106a60 0x7f05e8106e40 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009930 tx=0x7f05e002a420 comp rx=0 tx=0).stop 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 -- 172.21.15.77:0/2221596168 shutdown_connections 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 --2- 172.21.15.77:0/2221596168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e8101400 0x7f05e810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 --2- 172.21.15.77:0/2221596168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8100a60 0x7f05e8100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 --2- 172.21.15.77:0/2221596168 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8106a60 0x7f05e8106e40 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 -- 172.21.15.77:0/2221596168 >> 172.21.15.77:0/2221596168 conn(0x7f05e80fc780 msgr2=0x7f05e80feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 -- 172.21.15.77:0/2221596168 shutdown_connections 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.827+0000 7f05ef847640 1 -- 172.21.15.77:0/2221596168 wait complete. 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 Processor -- start 2024-09-15T23:30:40.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 -- start start 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8100a60 0x7f05e8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 0x7f05e81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e8106a60 0x7f05e819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f05e8111f20 con 0x7f05e8101400 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05e8111da0 con 0x7f05e8100a60 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ef847640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f05e81120a0 con 0x7f05e8106a60 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 0x7f05e81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 0x7f05e81989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46542/0 (socket says 172.21.15.77:46542) 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 -- 172.21.15.77:0/3716041478 learned_addr learned my addr 172.21.15.77:0/3716041478 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05edde4640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e8106a60 0x7f05e819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ed5e3640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8100a60 0x7f05e8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 -- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e8106a60 msgr2=0x7f05e819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05e8106a60 0x7f05e819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 -- 172.21.15.77:0/3716041478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8100a60 msgr2=0x7f05e8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e8100a60 0x7f05e8198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e819d410 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.828+0000 7f05ecde2640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 0x7f05e81989a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e9f0 tx=0x7f05dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc00cd80 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e819d700 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05dc010910 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0188f0 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e81a4fe0 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.829+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f05e8062940 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.831+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f05dc010ac0 con 0x7f05e8101400 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.831+0000 7f05e67fc640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f05d00a32d0 0x7f05d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.831+0000 7f05ed5e3640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f05d00a32d0 0x7f05d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:40.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f05dc0d0910 con 0x7f05e8101400 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05e67fc640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] conn(0x7f05d00ae5a0 0x7f05d00b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f05d00b1110 con 0x7f05d00ae5a0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f05dc0d0d60 con 0x7f05e8101400 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05ed5e3640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f05d00a32d0 0x7f05d00a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05edde4640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] conn(0x7f05d00ae5a0 0x7f05d00b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.832+0000 7f05edde4640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] conn(0x7f05d00ae5a0 0x7f05d00b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.833+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== osd.8 v2:172.21.15.159:6816/2918585527 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f05d00b1110 con 0x7f05d00ae5a0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 --> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f05e8062dc0 con 0x7f05d00ae5a0 2024-09-15T23:30:40.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05e67fc640 1 -- 172.21.15.77:0/3716041478 <== osd.8 v2:172.21.15.159:6816/2918585527 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f05e8062dc0 con 0x7f05d00ae5a0 2024-09-15T23:30:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] conn(0x7f05d00ae5a0 msgr2=0x7f05d00b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] conn(0x7f05d00ae5a0 0x7f05d00b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f05d00a32d0 msgr2=0x7f05d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f05d00a32d0 0x7f05d00a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e0005a20 comp rx=0 tx=0).stop 2024-09-15T23:30:40.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 msgr2=0x7f05e81989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05ef847640 1 --2- 172.21.15.77:0/3716041478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f05e8101400 0x7f05e81989a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f05dc00e9f0 tx=0x7f05dc00eeb0 comp rx=0 tx=0).stop 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.847+0000 7f05edde4640 1 -- 172.21.15.77:0/3716041478 reap_dead start 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.848+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 shutdown_connections 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.848+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 >> 172.21.15.77:0/3716041478 conn(0x7f05e80fc780 msgr2=0x7f05e80fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.848+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 shutdown_connections 2024-09-15T23:30:40.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:40.848+0000 7f05ef847640 1 -- 172.21.15.77:0/3716041478 wait complete. 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- 172.21.15.77:0/3474882969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408106a80 msgr2=0x7fb408106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 --2- 172.21.15.77:0/3474882969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408106a80 0x7fb408106e60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009930 tx=0x7fb3fc02a420 comp rx=0 tx=0).stop 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- 172.21.15.77:0/3474882969 shutdown_connections 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 --2- 172.21.15.77:0/3474882969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408101420 0x7fb40810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 --2- 172.21.15.77:0/3474882969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 0x7fb408100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 --2- 172.21.15.77:0/3474882969 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408106a80 0x7fb408106e60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- 172.21.15.77:0/3474882969 >> 172.21.15.77:0/3474882969 conn(0x7fb4080fc7a0 msgr2=0x7fb4080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- 172.21.15.77:0/3474882969 shutdown_connections 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- 172.21.15.77:0/3474882969 wait complete. 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 Processor -- start 2024-09-15T23:30:41.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.637+0000 7fb40fceb640 1 -- start start 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 0x7fb408198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 0x7fb4081989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408106a80 0x7fb40819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb408111f60 con 0x7fb408101420 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb408111de0 con 0x7fb408100a80 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4081120e0 con 0x7fb408106a80 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 0x7fb4081989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 0x7fb4081989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46560/0 (socket says 172.21.15.77:46560) 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 -- 172.21.15.77:0/2248842354 learned_addr learned my addr 172.21.15.77:0/2248842354 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40e288640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408106a80 0x7fb40819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40da87640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 0x7fb408198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 -- 172.21.15.77:0/2248842354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408106a80 msgr2=0x7fb40819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408106a80 0x7fb40819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 -- 172.21.15.77:0/2248842354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 msgr2=0x7fb408198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 0x7fb408198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40819d410 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40da87640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb408100a80 0x7fb408198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40d286640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 0x7fb4081989a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c890 tx=0x7fb40400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404004220 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40819d700 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb4040043c0 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.638+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4040049e0 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.639+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4081a4fe0 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.639+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb408062900 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb4040079b0 con 0x7fb408101420 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f40a32d0 0x7fb3f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:41.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb4040d0120 con 0x7fb408101420 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb40da87640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f40a32d0 0x7fb3f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] conn(0x7fb3f40ae5a0 0x7fb3f40b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3f40b1110 con 0x7fb3f40ae5a0 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.641+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb4040d0570 con 0x7fb408101420 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.642+0000 7fb40e288640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] conn(0x7fb3f40ae5a0 0x7fb3f40b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.642+0000 7fb40da87640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f40a32d0 0x7fb3f40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.642+0000 7fb40e288640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] conn(0x7fb3f40ae5a0 0x7fb3f40b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:41.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.642+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== osd.9 v2:172.21.15.77:6826/1779757892 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3f40b1110 con 0x7fb3f40ae5a0 2024-09-15T23:30:41.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.656+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 --> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb408062d80 con 0x7fb3f40ae5a0 2024-09-15T23:30:41.658 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb3faffd640 1 -- 172.21.15.77:0/2248842354 <== osd.9 v2:172.21.15.77:6826/1779757892 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb408062d80 con 0x7fb3f40ae5a0 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] conn(0x7fb3f40ae5a0 msgr2=0x7fb3f40b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] conn(0x7fb3f40ae5a0 0x7fb3f40b0a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f40a32d0 msgr2=0x7fb3f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f40a32d0 0x7fb3f40a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc032c70 comp rx=0 tx=0).stop 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 msgr2=0x7fb4081989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 --2- 172.21.15.77:0/2248842354 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101420 0x7fb4081989a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c890 tx=0x7fb40400cd50 comp rx=0 tx=0).stop 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40e288640 1 -- 172.21.15.77:0/2248842354 reap_dead start 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 shutdown_connections 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.657+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 >> 172.21.15.77:0/2248842354 conn(0x7fb4080fc7a0 msgr2=0x7fb4080fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.658+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 shutdown_connections 2024-09-15T23:30:41.659 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:41.658+0000 7fb40fceb640 1 -- 172.21.15.77:0/2248842354 wait complete. 2024-09-15T23:30:42.098 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:41 smithi077 ceph-mon[30968]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:30:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:41 smithi159 ceph-mon[35472]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:30:42.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:41 smithi155 ceph-mon[35631]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-15T23:30:42.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 -- 172.21.15.77:0/1237943635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e4103670 msgr2=0x7f52e410bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 --2- 172.21.15.77:0/1237943635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e4103670 0x7f52e410bb60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f52d0009900 tx=0x7f52d002a480 comp rx=0 tx=0).stop 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 -- 172.21.15.77:0/1237943635 shutdown_connections 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 --2- 172.21.15.77:0/1237943635 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e410c180 0x7f52e410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 --2- 172.21.15.77:0/1237943635 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e4103670 0x7f52e410bb60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 --2- 172.21.15.77:0/1237943635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52e4102d50 0x7f52e4103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 -- 172.21.15.77:0/1237943635 >> 172.21.15.77:0/1237943635 conn(0x7f52e40fc7d0 msgr2=0x7f52e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 -- 172.21.15.77:0/1237943635 shutdown_connections 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.867+0000 7f52eadb7640 1 -- 172.21.15.77:0/1237943635 wait complete. 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 Processor -- start 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 -- start start 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e4102d50 0x7f52e4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52e4103670 0x7f52e41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:42.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 0x7f52e419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4111fd0 con 0x7f52e410c180 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4111e50 con 0x7f52e4103670 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52eadb7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f52e4112150 con 0x7f52e4102d50 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52e9354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 0x7f52e419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52e9354640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 0x7f52e419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46592/0 (socket says 172.21.15.77:46592) 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.868+0000 7f52e9354640 1 -- 172.21.15.77:0/3591140208 learned_addr learned my addr 172.21.15.77:0/3591140208 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e8b53640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e4102d50 0x7f52e4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 -- 172.21.15.77:0/3591140208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e4102d50 msgr2=0x7f52e4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e4102d50 0x7f52e4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 -- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52e4103670 msgr2=0x7f52e41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52e4103670 0x7f52e41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e419d420 con 0x7f52e410c180 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e8b53640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52e4102d50 0x7f52e4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:42.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e9354640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 0x7f52e419cd40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00cad0 tx=0x7f52dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00ae20 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e419d710 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52dc005020 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00f6f0 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.869+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e41a4ff0 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.870+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f52e4062940 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.871+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f52dc0051d0 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e1ffb640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52d40a32d0 0x7f52d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e8b53640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52d40a32d0 0x7f52d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f52dc0cfee0 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e1ffb640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] conn(0x7f52d40ae5a0 0x7f52d40b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f52dc004810 con 0x7f52d40ae5a0 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f52dc0d25a0 con 0x7f52e410c180 2024-09-15T23:30:42.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.872+0000 7f52e8b53640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52d40a32d0 0x7f52d40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52d80058c0 tx=0x7f52d8005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.873+0000 7f52e3fff640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] conn(0x7f52d40ae5a0 0x7f52d40b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.873+0000 7f52e3fff640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] conn(0x7f52d40ae5a0 0x7f52d40b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:42.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.874+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== osd.10 v2:172.21.15.155:6824/3242099303 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f52dc004810 con 0x7f52d40ae5a0 2024-09-15T23:30:42.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.887+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 --> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f52e4062dc0 con 0x7f52d40ae5a0 2024-09-15T23:30:42.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52e1ffb640 1 -- 172.21.15.77:0/3591140208 <== osd.10 v2:172.21.15.155:6824/3242099303 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f52e4062dc0 con 0x7f52d40ae5a0 2024-09-15T23:30:42.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] conn(0x7f52d40ae5a0 msgr2=0x7f52d40b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] conn(0x7f52d40ae5a0 0x7f52d40b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52d40a32d0 msgr2=0x7f52d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f52d40a32d0 0x7f52d40a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f52d80058c0 tx=0x7f52d8005d30 comp rx=0 tx=0).stop 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 msgr2=0x7f52e419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 --2- 172.21.15.77:0/3591140208 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f52e410c180 0x7f52e419cd40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f52dc00cad0 tx=0x7f52dc00cf90 comp rx=0 tx=0).stop 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52e9354640 1 -- 172.21.15.77:0/3591140208 reap_dead start 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 shutdown_connections 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 >> 172.21.15.77:0/3591140208 conn(0x7f52e40fc7d0 msgr2=0x7f52e40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 shutdown_connections 2024-09-15T23:30:42.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.888+0000 7f52eadb7640 1 -- 172.21.15.77:0/3591140208 wait complete. 2024-09-15T23:30:43.117 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:42 smithi077 ceph-mon[30968]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:42 smithi159 ceph-mon[35472]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:42 smithi155 ceph-mon[35631]: pgmap v324: 129 pgs: 1 peering, 128 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 895 B/s wr, 3 op/s 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/2093554913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102ef0 msgr2=0x7f6bcc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/2093554913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102ef0 0x7f6bcc10da40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009ca0 tx=0x7f6bc402a950 comp rx=0 tx=0).stop 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/2093554913 shutdown_connections 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/2093554913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102ef0 0x7f6bcc10da40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/2093554913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc102570 0x7f6bcc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/2093554913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc100e20 0x7f6bcc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/2093554913 >> 172.21.15.77:0/2093554913 conn(0x7f6bcc0fc7d0 msgr2=0x7f6bcc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/2093554913 shutdown_connections 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.179+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/2093554913 wait complete. 2024-09-15T23:30:43.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.180+0000 7f6bd0a2e640 1 Processor -- start 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.180+0000 7f6bd0a2e640 1 -- start start 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc100e20 0x7f6bcc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 0x7f6bcc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc102ef0 0x7f6bcc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc110f80 con 0x7f6bcc102570 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc110e00 con 0x7f6bcc100e20 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bd0a2e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bcc111100 con 0x7f6bcc102ef0 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 0x7f6bcc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 0x7f6bcc198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46572/0 (socket says 172.21.15.77:46572) 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 -- 172.21.15.77:0/555556625 learned_addr learned my addr 172.21.15.77:0/555556625 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bca59c640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc100e20 0x7f6bcc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:43.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bcad9d640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc102ef0 0x7f6bcc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 -- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc102ef0 msgr2=0x7f6bcc19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bcc102ef0 0x7f6bcc19cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 -- 172.21.15.77:0/555556625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc100e20 msgr2=0x7f6bcc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bcc100e20 0x7f6bcc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bcc19d3e0 con 0x7f6bcc102570 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc3fff640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 0x7f6bcc198970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c890 tx=0x7f6bb400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.181+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004220 con 0x7f6bcc102570 2024-09-15T23:30:43.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.182+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb40043c0 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.182+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bcc19d6d0 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.182+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4004a00 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.182+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bcc1a4fb0 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.183+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bcc062900 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.184+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6bb40079b0 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.184+0000 7f6bc37fe640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bb80a32d0 0x7f6bb80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6bb40cfed0 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bca59c640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bb80a32d0 0x7f6bb80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bc37fe640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] conn(0x7f6bb80ae5a0 0x7f6bb80b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bb80b1110 con 0x7f6bb80ae5a0 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f6bb40d0320 con 0x7f6bcc102570 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bca59c640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bb80a32d0 0x7f6bb80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00abe0 tx=0x7f6bbc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:43.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.185+0000 7f6bcad9d640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] conn(0x7f6bb80ae5a0 0x7f6bb80b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.186+0000 7f6bcad9d640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] conn(0x7f6bb80ae5a0 0x7f6bb80b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.187+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== osd.5 v2:172.21.15.159:6808/1369347099 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bb80b1110 con 0x7f6bb80ae5a0 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.200+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 --> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bcc062d80 con 0x7f6bb80ae5a0 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bc37fe640 1 -- 172.21.15.77:0/555556625 <== osd.5 v2:172.21.15.159:6808/1369347099 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6bcc062d80 con 0x7f6bb80ae5a0 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] conn(0x7f6bb80ae5a0 msgr2=0x7f6bb80b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] conn(0x7f6bb80ae5a0 0x7f6bb80b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bb80a32d0 msgr2=0x7f6bb80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bb80a32d0 0x7f6bb80a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc00abe0 tx=0x7f6bbc00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 msgr2=0x7f6bcc198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 --2- 172.21.15.77:0/555556625 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bcc102570 0x7f6bcc198970 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6bb400c890 tx=0x7f6bb400cc90 comp rx=0 tx=0).stop 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bcad9d640 1 -- 172.21.15.77:0/555556625 reap_dead start 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 shutdown_connections 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 >> 172.21.15.77:0/555556625 conn(0x7f6bcc0fc7d0 msgr2=0x7f6bcc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:43.538 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 shutdown_connections 2024-09-15T23:30:43.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:42.201+0000 7f6bd0a2e640 1 -- 172.21.15.77:0/555556625 wait complete. 2024-09-15T23:30:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:43 smithi077 ceph-mon[30968]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T23:30:44.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:43 smithi077 ceph-mon[30968]: Cluster is now healthy 2024-09-15T23:30:44.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:43 smithi155 ceph-mon[35631]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T23:30:44.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:43 smithi155 ceph-mon[35631]: Cluster is now healthy 2024-09-15T23:30:44.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:43 smithi159 ceph-mon[35472]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-09-15T23:30:44.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:43 smithi159 ceph-mon[35472]: Cluster is now healthy 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.460+0000 7fd84e189640 1 -- 172.21.15.77:0/389105327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848106a80 msgr2=0x7fd848106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.460+0000 7fd84e189640 1 --2- 172.21.15.77:0/389105327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848106a80 0x7fd848106e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd838009cd0 tx=0x7fd83802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 -- 172.21.15.77:0/389105327 shutdown_connections 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 --2- 172.21.15.77:0/389105327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd848101420 0x7fd84810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 --2- 172.21.15.77:0/389105327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848100a80 0x7fd848100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 --2- 172.21.15.77:0/389105327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848106a80 0x7fd848106e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 -- 172.21.15.77:0/389105327 >> 172.21.15.77:0/389105327 conn(0x7fd8480fc7a0 msgr2=0x7fd8480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:44.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 -- 172.21.15.77:0/389105327 shutdown_connections 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 -- 172.21.15.77:0/389105327 wait complete. 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 Processor -- start 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 -- start start 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd848100a80 0x7fd8481992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.461+0000 7fd84e189640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 0x7fd848199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848106a80 0x7fd8481a4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd848110e80 con 0x7fd848101420 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd848110d00 con 0x7fd848100a80 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd848111000 con 0x7fd848106a80 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 0x7fd848199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 0x7fd848199810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46622/0 (socket says 172.21.15.77:46622) 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 -- 172.21.15.77:0/2000478342 learned_addr learned my addr 172.21.15.77:0/2000478342 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd847fff640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848106a80 0x7fd8481a4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd8477fe640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd848100a80 0x7fd8481992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 -- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848106a80 msgr2=0x7fd8481a4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848106a80 0x7fd8481a4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 -- 172.21.15.77:0/2000478342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd848100a80 msgr2=0x7fd8481992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd848100a80 0x7fd8481992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8481a4890 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd847fff640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd848106a80 0x7fd8481a4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd846ffd640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 0x7fd848199810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00d950 tx=0x7fd83c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c017070 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd83c009c30 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8481a4a60 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd83c00f6b0 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.462+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8481a4fa0 con 0x7fd848101420 2024-09-15T23:30:44.476 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.463+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd8480628c0 con 0x7fd848101420 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.464+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd83c0109d0 con 0x7fd848101420 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd844ff9640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd8300a3350 0x7fd8300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd8477fe640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd8300a3350 0x7fd8300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fd83c0cfeb0 con 0x7fd848101420 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd844ff9640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] conn(0x7fd8300ae620 0x7fd8300b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd83c01de50 con 0x7fd8300ae620 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.465+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fd83c0d0300 con 0x7fd848101420 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.466+0000 7fd8477fe640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd8300a3350 0x7fd8300a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd838006010 tx=0x7fd8380093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.466+0000 7fd847fff640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] conn(0x7fd8300ae620 0x7fd8300b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.466+0000 7fd847fff640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] conn(0x7fd8300ae620 0x7fd8300b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.467+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== osd.11 v2:172.21.15.159:6824/296038473 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd83c01de50 con 0x7fd8300ae620 2024-09-15T23:30:44.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.481+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 --> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd848062d40 con 0x7fd8300ae620 2024-09-15T23:30:44.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd844ff9640 1 -- 172.21.15.77:0/2000478342 <== osd.11 v2:172.21.15.159:6824/296038473 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd848062d40 con 0x7fd8300ae620 2024-09-15T23:30:44.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] conn(0x7fd8300ae620 msgr2=0x7fd8300b0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] conn(0x7fd8300ae620 0x7fd8300b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd8300a3350 msgr2=0x7fd8300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd8300a3350 0x7fd8300a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd838006010 tx=0x7fd8380093f0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 msgr2=0x7fd848199810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 --2- 172.21.15.77:0/2000478342 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd848101420 0x7fd848199810 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd83c00d950 tx=0x7fd83c00de10 comp rx=0 tx=0).stop 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd847fff640 1 -- 172.21.15.77:0/2000478342 reap_dead start 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 shutdown_connections 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 >> 172.21.15.77:0/2000478342 conn(0x7fd8480fc7a0 msgr2=0x7fd8480fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 shutdown_connections 2024-09-15T23:30:44.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.482+0000 7fd84e189640 1 -- 172.21.15.77:0/2000478342 wait complete. 2024-09-15T23:30:44.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- 172.21.15.77:0/2403333763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c106f20 msgr2=0x7fda8c10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 --2- 172.21.15.77:0/2403333763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c106f20 0x7fda8c10eaa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fda84009ca0 tx=0x7fda8402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- 172.21.15.77:0/2403333763 shutdown_connections 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 --2- 172.21.15.77:0/2403333763 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c106f20 0x7fda8c10eaa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 --2- 172.21.15.77:0/2403333763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda8c1027a0 0x7fda8c1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 --2- 172.21.15.77:0/2403333763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c101df0 0x7fda8c1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- 172.21.15.77:0/2403333763 >> 172.21.15.77:0/2403333763 conn(0x7fda8c0fd8b0 msgr2=0x7fda8c0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- 172.21.15.77:0/2403333763 shutdown_connections 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- 172.21.15.77:0/2403333763 wait complete. 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 Processor -- start 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.645+0000 7fda9469a640 1 -- start start 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 0x7fda8c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c1027a0 0x7fda8c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda8c106f20 0x7fda8c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c112020 con 0x7fda8c101df0 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c111ea0 con 0x7fda8c106f20 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c1121a0 con 0x7fda8c1027a0 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 0x7fda8c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 0x7fda8c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46640/0 (socket says 172.21.15.77:46640) 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 -- 172.21.15.77:0/2220845370 learned_addr learned my addr 172.21.15.77:0/2220845370 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda91c35640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c1027a0 0x7fda8c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92c37640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda8c106f20 0x7fda8c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 -- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c1027a0 msgr2=0x7fda8c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda8c1027a0 0x7fda8c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 -- 172.21.15.77:0/2220845370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda8c106f20 msgr2=0x7fda8c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda8c106f20 0x7fda8c19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c19d4d0 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda92436640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 0x7fda8c198520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fda8800b4a0 tx=0x7fda8800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88014070 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda88010af0 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c19d7c0 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.646+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda88017d10 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.647+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8c1a50a0 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.647+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fda8c062980 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.649+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fda88017070 con 0x7fda8c101df0 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.649+0000 7fda837fe640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fda780a32d0 0x7fda780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.649+0000 7fda91c35640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fda780a32d0 0x7fda780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fda880cf540 con 0x7fda8c101df0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda837fe640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] conn(0x7fda780ae5a0 0x7fda780b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda8801ae50 con 0x7fda780ae5a0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fda880cf990 con 0x7fda8c101df0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda91c35640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fda780a32d0 0x7fda780a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0fddd0 tx=0x7fda7c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.650+0000 7fda92c37640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] conn(0x7fda780ae5a0 0x7fda780b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.651+0000 7fda92c37640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] conn(0x7fda780ae5a0 0x7fda780b0a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.651+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== osd.2 v2:172.21.15.159:6800/1459216762 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda8801ae50 con 0x7fda780ae5a0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.664+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 --> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fda8c062e00 con 0x7fda780ae5a0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.665+0000 7fda837fe640 1 -- 172.21.15.77:0/2220845370 <== osd.2 v2:172.21.15.159:6800/1459216762 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fda8c062e00 con 0x7fda780ae5a0 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] conn(0x7fda780ae5a0 msgr2=0x7fda780b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] conn(0x7fda780ae5a0 0x7fda780b0a40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fda780a32d0 msgr2=0x7fda780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fda780a32d0 0x7fda780a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0fddd0 tx=0x7fda7c008040 comp rx=0 tx=0).stop 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 msgr2=0x7fda8c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 --2- 172.21.15.77:0/2220845370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda8c101df0 0x7fda8c198520 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fda8800b4a0 tx=0x7fda8800b960 comp rx=0 tx=0).stop 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda92c37640 1 -- 172.21.15.77:0/2220845370 reap_dead start 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 shutdown_connections 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 >> 172.21.15.77:0/2220845370 conn(0x7fda8c0fd8b0 msgr2=0x7fda8c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 shutdown_connections 2024-09-15T23:30:44.674 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:44.666+0000 7fda9469a640 1 -- 172.21.15.77:0/2220845370 wait complete. 2024-09-15T23:30:44.921 INFO:teuthology.orchestra.run.smithi077.stdout:279172874278 2024-09-15T23:30:44.921 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-15T23:30:45.247 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:44 smithi077 ceph-mon[30968]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:30:45.273 INFO:teuthology.orchestra.run.smithi077.stdout:300647710752 2024-09-15T23:30:45.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-15T23:30:45.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:44 smithi155 ceph-mon[35631]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:30:45.366 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:44 smithi159 ceph-mon[35472]: pgmap v325: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:30:45.713 INFO:teuthology.orchestra.run.smithi077.stdout:249108103211 2024-09-15T23:30:45.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-15T23:30:45.932 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:46.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:46 smithi077 ceph-mon[30968]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-15T23:30:46.353 INFO:teuthology.orchestra.run.smithi077.stdout:77309411403 2024-09-15T23:30:46.353 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-15T23:30:46.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:46 smithi155 ceph-mon[35631]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-15T23:30:46.379 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:46 smithi159 ceph-mon[35472]: pgmap v326: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 231 B/s wr, 2 op/s 2024-09-15T23:30:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- 172.21.15.77:0/1100796221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 msgr2=0x7f82201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 --2- 172.21.15.77:0/1100796221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201067e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8208009900 tx=0x7f820802a410 comp rx=0 tx=0).stop 2024-09-15T23:30:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- 172.21.15.77:0/1100796221 shutdown_connections 2024-09-15T23:30:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 --2- 172.21.15.77:0/1100796221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220106f10 0x7f822010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 --2- 172.21.15.77:0/1100796221 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201067e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 --2- 172.21.15.77:0/1100796221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220101de0 0x7f82201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- 172.21.15.77:0/1100796221 >> 172.21.15.77:0/1100796221 conn(0x7f82200fd880 msgr2=0x7f82200ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- 172.21.15.77:0/1100796221 shutdown_connections 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- 172.21.15.77:0/1100796221 wait complete. 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 Processor -- start 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.892+0000 7f822585c640 1 -- start start 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220101de0 0x7f8220198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220106f10 0x7f822019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8220111f90 con 0x7f8220102790 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8220111e10 con 0x7f8220106f10 2024-09-15T23:30:46.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8220112110 con 0x7f8220101de0 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46610/0 (socket says 172.21.15.77:46610) 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 -- 172.21.15.77:0/1993125667 learned_addr learned my addr 172.21.15.77:0/1993125667 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821effd640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220101de0 0x7f8220198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821f7fe640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220106f10 0x7f822019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 -- 172.21.15.77:0/1993125667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220101de0 msgr2=0x7f8220198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220101de0 0x7f8220198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 -- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220106f10 msgr2=0x7f822019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220106f10 0x7f822019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f822019d440 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821effd640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8220101de0 0x7f8220198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821f7fe640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8220106f10 0x7f822019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f821e7fc640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201989d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8208006010 tx=0x7f82080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f820803f030 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8208003ce0 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f822019d6d0 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8208035070 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.893+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82201a5010 con 0x7f8220102790 2024-09-15T23:30:46.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.894+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8220062980 con 0x7f8220102790 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.896+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8208042030 con 0x7f8220102790 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.896+0000 7f822485a640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f820c0a32d0 0x7f820c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f821effd640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f820c0a32d0 0x7f820c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f82080f0b40 con 0x7f8220102790 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f822485a640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] conn(0x7f820c0ae5a0 0x7f820c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8208040e70 con 0x7f820c0ae5a0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f82080f0f90 con 0x7f8220102790 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f821effd640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f820c0a32d0 0x7f820c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8210009fa0 tx=0x7f8210009570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.897+0000 7f821f7fe640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] conn(0x7f820c0ae5a0 0x7f820c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.898+0000 7f821f7fe640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] conn(0x7f820c0ae5a0 0x7f820c0b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.899+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== osd.7 v2:172.21.15.155:6816/649069233 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8208040e70 con 0x7f820c0ae5a0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 --> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8220062e00 con 0x7f820c0ae5a0 2024-09-15T23:30:46.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822485a640 1 -- 172.21.15.77:0/1993125667 <== osd.7 v2:172.21.15.155:6816/649069233 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8220062e00 con 0x7f820c0ae5a0 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] conn(0x7f820c0ae5a0 msgr2=0x7f820c0b0a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] conn(0x7f820c0ae5a0 0x7f820c0b0a40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f820c0a32d0 msgr2=0x7f820c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f820c0a32d0 0x7f820c0a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8210009fa0 tx=0x7f8210009570 comp rx=0 tx=0).stop 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 msgr2=0x7f82201989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.913+0000 7f822585c640 1 --2- 172.21.15.77:0/1993125667 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8220102790 0x7f82201989d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8208006010 tx=0x7f82080042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.914+0000 7f821f7fe640 1 -- 172.21.15.77:0/1993125667 reap_dead start 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.914+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 shutdown_connections 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.914+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 >> 172.21.15.77:0/1993125667 conn(0x7f82200fd880 msgr2=0x7f82200fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.914+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 shutdown_connections 2024-09-15T23:30:46.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:43.914+0000 7f822585c640 1 -- 172.21.15.77:0/1993125667 wait complete. 2024-09-15T23:30:46.646 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:47.121 INFO:teuthology.orchestra.run.smithi077.stdout:214748364849 2024-09-15T23:30:47.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-15T23:30:47.521 INFO:teuthology.orchestra.run.smithi077.stdout:330712481820 2024-09-15T23:30:47.521 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-15T23:30:48.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 -- 172.21.15.77:0/2146066739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 msgr2=0x7f970c10de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 --2- 172.21.15.77:0/2146066739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c10de80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9700009900 tx=0x7f970002a480 comp rx=0 tx=0).stop 2024-09-15T23:30:48.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 -- 172.21.15.77:0/2146066739 shutdown_connections 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 --2- 172.21.15.77:0/2146066739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f970c10e3c0 0x7f970c110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 --2- 172.21.15.77:0/2146066739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c10de80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 --2- 172.21.15.77:0/2146066739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c074620 0x7f970c074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 -- 172.21.15.77:0/2146066739 >> 172.21.15.77:0/2146066739 conn(0x7f970c0fd8c0 msgr2=0x7f970c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 -- 172.21.15.77:0/2146066739 shutdown_connections 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.599+0000 7f9714178640 1 -- 172.21.15.77:0/2146066739 wait complete. 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 Processor -- start 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 -- start start 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f970c074620 0x7f970c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c10e3c0 0x7f970c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f970c114160 con 0x7f970c074f40 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f970c113fe0 con 0x7f970c074620 2024-09-15T23:30:48.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9714178640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f970c1142e0 con 0x7f970c10e3c0 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9711713640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9711713640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58800/0 (socket says 172.21.15.77:58800) 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9711713640 1 -- 172.21.15.77:0/3236952182 learned_addr learned my addr 172.21.15.77:0/3236952182 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9711f14640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f970c074620 0x7f970c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.600+0000 7f9712715640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c10e3c0 0x7f970c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 -- 172.21.15.77:0/3236952182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c10e3c0 msgr2=0x7f970c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f970c10e3c0 0x7f970c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 -- 172.21.15.77:0/3236952182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f970c074620 msgr2=0x7f970c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f970c074620 0x7f970c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970c19f650 con 0x7f970c074f40 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9711713640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c19abe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9700006010 tx=0x7f97000042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970003f030 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9700003ce0 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9700035070 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f970c19f8e0 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.601+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f970c1a7220 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.602+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f970c062980 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.603+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9700042030 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f970affd640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96f40a3350 0x7f96f40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f9711f14640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96f40a3350 0x7f96f40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f97000f09d0 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f970affd640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] conn(0x7f96f40ae620 0x7f96f40b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9700001d30 con 0x7f96f40ae620 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f97000f0e20 con 0x7f970c074f40 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f9712715640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] conn(0x7f96f40ae620 0x7f96f40b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f9711f14640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96f40a3350 0x7f96f40a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9704005fd0 tx=0x7f970400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.604+0000 7f9712715640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] conn(0x7f96f40ae620 0x7f96f40b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.605+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== osd.0 v2:172.21.15.77:6802/1105167923 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9700001d30 con 0x7f96f40ae620 2024-09-15T23:30:48.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 --> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f970c062d80 con 0x7f96f40ae620 2024-09-15T23:30:48.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f970affd640 1 -- 172.21.15.77:0/3236952182 <== osd.0 v2:172.21.15.77:6802/1105167923 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f970c062d80 con 0x7f96f40ae620 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] conn(0x7f96f40ae620 msgr2=0x7f96f40b0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] conn(0x7f96f40ae620 0x7f96f40b0ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96f40a3350 msgr2=0x7f96f40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f96f40a3350 0x7f96f40a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9704005fd0 tx=0x7f970400b390 comp rx=0 tx=0).stop 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 msgr2=0x7f970c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 --2- 172.21.15.77:0/3236952182 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f970c074f40 0x7f970c19abe0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9700006010 tx=0x7f97000042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9712715640 1 -- 172.21.15.77:0/3236952182 reap_dead start 2024-09-15T23:30:48.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 shutdown_connections 2024-09-15T23:30:48.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 >> 172.21.15.77:0/3236952182 conn(0x7f970c0fd8c0 msgr2=0x7f970c0fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:48.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 shutdown_connections 2024-09-15T23:30:48.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.619+0000 7f9714178640 1 -- 172.21.15.77:0/3236952182 wait complete. 2024-09-15T23:30:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 -- 172.21.15.77:0/3194594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34102d40 msgr2=0x7f9f34103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 --2- 172.21.15.77:0/3194594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34102d40 0x7f9f34103120 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009900 tx=0x7f9f2402a480 comp rx=0 tx=0).stop 2024-09-15T23:30:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 -- 172.21.15.77:0/3194594632 shutdown_connections 2024-09-15T23:30:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 --2- 172.21.15.77:0/3194594632 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f3410c170 0x7f9f3410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 --2- 172.21.15.77:0/3194594632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f34103660 0x7f9f3410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 --2- 172.21.15.77:0/3194594632 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34102d40 0x7f9f34103120 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 -- 172.21.15.77:0/3194594632 >> 172.21.15.77:0/3194594632 conn(0x7f9f340fc7a0 msgr2=0x7f9f340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 -- 172.21.15.77:0/3194594632 shutdown_connections 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.822+0000 7f9f39120640 1 -- 172.21.15.77:0/3194594632 wait complete. 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.823+0000 7f9f39120640 1 Processor -- start 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.823+0000 7f9f39120640 1 -- start start 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.823+0000 7f9f39120640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f34102d40 0x7f9f341985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.823+0000 7f9f39120640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 0x7f9f34198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3410c170 0x7f9f3419ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34112030 con 0x7f9f34103660 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34111eb0 con 0x7f9f3410c170 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341121b0 con 0x7f9f34102d40 2024-09-15T23:30:48.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 0x7f9f34198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 0x7f9f34198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58812/0 (socket says 172.21.15.77:58812) 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 -- 172.21.15.77:0/1453526230 learned_addr learned my addr 172.21.15.77:0/1453526230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f32d9d640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f34102d40 0x7f9f341985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3359e640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3410c170 0x7f9f3419ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 -- 172.21.15.77:0/1453526230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f34102d40 msgr2=0x7f9f341985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f34102d40 0x7f9f341985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 -- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3410c170 msgr2=0x7f9f3419ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3410c170 0x7f9f3419ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3419d550 con 0x7f9f34103660 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3359e640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3410c170 0x7f9f3419ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f3259c640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 0x7f9f34198ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800b3f0 tx=0x7f9f2800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28015020 con 0x7f9f34103660 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3419d840 con 0x7f9f34103660 2024-09-15T23:30:48.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f28011d10 con 0x7f9f34103660 2024-09-15T23:30:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2800f2e0 con 0x7f9f34103660 2024-09-15T23:30:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.824+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341008d0 con 0x7f9f34103660 2024-09-15T23:30:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.825+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f34062980 con 0x7f9f34103660 2024-09-15T23:30:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.827+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9f28018020 con 0x7f9f34103660 2024-09-15T23:30:48.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.827+0000 7f9f1bfff640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f1c0a3350 0x7f9f1c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.827+0000 7f9f32d9d640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f1c0a3350 0x7f9f1c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.827+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9f280cf490 con 0x7f9f34103660 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.828+0000 7f9f1bfff640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] conn(0x7f9f1c0ae620 0x7f9f1c0b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.828+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f1c0b1190 con 0x7f9f1c0ae620 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.828+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9f280d6050 con 0x7f9f34103660 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.828+0000 7f9f32d9d640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f1c0a3350 0x7f9f1c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000c00 tx=0x7f9f240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.828+0000 7f9f3359e640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] conn(0x7f9f1c0ae620 0x7f9f1c0b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.829+0000 7f9f3359e640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] conn(0x7f9f1c0ae620 0x7f9f1c0b0ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:48.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.830+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== osd.1 v2:172.21.15.155:6800/3752689492 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9f1c0b1190 con 0x7f9f1c0ae620 2024-09-15T23:30:48.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.843+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 --> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9f34062e00 con 0x7f9f1c0ae620 2024-09-15T23:30:48.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f1bfff640 1 -- 172.21.15.77:0/1453526230 <== osd.1 v2:172.21.15.155:6800/3752689492 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9f34062e00 con 0x7f9f1c0ae620 2024-09-15T23:30:48.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] conn(0x7f9f1c0ae620 msgr2=0x7f9f1c0b0ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] conn(0x7f9f1c0ae620 0x7f9f1c0b0ac0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f1c0a3350 msgr2=0x7f9f1c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f1c0a3350 0x7f9f1c0a5810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000c00 tx=0x7f9f240058d0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 msgr2=0x7f9f34198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 --2- 172.21.15.77:0/1453526230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f34103660 0x7f9f34198ae0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9f2800b3f0 tx=0x7f9f2800b8b0 comp rx=0 tx=0).stop 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f3359e640 1 -- 172.21.15.77:0/1453526230 reap_dead start 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 shutdown_connections 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 >> 172.21.15.77:0/1453526230 conn(0x7f9f340fc7a0 msgr2=0x7f9f340fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 shutdown_connections 2024-09-15T23:30:48.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:48.844+0000 7f9f39120640 1 -- 172.21.15.77:0/1453526230 wait complete. 2024-09-15T23:30:49.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:48 smithi077 ceph-mon[30968]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:30:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:48 smithi159 ceph-mon[35472]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:30:49.267 INFO:teuthology.orchestra.run.smithi077.stdout:158913790010 2024-09-15T23:30:49.268 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-15T23:30:49.345 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:48 smithi155 ceph-mon[35631]: pgmap v327: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 204 B/s wr, 2 op/s 2024-09-15T23:30:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 -- 172.21.15.77:0/1193318441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614103740 msgr2=0x7ff614107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 --2- 172.21.15.77:0/1193318441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614103740 0x7ff614107b80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff608009930 tx=0x7ff60802a420 comp rx=0 tx=0).stop 2024-09-15T23:30:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 -- 172.21.15.77:0/1193318441 shutdown_connections 2024-09-15T23:30:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 --2- 172.21.15.77:0/1193318441 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614108290 0x7ff61410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 --2- 172.21.15.77:0/1193318441 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614103740 0x7ff614107b80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 --2- 172.21.15.77:0/1193318441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 0x7ff614103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 -- 172.21.15.77:0/1193318441 >> 172.21.15.77:0/1193318441 conn(0x7ff6140fc7d0 msgr2=0x7ff6140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 -- 172.21.15.77:0/1193318441 shutdown_connections 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.637+0000 7ff61bc77640 1 -- 172.21.15.77:0/1193318441 wait complete. 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 Processor -- start 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 -- start start 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 0x7ff6141985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614103740 0x7ff614198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff614112090 con 0x7ff614108290 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff614111f10 con 0x7ff614103740 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.638+0000 7ff61bc77640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff614112210 con 0x7ff614102d90 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:49.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58828/0 (socket says 172.21.15.77:58828) 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 -- 172.21.15.77:0/3252589983 learned_addr learned my addr 172.21.15.77:0/3252589983 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff619a13640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 0x7ff6141985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff619212640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614103740 0x7ff614198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 -- 172.21.15.77:0/3252589983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 msgr2=0x7ff6141985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 0x7ff6141985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 -- 172.21.15.77:0/3252589983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614103740 msgr2=0x7ff614198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614103740 0x7ff614198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 -- 172.21.15.77:0/3252589983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61419d580 con 0x7ff614108290 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61a214640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00d950 tx=0x7ff60c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c017030 con 0x7ff614108290 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff60c004020 con 0x7ff614108290 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff61419d870 con 0x7ff614108290 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c003c00 con 0x7ff614108290 2024-09-15T23:30:49.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.639+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a5150 con 0x7ff614108290 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.640+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff61406a7f0 con 0x7ff614108290 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.642+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff60c01a070 con 0x7ff614108290 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.643+0000 7ff612ffd640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 0x7ff5fc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.643+0000 7ff619a13640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 0x7ff5fc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.643+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff60c0cfbe0 con 0x7ff614108290 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.643+0000 7ff619a13640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 0x7ff5fc0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff604005c40 tx=0x7ff60400a570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:49.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.646+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff60c09c430 con 0x7ff614108290 2024-09-15T23:30:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.822+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ff614103170 con 0x7ff614108290 2024-09-15T23:30:49.823 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.822+0000 7ff612ffd640 1 -- 172.21.15.77:0/3252589983 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff614103170 con 0x7ff614108290 2024-09-15T23:30:49.823 INFO:teuthology.orchestra.run.smithi077.stdout:188978561078 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 msgr2=0x7ff5fc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 0x7ff5fc0a5810 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff604005c40 tx=0x7ff60400a570 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 msgr2=0x7ff61419cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00d950 tx=0x7ff60c00de10 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 shutdown_connections 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff5fc0a3350 0x7ff5fc0a5810 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff614108290 0x7ff61419cea0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff614103740 0x7ff614198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 --2- 172.21.15.77:0/3252589983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff614102d90 0x7ff6141985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 >> 172.21.15.77:0/3252589983 conn(0x7ff6140fc7d0 msgr2=0x7ff614105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 shutdown_connections 2024-09-15T23:30:49.826 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:49.824+0000 7ff61bc77640 1 -- 172.21.15.77:0/3252589983 wait complete. 2024-09-15T23:30:50.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:49 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3252589983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:30:50.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:49 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3252589983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:30:50.313 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:49 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3252589983' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-15T23:30:50.645 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561076 got 188978561078 for osd.6 2024-09-15T23:30:50.646 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:51.153 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:50 smithi077 ceph-mon[30968]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 173 B/s wr, 2 op/s 2024-09-15T23:30:51.155 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:51.184 INFO:teuthology.orchestra.run.smithi077.stdout:34359738453 2024-09-15T23:30:51.185 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-15T23:30:51.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:50 smithi159 ceph-mon[35472]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 173 B/s wr, 2 op/s 2024-09-15T23:30:51.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:50 smithi155 ceph-mon[35631]: pgmap v328: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 173 B/s wr, 2 op/s 2024-09-15T23:30:51.795 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:51.796 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:51.796 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:51.835 INFO:teuthology.orchestra.run.smithi077.stdout:55834574927 2024-09-15T23:30:51.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 -- 172.21.15.77:0/2059098677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8105f40 msgr2=0x7f13c81063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2059098677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8105f40 0x7f13c81063d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f13c0009ca0 tx=0x7f13c002a940 comp rx=0 tx=0).stop 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 -- 172.21.15.77:0/2059098677 shutdown_connections 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2059098677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8105f40 0x7f13c81063d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2059098677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8101450 0x7f13c8105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2059098677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 0x7f13c8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 -- 172.21.15.77:0/2059098677 >> 172.21.15.77:0/2059098677 conn(0x7f13c80fc7a0 msgr2=0x7f13c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.078+0000 7f13cccd1640 1 -- 172.21.15.77:0/2059098677 shutdown_connections 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 -- 172.21.15.77:0/2059098677 wait complete. 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 Processor -- start 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 -- start start 2024-09-15T23:30:52.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 0x7f13c81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.079+0000 7f13cccd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 0x7f13c819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13cccd1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f13c8118570 con 0x7f13c8101450 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13cccd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81183f0 con 0x7f13c8105f40 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13cccd1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f13c81186f0 con 0x7f13c8100b30 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58848/0 (socket says 172.21.15.77:58848) 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 -- 172.21.15.77:0/2097478214 learned_addr learned my addr 172.21.15.77:0/2097478214 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c659c640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 0x7f13c81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c6d9d640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 0x7f13c819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 -- 172.21.15.77:0/2097478214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 msgr2=0x7f13c81a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 0x7f13c81a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 -- 172.21.15.77:0/2097478214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 msgr2=0x7f13c819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:52.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 0x7f13c819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 -- 172.21.15.77:0/2097478214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c819efb0 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c6d9d640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 0x7f13c819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13c5d9b640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c940 tx=0x7f13bc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc004220 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c819f2a0 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f13bc0043c0 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc004a00 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.080+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c81ab4f0 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.081+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c806b070 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.082+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f13bc0079b0 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.083+0000 7f13b77fe640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 0x7f13b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.083+0000 7f13c659c640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 0x7f13b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.084+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f13bc0cfe10 con 0x7f13c8101450 2024-09-15T23:30:52.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.084+0000 7f13c659c640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 0x7f13b00a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:52.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.087+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f13bc014030 con 0x7f13c8101450 2024-09-15T23:30:52.151 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:52.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.277+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f13c81ab720 con 0x7f13c8101450 2024-09-15T23:30:52.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.278+0000 7f13b77fe640 1 -- 172.21.15.77:0/2097478214 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f13bc09c5e0 con 0x7f13c8101450 2024-09-15T23:30:52.279 INFO:teuthology.orchestra.run.smithi077.stdout:249108103213 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 msgr2=0x7f13b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 0x7f13b00a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f13b8005fd0 tx=0x7f13b800b390 comp rx=0 tx=0).stop 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 msgr2=0x7f13c81a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00c940 tx=0x7f13bc00ce00 comp rx=0 tx=0).stop 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 shutdown_connections 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f13b00a32d0 0x7f13b00a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f13c8105f40 0x7f13c819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f13c8101450 0x7f13c81a4bd0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 --2- 172.21.15.77:0/2097478214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13c8100b30 0x7f13c81a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:52.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 >> 172.21.15.77:0/2097478214 conn(0x7f13c80fc7a0 msgr2=0x7f13c810f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:52.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 shutdown_connections 2024-09-15T23:30:52.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:52.280+0000 7f13cccd1640 1 -- 172.21.15.77:0/2097478214 wait complete. 2024-09-15T23:30:53.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:52 smithi077 ceph-mon[30968]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:53.116 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:52 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2097478214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:30:53.124 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:53.124 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:52 smithi159 ceph-mon[35472]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:52 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2097478214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:30:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:52 smithi155 ceph-mon[35631]: pgmap v329: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:52 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2097478214' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-15T23:30:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 -- 172.21.15.77:0/450942318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100100 msgr2=0x7fc5e0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 --2- 172.21.15.77:0/450942318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100100 0x7fc5e0100560 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0009900 tx=0x7fc5d002a410 comp rx=0 tx=0).stop 2024-09-15T23:30:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 -- 172.21.15.77:0/450942318 shutdown_connections 2024-09-15T23:30:53.457 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 --2- 172.21.15.77:0/450942318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100aa0 0x7fc5e010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 --2- 172.21.15.77:0/450942318 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100100 0x7fc5e0100560 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 --2- 172.21.15.77:0/450942318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 -- 172.21.15.77:0/450942318 >> 172.21.15.77:0/450942318 conn(0x7fc5e0077230 msgr2=0x7fc5e00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 -- 172.21.15.77:0/450942318 shutdown_connections 2024-09-15T23:30:53.458 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.318+0000 7fc5e8587640 1 -- 172.21.15.77:0/450942318 wait complete. 2024-09-15T23:30:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 Processor -- start 2024-09-15T23:30:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 -- start start 2024-09-15T23:30:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 0x7fc5e01984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:53.459 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e0112050 con 0x7fc5e0100aa0 2024-09-15T23:30:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e0111ed0 con 0x7fc5e0106b80 2024-09-15T23:30:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e8587640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e01121d0 con 0x7fc5e0100100 2024-09-15T23:30:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:53.460 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58866/0 (socket says 172.21.15.77:58866) 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 -- 172.21.15.77:0/4139415257 learned_addr learned my addr 172.21.15.77:0/4139415257 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e6323640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 0x7fc5e01984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 -- 172.21.15.77:0/4139415257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 msgr2=0x7fc5e01984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 0x7fc5e01984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e6b24640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:53.461 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 -- 172.21.15.77:0/4139415257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 msgr2=0x7fc5e019cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e019cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e5b22640 1 -- 172.21.15.77:0/4139415257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e019d4a0 con 0x7fc5e0100aa0 2024-09-15T23:30:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e6323640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 0x7fc5e01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.319+0000 7fc5e6b24640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:53.462 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5e5b22640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0006010 tx=0x7fc5d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d003f030 con 0x7fc5e0100aa0 2024-09-15T23:30:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5d0003ce0 con 0x7fc5e0100aa0 2024-09-15T23:30:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e019d730 con 0x7fc5e0100aa0 2024-09-15T23:30:53.463 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5d0035070 con 0x7fc5e0100aa0 2024-09-15T23:30:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.320+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e01a5070 con 0x7fc5e0100aa0 2024-09-15T23:30:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.321+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e0100560 con 0x7fc5e0100aa0 2024-09-15T23:30:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.322+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc5d0042030 con 0x7fc5e0100aa0 2024-09-15T23:30:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.323+0000 7fc5d77fe640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 0x7fc5cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:53.464 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.323+0000 7fc5e6323640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 0x7fc5cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.323+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fc5d00f05a0 con 0x7fc5e0100aa0 2024-09-15T23:30:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.323+0000 7fc5e6323640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 0x7fc5cc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0058c0 tx=0x7fc5dc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:53.465 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.327+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc5d00bce90 con 0x7fc5e0100aa0 2024-09-15T23:30:53.468 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:53.468 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:53.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.517+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc5e01013b0 con 0x7fc5e0100aa0 2024-09-15T23:30:53.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.517+0000 7fc5d77fe640 1 -- 172.21.15.77:0/4139415257 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc5d00bc790 con 0x7fc5e0100aa0 2024-09-15T23:30:53.518 INFO:teuthology.orchestra.run.smithi077.stdout:77309411404 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 msgr2=0x7fc5cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 0x7fc5cc0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc0058c0 tx=0x7fc5dc005850 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 msgr2=0x7fc5e0198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc5d0006010 tx=0x7fc5d00042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 shutdown_connections 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc5cc0a32d0 0x7fc5cc0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc5e0106b80 0x7fc5e019cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc5e0100aa0 0x7fc5e0198a30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 --2- 172.21.15.77:0/4139415257 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5e0100100 0x7fc5e01984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 >> 172.21.15.77:0/4139415257 conn(0x7fc5e0077230 msgr2=0x7fc5e0104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:53.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 shutdown_connections 2024-09-15T23:30:53.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:53.519+0000 7fc5e8587640 1 -- 172.21.15.77:0/4139415257 wait complete. 2024-09-15T23:30:54.062 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:53 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4139415257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:30:54.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 -- 172.21.15.77:0/4195955152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 msgr2=0x7fda0410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 --2- 172.21.15.77:0/4195955152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0410ea90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009ca0 tx=0x7fd9fc02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 -- 172.21.15.77:0/4195955152 shutdown_connections 2024-09-15T23:30:54.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 --2- 172.21.15.77:0/4195955152 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0410ea90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 --2- 172.21.15.77:0/4195955152 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 0x7fda041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 --2- 172.21.15.77:0/4195955152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 0x7fda041021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 -- 172.21.15.77:0/4195955152 >> 172.21.15.77:0/4195955152 conn(0x7fda040fd8c0 msgr2=0x7fda040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 -- 172.21.15.77:0/4195955152 shutdown_connections 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.140+0000 7fda095ce640 1 -- 172.21.15.77:0/4195955152 wait complete. 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 Processor -- start 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 -- start start 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 0x7fda04198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 0x7fda041988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fda04111f70 con 0x7fda04106f10 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda04111df0 con 0x7fda04102790 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda095ce640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fda041120f0 con 0x7fda04101de0 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.163 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda037fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58890/0 (socket says 172.21.15.77:58890) 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fda037fe640 1 -- 172.21.15.77:0/2229296077 learned_addr learned my addr 172.21.15.77:0/2229296077 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.141+0000 7fd9fa7fc640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 0x7fda041988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda02ffd640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 0x7fda04198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 -- 172.21.15.77:0/2229296077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 msgr2=0x7fda04198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 0x7fda04198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 -- 172.21.15.77:0/2229296077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 msgr2=0x7fda041988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 0x7fda041988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 -- 172.21.15.77:0/2229296077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0419d340 con 0x7fda04106f10 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda037fe640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc031a20 tx=0x7fd9fc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc003c30 con 0x7fda04106f10 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd9fc003dd0 con 0x7fda04106f10 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0419d5d0 con 0x7fda04106f10 2024-09-15T23:30:54.164 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc02fcf0 con 0x7fda04106f10 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.142+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda04074420 con 0x7fda04106f10 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.143+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda041021c0 con 0x7fda04106f10 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.144+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd9fc004050 con 0x7fda04106f10 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.145+0000 7fda00ff9640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 0x7fd9f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.145+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fd9fc0f1040 con 0x7fda04106f10 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.145+0000 7fda02ffd640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 0x7fd9f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.145+0000 7fda02ffd640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 0x7fd9f00a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005e10 tx=0x7fd9f4005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:54.165 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.149+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fd9fc0bdb30 con 0x7fda04106f10 2024-09-15T23:30:54.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:53 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/4139415257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:30:54.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.318+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fda04074740 con 0x7fda04106f10 2024-09-15T23:30:54.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.319+0000 7fda00ff9640 1 -- 172.21.15.77:0/2229296077 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd9fc02fe90 con 0x7fda04106f10 2024-09-15T23:30:54.320 INFO:teuthology.orchestra.run.smithi077.stdout:300647710754 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.321+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 msgr2=0x7fd9f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.321+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 0x7fd9f00a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005e10 tx=0x7fd9f4005da0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.321+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 msgr2=0x7fda0419cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.321+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc031a20 tx=0x7fd9fc031a50 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 shutdown_connections 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd9f00a3350 0x7fd9f00a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fda04106f10 0x7fda0419cc60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda04102790 0x7fda041988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 --2- 172.21.15.77:0/2229296077 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda04101de0 0x7fda04198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 >> 172.21.15.77:0/2229296077 conn(0x7fda040fd8c0 msgr2=0x7fda040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:54.323 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 shutdown_connections 2024-09-15T23:30:54.324 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.322+0000 7fda095ce640 1 -- 172.21.15.77:0/2229296077 wait complete. 2024-09-15T23:30:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:53 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/4139415257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-15T23:30:54.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 -- 172.21.15.77:0/1126450769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 msgr2=0x7fbfe010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/1126450769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe010eaa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009ca0 tx=0x7fbfd802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 -- 172.21.15.77:0/1126450769 shutdown_connections 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/1126450769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe010eaa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/1126450769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 0x7fbfe01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/1126450769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 -- 172.21.15.77:0/1126450769 >> 172.21.15.77:0/1126450769 conn(0x7fbfe00fd8b0 msgr2=0x7fbfe00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 -- 172.21.15.77:0/1126450769 shutdown_connections 2024-09-15T23:30:54.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.487+0000 7fbfe4e35640 1 -- 172.21.15.77:0/1126450769 wait complete. 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 Processor -- start 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 -- start start 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 0x7fbfe01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0111fd0 con 0x7fbfe0106f20 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0111e50 con 0x7fbfe0101df0 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfe4e35640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0112150 con 0x7fbfe01027a0 2024-09-15T23:30:54.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfded9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfded9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58914/0 (socket says 172.21.15.77:58914) 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfded9d640 1 -- 172.21.15.77:0/462587550 learned_addr learned my addr 172.21.15.77:0/462587550 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.488+0000 7fbfd7fff640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 0x7fbfe01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 -- 172.21.15.77:0/462587550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 msgr2=0x7fbfe01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 0x7fbfe01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 -- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 msgr2=0x7fbfe019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 -- 172.21.15.77:0/462587550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe019d460 con 0x7fbfe0101df0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.489+0000 7fbfde59c640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01984b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000d6d0 tx=0x7fbfd000db90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.490+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0017070 con 0x7fbfe0101df0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.490+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfd0009820 con 0x7fbfe0101df0 2024-09-15T23:30:54.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.490+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe019d750 con 0x7fbfe0101df0 2024-09-15T23:30:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.490+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd0004ce0 con 0x7fbfe0101df0 2024-09-15T23:30:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.490+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01a5030 con 0x7fbfe0101df0 2024-09-15T23:30:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.491+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe01021d0 con 0x7fbfe0101df0 2024-09-15T23:30:54.493 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.492+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbfd00099d0 con 0x7fbfe0101df0 2024-09-15T23:30:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.493+0000 7fbfd77fe640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 0x7fbfcc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.493+0000 7fbfd7fff640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 0x7fbfcc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.493+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fbfd00cf9e0 con 0x7fbfe0101df0 2024-09-15T23:30:54.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.493+0000 7fbfd7fff640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 0x7fbfcc0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005fd0 tx=0x7fbfc8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:54.497 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.496+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbfd009c290 con 0x7fbfe0101df0 2024-09-15T23:30:54.668 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.667+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbfe0199810 con 0x7fbfe0101df0 2024-09-15T23:30:54.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.668+0000 7fbfd77fe640 1 -- 172.21.15.77:0/462587550 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fbfd009bb90 con 0x7fbfe0101df0 2024-09-15T23:30:54.669 INFO:teuthology.orchestra.run.smithi077.stdout:107374182471 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 msgr2=0x7fbfcc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 0x7fbfcc0a5810 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8005fd0 tx=0x7fbfc8005850 comp rx=0 tx=0).stop 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 msgr2=0x7fbfe01984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01984b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbfd000d6d0 tx=0x7fbfd000db90 comp rx=0 tx=0).stop 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 shutdown_connections 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbfcc0a3350 0x7fbfcc0a5810 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbfe0106f20 0x7fbfe019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbfe01027a0 0x7fbfe01989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 --2- 172.21.15.77:0/462587550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfe0101df0 0x7fbfe01984b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:54.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 >> 172.21.15.77:0/462587550 conn(0x7fbfe00fd8b0 msgr2=0x7fbfe00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:54.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 shutdown_connections 2024-09-15T23:30:54.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:54.670+0000 7fbfe4e35640 1 -- 172.21.15.77:0/462587550 wait complete. 2024-09-15T23:30:55.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:54 smithi077 ceph-mon[30968]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:55.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:54 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2229296077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:30:55.163 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:54 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/462587550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:30:55.189 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103211 got 249108103213 for osd.8 2024-09-15T23:30:55.190 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:54 smithi159 ceph-mon[35472]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:54 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2229296077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:30:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:54 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/462587550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:30:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:54 smithi155 ceph-mon[35631]: pgmap v330: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:54 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2229296077' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-15T23:30:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:54 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/462587550' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-15T23:30:55.797 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710752 got 300647710754 for osd.10 2024-09-15T23:30:55.797 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:55.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 -- 172.21.15.77:0/3039957162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960102ef0 msgr2=0x7ff96010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:55.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 --2- 172.21.15.77:0/3039957162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960102ef0 0x7ff96010da40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff958009ca0 tx=0x7ff95802a950 comp rx=0 tx=0).stop 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 -- 172.21.15.77:0/3039957162 shutdown_connections 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 --2- 172.21.15.77:0/3039957162 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960102ef0 0x7ff96010da40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 --2- 172.21.15.77:0/3039957162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102570 0x7ff9601029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 --2- 172.21.15.77:0/3039957162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960100e20 0x7ff960101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 -- 172.21.15.77:0/3039957162 >> 172.21.15.77:0/3039957162 conn(0x7ff9600fc7d0 msgr2=0x7ff9600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 -- 172.21.15.77:0/3039957162 shutdown_connections 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.976+0000 7ff967402640 1 -- 172.21.15.77:0/3039957162 wait complete. 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 Processor -- start 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 -- start start 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 0x7ff9601997b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 0x7ff9601a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:55.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff960110f80 con 0x7ff960100e20 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff960110e00 con 0x7ff960102570 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff967402640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff960111100 con 0x7ff960102ef0 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:58938/0 (socket says 172.21.15.77:58938) 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 -- 172.21.15.77:0/1160608134 learned_addr learned my addr 172.21.15.77:0/1160608134 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96599f640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 0x7ff9601a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96499d640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 0x7ff9601997b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 -- 172.21.15.77:0/1160608134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 msgr2=0x7ff9601a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 0x7ff9601a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 -- 172.21.15.77:0/1160608134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 msgr2=0x7ff9601997b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 0x7ff9601997b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 -- 172.21.15.77:0/1160608134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9601a4830 con 0x7ff960100e20 2024-09-15T23:30:55.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96499d640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 0x7ff9601997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96599f640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 0x7ff9601a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.977+0000 7ff96519e640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00c890 tx=0x7ff95c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.978+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c004220 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.978+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff95c0043c0 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.978+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9601a4a00 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.978+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0049e0 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.978+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9601a4f10 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.979+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff960101200 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.980+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff95c0079b0 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.981+0000 7ff9567fc640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 0x7ff94c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.981+0000 7ff96499d640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 0x7ff94c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.981+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff95c0cff40 con 0x7ff960100e20 2024-09-15T23:30:55.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.981+0000 7ff96499d640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 0x7ff94c0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff950005e10 tx=0x7ff950005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:55.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:55.985+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff95c014030 con 0x7ff960100e20 2024-09-15T23:30:56.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.158+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff9601a51d0 con 0x7ff960100e20 2024-09-15T23:30:56.159 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.158+0000 7ff9567fc640 1 -- 172.21.15.77:0/1160608134 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff95c09c770 con 0x7ff960100e20 2024-09-15T23:30:56.160 INFO:teuthology.orchestra.run.smithi077.stdout:158913790013 2024-09-15T23:30:56.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 msgr2=0x7ff94c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:56.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 0x7ff94c0a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff950005e10 tx=0x7ff950005da0 comp rx=0 tx=0).stop 2024-09-15T23:30:56.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 msgr2=0x7ff960199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:56.161 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00c890 tx=0x7ff95c00cd50 comp rx=0 tx=0).stop 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 shutdown_connections 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff94c0a32d0 0x7ff94c0a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff960102ef0 0x7ff9601a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff960102570 0x7ff9601997b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 --2- 172.21.15.77:0/1160608134 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff960100e20 0x7ff960199270 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 >> 172.21.15.77:0/1160608134 conn(0x7ff9600fc7d0 msgr2=0x7ff9601067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 shutdown_connections 2024-09-15T23:30:56.162 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:56.160+0000 7ff967402640 1 -- 172.21.15.77:0/1160608134 wait complete. 2024-09-15T23:30:56.218 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:30:56.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182468 got 107374182471 for osd.3 2024-09-15T23:30:56.872 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:57.103 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:56 smithi077 ceph-mon[30968]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T23:30:57.103 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:56 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1160608134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:30:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:56 smithi159 ceph-mon[35472]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T23:30:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:56 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1160608134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:30:57.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:56 smithi155 ceph-mon[35631]: pgmap v331: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 1 op/s 2024-09-15T23:30:57.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:56 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1160608134' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-15T23:30:57.485 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411403 got 77309411404 for osd.2 2024-09-15T23:30:57.485 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:57.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 -- 172.21.15.77:0/1084093688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 msgr2=0x7f38001063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:57.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 --2- 172.21.15.77:0/1084093688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f38001063d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f37f8009ca0 tx=0x7f37f802a940 comp rx=0 tx=0).stop 2024-09-15T23:30:57.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 -- 172.21.15.77:0/1084093688 shutdown_connections 2024-09-15T23:30:57.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 --2- 172.21.15.77:0/1084093688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f38001063d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 --2- 172.21.15.77:0/1084093688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800101450 0x7f3800105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 --2- 172.21.15.77:0/1084093688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800100b30 0x7f3800100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 -- 172.21.15.77:0/1084093688 >> 172.21.15.77:0/1084093688 conn(0x7f38000fc7a0 msgr2=0x7f38000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 -- 172.21.15.77:0/1084093688 shutdown_connections 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.624+0000 7f3807d37640 1 -- 172.21.15.77:0/1084093688 wait complete. 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 Processor -- start 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 -- start start 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800100b30 0x7f38001a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800101450 0x7f38001a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3800118570 con 0x7f3800105f40 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f38001183f0 con 0x7f3800100b30 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.625+0000 7f3807d37640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f38001186f0 con 0x7f3800101450 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:57.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41584/0 (socket says 172.21.15.77:41584) 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 -- 172.21.15.77:0/3934978854 learned_addr learned my addr 172.21.15.77:0/3934978854 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38052d2640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800101450 0x7f38001a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f3805ad3640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800100b30 0x7f38001a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 -- 172.21.15.77:0/3934978854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800101450 msgr2=0x7f38001a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800101450 0x7f38001a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 -- 172.21.15.77:0/3934978854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800100b30 msgr2=0x7f38001a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800100b30 0x7f38001a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 -- 172.21.15.77:0/3934978854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f380019efa0 con 0x7f3800105f40 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f38062d4640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37f8006010 tx=0x7f37f802f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8034040 con 0x7f3800105f40 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37f8003e50 con 0x7f3800105f40 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f380019f230 con 0x7f3800105f40 2024-09-15T23:30:57.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004800 con 0x7f3800105f40 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.626+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001ab4e0 con 0x7f3800105f40 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.627+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f380006b070 con 0x7f3800105f40 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.628+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f37f8037020 con 0x7f3800105f40 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.629+0000 7f37f6ffd640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 0x7f37ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.629+0000 7f3805ad3640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 0x7f37ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.629+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f37f80f0c30 con 0x7f3800105f40 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.630+0000 7f3805ad3640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 0x7f37ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37f00058c0 tx=0x7f37f000a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:57.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.633+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f37f80098b0 con 0x7f3800105f40 2024-09-15T23:30:57.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.806+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f38001ab6b0 con 0x7f3800105f40 2024-09-15T23:30:57.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.807+0000 7f37f6ffd640 1 -- 172.21.15.77:0/3934978854 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f37f80bd600 con 0x7f3800105f40 2024-09-15T23:30:57.808 INFO:teuthology.orchestra.run.smithi077.stdout:279172874281 2024-09-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 msgr2=0x7f37ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 0x7f37ec0a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f37f00058c0 tx=0x7f37f000a250 comp rx=0 tx=0).stop 2024-09-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 msgr2=0x7f380019e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f37f8006010 tx=0x7f37f802f700 comp rx=0 tx=0).stop 2024-09-15T23:30:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 shutdown_connections 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f37ec0a32d0 0x7f37ec0a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3800105f40 0x7f380019e800 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3800101450 0x7f38001a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 --2- 172.21.15.77:0/3934978854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3800100b30 0x7f38001a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 >> 172.21.15.77:0/3934978854 conn(0x7f38000fc7a0 msgr2=0x7f38001038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 shutdown_connections 2024-09-15T23:30:57.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:57.809+0000 7f3807d37640 1 -- 172.21.15.77:0/3934978854 wait complete. 2024-09-15T23:30:57.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:57 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3934978854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:30:58.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:57 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3934978854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:30:58.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:57 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3934978854' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-15T23:30:58.586 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874278 got 279172874281 for osd.9 2024-09-15T23:30:58.587 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:58.979 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:58 smithi077 ceph-mon[30968]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:59.007 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790010 got 158913790013 for osd.5 2024-09-15T23:30:59.007 DEBUG:teuthology.parallel:result is None 2024-09-15T23:30:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:58 smithi159 ceph-mon[35472]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:58 smithi155 ceph-mon[35631]: pgmap v332: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:30:59.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 -- 172.21.15.77:0/1998417916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 msgr2=0x7f62e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 --2- 172.21.15.77:0/1998417916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01021c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f62d0009900 tx=0x7f62d002a410 comp rx=0 tx=0).stop 2024-09-15T23:30:59.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 -- 172.21.15.77:0/1998417916 shutdown_connections 2024-09-15T23:30:59.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 --2- 172.21.15.77:0/1998417916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 0x7f62e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 --2- 172.21.15.77:0/1998417916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 --2- 172.21.15.77:0/1998417916 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01021c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 -- 172.21.15.77:0/1998417916 >> 172.21.15.77:0/1998417916 conn(0x7f62e00fd8c0 msgr2=0x7f62e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 -- 172.21.15.77:0/1998417916 shutdown_connections 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.748+0000 7f62e76e8640 1 -- 172.21.15.77:0/1998417916 wait complete. 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 Processor -- start 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 -- start start 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e0198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 0x7f62e019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0112010 con 0x7f62e0101de0 2024-09-15T23:30:59.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0111e90 con 0x7f62e0106f10 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e76e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0112190 con 0x7f62e0102790 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41610/0 (socket says 172.21.15.77:41610) 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 -- 172.21.15.77:0/3840336863 learned_addr learned my addr 172.21.15.77:0/3840336863 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5c85640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 0x7f62e019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e4c83640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e0198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 -- 172.21.15.77:0/3840336863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 msgr2=0x7f62e0198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e0198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 -- 172.21.15.77:0/3840336863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 msgr2=0x7f62e019ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 0x7f62e019ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 -- 172.21.15.77:0/3840336863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e019d560 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e4c83640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.749+0000 7f62e5484640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62d0005ab0 tx=0x7f62d00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.750+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d003f030 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.750+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f62d0003ce0 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.750+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e019d7f0 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.750+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d0035070 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.750+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e01a5130 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.751+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e01032c0 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.752+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f62d0042030 con 0x7f62e0101de0 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.753+0000 7f62d67fc640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 0x7f62cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.753+0000 7f62e4c83640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 0x7f62cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.753+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f62d00f0ab0 con 0x7f62e0101de0 2024-09-15T23:30:59.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.753+0000 7f62e4c83640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 0x7f62cc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62dc006fd0 tx=0x7f62dc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:59.774 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.756+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f62d00bd280 con 0x7f62e0101de0 2024-09-15T23:30:59.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.927+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f62e010a0f0 con 0x7f62e0101de0 2024-09-15T23:30:59.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.928+0000 7f62d67fc640 1 -- 172.21.15.77:0/3840336863 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f62d00bcb80 con 0x7f62e0101de0 2024-09-15T23:30:59.929 INFO:teuthology.orchestra.run.smithi077.stdout:330712481823 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 msgr2=0x7f62cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 0x7f62cc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f62dc006fd0 tx=0x7f62dc008040 comp rx=0 tx=0).stop 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 msgr2=0x7f62e01985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f62d0005ab0 tx=0x7f62d00042f0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 shutdown_connections 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f62cc0a32d0 0x7f62cc0a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f62e0106f10 0x7f62e019ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.931 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f62e0102790 0x7f62e0198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 --2- 172.21.15.77:0/3840336863 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f62e0101de0 0x7f62e01985b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 >> 172.21.15.77:0/3840336863 conn(0x7f62e00fd8c0 msgr2=0x7f62e00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 shutdown_connections 2024-09-15T23:30:59.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.930+0000 7f62e76e8640 1 -- 172.21.15.77:0/3840336863 wait complete. 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 -- 172.21.15.77:0/3980054076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 msgr2=0x7fcd201031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 --2- 172.21.15.77:0/3980054076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201031b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcd10009900 tx=0x7fcd1002a480 comp rx=0 tx=0).stop 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 -- 172.21.15.77:0/3980054076 shutdown_connections 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 --2- 172.21.15.77:0/3980054076 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd2010c170 0x7fcd2010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 --2- 172.21.15.77:0/3980054076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd201036f0 0x7fcd2010bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 --2- 172.21.15.77:0/3980054076 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201031b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 -- 172.21.15.77:0/3980054076 >> 172.21.15.77:0/3980054076 conn(0x7fcd200fc790 msgr2=0x7fcd200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:30:59.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 -- 172.21.15.77:0/3980054076 shutdown_connections 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.965+0000 7fcd2528a640 1 -- 172.21.15.77:0/3980054076 wait complete. 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 Processor -- start 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 -- start start 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd201036f0 0x7fcd201989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd2010c170 0x7fcd2019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20111fa0 con 0x7fcd20102dd0 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20111e20 con 0x7fcd2010c170 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd2528a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20112120 con 0x7fcd201036f0 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd1effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41622/0 (socket says 172.21.15.77:41622) 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.966+0000 7fcd1effd640 1 -- 172.21.15.77:0/248153401 learned_addr learned my addr 172.21.15.77:0/248153401 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 -- 172.21.15.77:0/248153401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd201036f0 msgr2=0x7fcd201989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd201036f0 0x7fcd201989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 -- 172.21.15.77:0/248153401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd2010c170 msgr2=0x7fcd2019cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd2010c170 0x7fcd2019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 -- 172.21.15.77:0/248153401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2019d450 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd1effd640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcd10006010 tx=0x7fcd100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1003f030 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcd10003ce0 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10035070 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2019d6e0 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.967+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd201a5020 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.968+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd201031b0 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.969+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcd10042030 con 0x7fcd20102dd0 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.970+0000 7fcd17fff640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 0x7fcd0c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:30:59.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.970+0000 7fcd1e7fc640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 0x7fcd0c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:30:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.970+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fcd100f07b0 con 0x7fcd20102dd0 2024-09-15T23:30:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.971+0000 7fcd1e7fc640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 0x7fcd0c0a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd08005fd0 tx=0x7fcd08005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:30:59.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.973+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcd100bd0a0 con 0x7fcd20102dd0 2024-09-15T23:31:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:30:59 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2985941050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:31:00.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:30:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2985941050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:31:00.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.143+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fcd20199800 con 0x7fcd20102dd0 2024-09-15T23:31:00.145 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.144+0000 7fcd17fff640 1 -- 172.21.15.77:0/248153401 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcd100bc9a0 con 0x7fcd20102dd0 2024-09-15T23:31:00.145 INFO:teuthology.orchestra.run.smithi077.stdout:137438953539 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 msgr2=0x7fcd0c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 0x7fcd0c0a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd08005fd0 tx=0x7fcd08005c70 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 msgr2=0x7fcd201984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcd10006010 tx=0x7fcd100042f0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 shutdown_connections 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcd0c0a3350 0x7fcd0c0a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcd2010c170 0x7fcd2019cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcd201036f0 0x7fcd201989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 --2- 172.21.15.77:0/248153401 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcd20102dd0 0x7fcd201984a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.146+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 >> 172.21.15.77:0/248153401 conn(0x7fcd200fc790 msgr2=0x7fcd200fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.147+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 shutdown_connections 2024-09-15T23:31:00.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:00.147+0000 7fcd2528a640 1 -- 172.21.15.77:0/248153401 wait complete. 2024-09-15T23:31:00.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:30:59 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2985941050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-15T23:31:00.840 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953535 got 137438953539 for osd.4 2024-09-15T23:31:00.840 DEBUG:teuthology.parallel:result is None 2024-09-15T23:31:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 -- 172.21.15.77:0/1407811260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 msgr2=0x7fa0c010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/1407811260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c010d130 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8009ca0 tx=0x7fa0b802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 -- 172.21.15.77:0/1407811260 shutdown_connections 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/1407811260 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c010d130 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/1407811260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100e30 0x7fa0c0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/1407811260 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100480 0x7fa0c0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 -- 172.21.15.77:0/1407811260 >> 172.21.15.77:0/1407811260 conn(0x7fa0c0077210 msgr2=0x7fa0c00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 -- 172.21.15.77:0/1407811260 shutdown_connections 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.184+0000 7fa0c65c3640 1 -- 172.21.15.77:0/1407811260 wait complete. 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 Processor -- start 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 -- start start 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100480 0x7fa0c00fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100e30 0x7fa0c00fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:00.913 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0110f30 con 0x7fa0c01055b0 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c0110db0 con 0x7fa0c0100480 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.185+0000 7fa0c65c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c01110b0 con 0x7fa0c0100e30 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41602/0 (socket says 172.21.15.77:41602) 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 -- 172.21.15.77:0/2985941050 learned_addr learned my addr 172.21.15.77:0/2985941050 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0bffff640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100480 0x7fa0c00fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0bf7fe640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100e30 0x7fa0c00fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 -- 172.21.15.77:0/2985941050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100e30 msgr2=0x7fa0c00fcbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100e30 0x7fa0c00fcbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 -- 172.21.15.77:0/2985941050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100480 msgr2=0x7fa0c00fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100480 0x7fa0c00fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 -- 172.21.15.77:0/2985941050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c01a6a20 con 0x7fa0c01055b0 2024-09-15T23:31:00.914 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c4b60640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031a60 tx=0x7fa0b8031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8003b70 con 0x7fa0c01055b0 2024-09-15T23:31:00.915 INFO:teuthology.orchestra.run.smithi077.stdout:214748364851 2024-09-15T23:31:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0b8003d10 con 0x7fa0c01055b0 2024-09-15T23:31:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c01a6cb0 con 0x7fa0c01055b0 2024-09-15T23:31:00.915 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8004770 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.186+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c01a71f0 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.187+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c01008e0 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.189+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa0b8004b40 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.189+0000 7fa0bd7fa640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 0x7fa0ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.190+0000 7fa0bffff640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 0x7fa0ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.190+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa0b80f11f0 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.190+0000 7fa0bffff640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 0x7fa0ac0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009990 tx=0x7fa0b0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.193+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa0b80bdb30 con 0x7fa0c01055b0 2024-09-15T23:31:00.916 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.366+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa0c01a7420 con 0x7fa0c01055b0 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.367+0000 7fa0bd7fa640 1 -- 172.21.15.77:0/2985941050 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa0b80bd430 con 0x7fa0c01055b0 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.369+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 msgr2=0x7fa0ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.369+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 0x7fa0ac0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0b0009990 tx=0x7fa0b0009110 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.369+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 msgr2=0x7fa0c00fd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.369+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa0b8031a60 tx=0x7fa0b8031a90 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 shutdown_connections 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa0ac0a32d0 0x7fa0ac0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa0c01055b0 0x7fa0c00fd110 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0c0100e30 0x7fa0c00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 --2- 172.21.15.77:0/2985941050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0c0100480 0x7fa0c00fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 >> 172.21.15.77:0/2985941050 conn(0x7fa0c0077210 msgr2=0x7fa0c010db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 shutdown_connections 2024-09-15T23:31:00.917 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:30:59.370+0000 7fa0c65c3640 1 -- 172.21.15.77:0/2985941050 wait complete. 2024-09-15T23:31:01.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:00 smithi077 ceph-mon[30968]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:00 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3840336863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:31:01.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:00 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/248153401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:31:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:00 smithi159 ceph-mon[35472]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:00 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3840336863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:31:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:00 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/248153401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:31:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:00 smithi155 ceph-mon[35631]: pgmap v333: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:00 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3840336863' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-15T23:31:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:00 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/248153401' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 -- 172.21.15.77:0/3818994865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374100a80 msgr2=0x7fb374100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 --2- 172.21.15.77:0/3818994865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374100a80 0x7fb374100ee0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009930 tx=0x7fb35c02a420 comp rx=0 tx=0).stop 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 -- 172.21.15.77:0/3818994865 shutdown_connections 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 --2- 172.21.15.77:0/3818994865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374101420 0x7fb37410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 --2- 172.21.15.77:0/3818994865 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374100a80 0x7fb374100ee0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 --2- 172.21.15.77:0/3818994865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374106a80 0x7fb374106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 -- 172.21.15.77:0/3818994865 >> 172.21.15.77:0/3818994865 conn(0x7fb3740fc7a0 msgr2=0x7fb3740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 -- 172.21.15.77:0/3818994865 shutdown_connections 2024-09-15T23:31:01.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.665+0000 7fb379059640 1 -- 172.21.15.77:0/3818994865 wait complete. 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 Processor -- start 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 -- start start 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 0x7fb3741992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 0x7fb3741a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb374110e80 con 0x7fb374101420 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb374110d00 con 0x7fb374100a80 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb379059640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb374111000 con 0x7fb374106a80 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb36a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb36a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41636/0 (socket says 172.21.15.77:41636) 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb36a59c640 1 -- 172.21.15.77:0/3021683728 learned_addr learned my addr 172.21.15.77:0/3021683728 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:01.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.666+0000 7fb372d9d640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 0x7fb3741992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb37359e640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 0x7fb3741a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 -- 172.21.15.77:0/3021683728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 msgr2=0x7fb3741a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 0x7fb3741a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 -- 172.21.15.77:0/3021683728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 msgr2=0x7fb3741992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 0x7fb3741992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 -- 172.21.15.77:0/3021683728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3741a4870 con 0x7fb374101420 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb37359e640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 0x7fb3741a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb372d9d640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 0x7fb3741992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb36a59c640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009a50 tx=0x7fb35c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c03f030 con 0x7fb374101420 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3741a4a40 con 0x7fb374101420 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb35c003ce0 con 0x7fb374101420 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c035070 con 0x7fb374101420 2024-09-15T23:31:01.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.667+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3741a4e90 con 0x7fb374101420 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.668+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb374100ee0 con 0x7fb374101420 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.670+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb35c042030 con 0x7fb374101420 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.671+0000 7fb370d99640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 0x7fb3600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.671+0000 7fb372d9d640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 0x7fb3600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.671+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb35c0f08d0 con 0x7fb374101420 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.671+0000 7fb372d9d640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 0x7fb3600a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb364005d90 tx=0x7fb364005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:01.695 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.674+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb35c0bd100 con 0x7fb374101420 2024-09-15T23:31:01.781 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.847+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb37406ad80 con 0x7fb374101420 2024-09-15T23:31:01.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.848+0000 7fb370d99640 1 -- 172.21.15.77:0/3021683728 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb37406ad80 con 0x7fb374101420 2024-09-15T23:31:01.849 INFO:teuthology.orchestra.run.smithi077.stdout:34359738455 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 msgr2=0x7fb3600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 0x7fb3600a5790 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb364005d90 tx=0x7fb364005d20 comp rx=0 tx=0).stop 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 msgr2=0x7fb3741997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb35c009a50 tx=0x7fb35c004270 comp rx=0 tx=0).stop 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 shutdown_connections 2024-09-15T23:31:01.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3600a32d0 0x7fb3600a5790 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb374106a80 0x7fb3741a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb374101420 0x7fb3741997f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 --2- 172.21.15.77:0/3021683728 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb374100a80 0x7fb3741992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 >> 172.21.15.77:0/3021683728 conn(0x7fb3740fc7a0 msgr2=0x7fb3740fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 shutdown_connections 2024-09-15T23:31:01.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:01.850+0000 7fb379059640 1 -- 172.21.15.77:0/3021683728 wait complete. 2024-09-15T23:31:02.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:01 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3021683728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:31:02.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:01 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3021683728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:31:02.253 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364849 got 214748364851 for osd.7 2024-09-15T23:31:02.253 DEBUG:teuthology.parallel:result is None 2024-09-15T23:31:02.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:01 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3021683728' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-15T23:31:03.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:02 smithi077 ceph-mon[30968]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:03.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:02 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1016597414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:31:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:02 smithi159 ceph-mon[35472]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:02 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1016597414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:31:03.334 INFO:tasks.cephadm.ceph_manager.ceph:need seq 330712481820 got 330712481823 for osd.11 2024-09-15T23:31:03.334 DEBUG:teuthology.parallel:result is None 2024-09-15T23:31:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:02 smithi155 ceph-mon[35631]: pgmap v334: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:02 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1016597414' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.669+0000 7f31805b1640 1 -- 172.21.15.77:0/2518224782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178100e20 msgr2=0x7f3178101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- 172.21.15.77:0/2518224782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178100e20 0x7f3178101200 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3168009ca0 tx=0x7f316802a950 comp rx=0 tx=0).stop 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- 172.21.15.77:0/2518224782 shutdown_connections 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- 172.21.15.77:0/2518224782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178102ef0 0x7f317810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- 172.21.15.77:0/2518224782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102570 0x7f31781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- 172.21.15.77:0/2518224782 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178100e20 0x7f3178101200 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- 172.21.15.77:0/2518224782 >> 172.21.15.77:0/2518224782 conn(0x7f31780fc7d0 msgr2=0x7f31780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:03.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- 172.21.15.77:0/2518224782 shutdown_connections 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- 172.21.15.77:0/2518224782 wait complete. 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 Processor -- start 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- start start 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178100e20 0x7f3178198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 0x7f317819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3178110f80 con 0x7f3178102570 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3178110e00 con 0x7f3178102ef0 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.670+0000 7f31805b1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3178111100 con 0x7f3178100e20 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41646/0 (socket says 172.21.15.77:41646) 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 -- 172.21.15.77:0/1016597414 learned_addr learned my addr 172.21.15.77:0/1016597414 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317e34d640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178100e20 0x7f3178198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:03.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317eb4e640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 0x7f317819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 -- 172.21.15.77:0/1016597414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178100e20 msgr2=0x7f3178198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178100e20 0x7f3178198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 -- 172.21.15.77:0/1016597414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 msgr2=0x7f317819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 0x7f317819ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 -- 172.21.15.77:0/1016597414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317819d4f0 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317eb4e640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 0x7f317819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f317db4c640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e9f0 tx=0x7f316c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c00cd80 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317819d7e0 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31781a50c0 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f316c010910 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.671+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c018980 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.672+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3164005290 con 0x7f3178102570 2024-09-15T23:31:03.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.673+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f316c010ac0 con 0x7f3178102570 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.674+0000 7f31777fe640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 0x7f31600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.674+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f316c0d0190 con 0x7f3178102570 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.674+0000 7f317e34d640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 0x7f31600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.675+0000 7f317e34d640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 0x7f31600a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3168005fc0 tx=0x7f3168009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stdout:55834574930 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.678+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f316c09c9c0 con 0x7f3178102570 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.847+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3164005850 con 0x7f3178102570 2024-09-15T23:31:03.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.847+0000 7f31777fe640 1 -- 172.21.15.77:0/1016597414 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f316c09c2c0 con 0x7f3178102570 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.849+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 msgr2=0x7f31600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.849+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 0x7f31600a5810 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3168005fc0 tx=0x7f3168009360 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.849+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 msgr2=0x7f3178198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.849+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e9f0 tx=0x7f316c00eeb0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 shutdown_connections 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f31600a3350 0x7f31600a5810 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3178102ef0 0x7f317819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3178102570 0x7f3178198a80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 --2- 172.21.15.77:0/1016597414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3178100e20 0x7f3178198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 >> 172.21.15.77:0/1016597414 conn(0x7f31780fc7d0 msgr2=0x7f3178105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 shutdown_connections 2024-09-15T23:31:03.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:02.850+0000 7f31805b1640 1 -- 172.21.15.77:0/1016597414 wait complete. 2024-09-15T23:31:04.060 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574930 for osd.1 2024-09-15T23:31:04.060 DEBUG:teuthology.parallel:result is None 2024-09-15T23:31:04.593 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738455 for osd.0 2024-09-15T23:31:04.593 DEBUG:teuthology.parallel:result is None 2024-09-15T23:31:04.593 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T23:31:04.594 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:31:04.850 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:05.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:04 smithi159 ceph-mon[35472]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:05.286 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:04 smithi077 ceph-mon[30968]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:05.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:04 smithi155 ceph-mon[35631]: pgmap v335: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- 172.21.15.77:0/4268777779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 msgr2=0x7f716c110840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 --2- 172.21.15.77:0/4268777779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c110840 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7164009900 tx=0x7f716402a480 comp rx=0 tx=0).stop 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- 172.21.15.77:0/4268777779 shutdown_connections 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 --2- 172.21.15.77:0/4268777779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c110840 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 --2- 172.21.15.77:0/4268777779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c074e30 0x7f716c10df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 --2- 172.21.15.77:0/4268777779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074510 0x7f716c0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- 172.21.15.77:0/4268777779 >> 172.21.15.77:0/4268777779 conn(0x7f716c0fd8f0 msgr2=0x7f716c0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- 172.21.15.77:0/4268777779 shutdown_connections 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- 172.21.15.77:0/4268777779 wait complete. 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 Processor -- start 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.365+0000 7f71746fc640 1 -- start start 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c074510 0x7f716c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074e30 0x7f716c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f716c114160 con 0x7f716c10e450 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f716c113fe0 con 0x7f716c074510 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f716c1142e0 con 0x7f716c074e30 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:41662/0 (socket says 172.21.15.77:41662) 2024-09-15T23:31:05.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 -- 172.21.15.77:0/124279306 learned_addr learned my addr 172.21.15.77:0/124279306 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7171c97640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074e30 0x7f716c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 -- 172.21.15.77:0/124279306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074e30 msgr2=0x7f716c19aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074e30 0x7f716c19aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 -- 172.21.15.77:0/124279306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c074510 msgr2=0x7f716c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c074510 0x7f716c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 -- 172.21.15.77:0/124279306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716c19f610 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f7172c99640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7164005ab0 tx=0x7f71640040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f716403f030 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71640044c0 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716c19f8a0 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164035070 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.366+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f716c1a71e0 con 0x7f716c10e450 2024-09-15T23:31:05.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.367+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f716c075c50 con 0x7f716c10e450 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.369+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7164042030 con 0x7f716c10e450 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.370+0000 7f716b7fe640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 0x7f71540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.370+0000 7f7172498640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 0x7f71540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.370+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f71640f0530 con 0x7f716c10e450 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.370+0000 7f7172498640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 0x7f71540a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f715c005fd0 tx=0x7f715c009710 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:05.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.373+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71640bcd60 con 0x7f716c10e450 2024-09-15T23:31:05.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.535+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f716c109640 con 0x7f71540a32d0 2024-09-15T23:31:05.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.542+0000 7f716b7fe640 1 -- 172.21.15.77:0/124279306 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340285 (secure 0 0 0) 0x7f715c009920 con 0x7f71540a32d0 2024-09-15T23:31:05.548 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:05.549 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 msgr2=0x7f71540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 0x7f71540a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f715c005fd0 tx=0x7f715c009710 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 msgr2=0x7f716c19ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7164005ab0 tx=0x7f71640040c0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 shutdown_connections 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a32d0 0x7f71540a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.546+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f716c10e450 0x7f716c19ef30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.547+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f716c074e30 0x7f716c19aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.547+0000 7f71746fc640 1 --2- 172.21.15.77:0/124279306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f716c074510 0x7f716c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.547+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 >> 172.21.15.77:0/124279306 conn(0x7f716c0fd8f0 msgr2=0x7f716c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.547+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 shutdown_connections 2024-09-15T23:31:05.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:05.547+0000 7f71746fc640 1 -- 172.21.15.77:0/124279306 wait complete. 2024-09-15T23:31:06.437 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2024-09-15T23:31:03.818612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655464,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":235,"num_read_kb":229,"num_write":268,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388348,"kb_used_data":14048,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553476,"statfs":{"total":1151940427776,"available":1151542759424,"internally_reserved":0,"allocated":14385152,"data_stored":8077514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003486"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989663+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989663+0000","last_peered":"2024-09-15T23:30:37.989663+0000","last_clean":"2024-09-15T23:30:37.989663+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989663+0000","last_undegraded":"2024-09-15T23:30:37.989663+0000","last_fullsized":"2024-09-15T23:30:37.989663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989550+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:30:37.989550+0000","last_peered":"2024-09-15T23:30:37.989550+0000","last_clean":"2024-09-15T23:30:37.989550+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:30:37.989550+0000","last_undegraded":"2024-09-15T23:30:37.989550+0000","last_fullsized":"2024-09-15T23:30:37.989550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175717+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175717+0000","last_peered":"2024-09-15T23:30:38.175717+0000","last_clean":"2024-09-15T23:30:38.175717+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175717+0000","last_undegraded":"2024-09-15T23:30:38.175717+0000","last_fullsized":"2024-09-15T23:30:38.175717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174682+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:30:38.174682+0000","last_peered":"2024-09-15T23:30:38.174682+0000","last_clean":"2024-09-15T23:30:38.174682+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:30:38.174682+0000","last_undegraded":"2024-09-15T23:30:38.174682+0000","last_fullsized":"2024-09-15T23:30:38.174682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176546+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:30:38.176546+0000","last_peered":"2024-09-15T23:30:38.176546+0000","last_clean":"2024-09-15T23:30:38.176546+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:30:38.176546+0000","last_undegraded":"2024-09-15T23:30:38.176546+0000","last_fullsized":"2024-09-15T23:30:38.176546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175617+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:30:38.175617+0000","last_peered":"2024-09-15T23:30:38.175617+0000","last_clean":"2024-09-15T23:30:38.175617+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:30:38.175617+0000","last_undegraded":"2024-09-15T23:30:38.175617+0000","last_fullsized":"2024-09-15T23:30:38.175617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175850+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:30:38.175850+0000","last_peered":"2024-09-15T23:30:38.175850+0000","last_clean":"2024-09-15T23:30:38.175850+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:30:38.175850+0000","last_undegraded":"2024-09-15T23:30:38.175850+0000","last_fullsized":"2024-09-15T23:30:38.175850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175368+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:30:38.175368+0000","last_peered":"2024-09-15T23:30:38.175368+0000","last_clean":"2024-09-15T23:30:38.175368+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:30:38.175368+0000","last_undegraded":"2024-09-15T23:30:38.175368+0000","last_fullsized":"2024-09-15T23:30:38.175368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996446+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996446+0000","last_peered":"2024-09-15T23:30:37.996446+0000","last_clean":"2024-09-15T23:30:37.996446+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996446+0000","last_undegraded":"2024-09-15T23:30:37.996446+0000","last_fullsized":"2024-09-15T23:30:37.996446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994295+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:30:37.994295+0000","last_peered":"2024-09-15T23:30:37.994295+0000","last_clean":"2024-09-15T23:30:37.994295+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:30:37.994295+0000","last_undegraded":"2024-09-15T23:30:37.994295+0000","last_fullsized":"2024-09-15T23:30:37.994295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175289+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175289+0000","last_peered":"2024-09-15T23:30:38.175289+0000","last_clean":"2024-09-15T23:30:38.175289+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175289+0000","last_undegraded":"2024-09-15T23:30:38.175289+0000","last_fullsized":"2024-09-15T23:30:38.175289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994666+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:30:37.994666+0000","last_peered":"2024-09-15T23:30:37.994666+0000","last_clean":"2024-09-15T23:30:37.994666+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:30:37.994666+0000","last_undegraded":"2024-09-15T23:30:37.994666+0000","last_fullsized":"2024-09-15T23:30:37.994666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177118+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177118+0000","last_peered":"2024-09-15T23:30:38.177118+0000","last_clean":"2024-09-15T23:30:38.177118+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177118+0000","last_undegraded":"2024-09-15T23:30:38.177118+0000","last_fullsized":"2024-09-15T23:30:38.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175098+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:30:38.175098+0000","last_peered":"2024-09-15T23:30:38.175098+0000","last_clean":"2024-09-15T23:30:38.175098+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:30:38.175098+0000","last_undegraded":"2024-09-15T23:30:38.175098+0000","last_fullsized":"2024-09-15T23:30:38.175098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990439+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990439+0000","last_peered":"2024-09-15T23:30:37.990439+0000","last_clean":"2024-09-15T23:30:37.990439+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990439+0000","last_undegraded":"2024-09-15T23:30:37.990439+0000","last_fullsized":"2024-09-15T23:30:37.990439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175619+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:30:38.175619+0000","last_peered":"2024-09-15T23:30:38.175619+0000","last_clean":"2024-09-15T23:30:38.175619+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:30:38.175619+0000","last_undegraded":"2024-09-15T23:30:38.175619+0000","last_fullsized":"2024-09-15T23:30:38.175619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989723+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:30:37.989723+0000","last_peered":"2024-09-15T23:30:37.989723+0000","last_clean":"2024-09-15T23:30:37.989723+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:30:37.989723+0000","last_undegraded":"2024-09-15T23:30:37.989723+0000","last_fullsized":"2024-09-15T23:30:37.989723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174513+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174513+0000","last_peered":"2024-09-15T23:30:38.174513+0000","last_clean":"2024-09-15T23:30:38.174513+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174513+0000","last_undegraded":"2024-09-15T23:30:38.174513+0000","last_fullsized":"2024-09-15T23:30:38.174513+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991854+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:30:37.991854+0000","last_peered":"2024-09-15T23:30:37.991854+0000","last_clean":"2024-09-15T23:30:37.991854+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:30:37.991854+0000","last_undegraded":"2024-09-15T23:30:37.991854+0000","last_fullsized":"2024-09-15T23:30:37.991854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995522+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995522+0000","last_peered":"2024-09-15T23:30:37.995522+0000","last_clean":"2024-09-15T23:30:37.995522+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995522+0000","last_undegraded":"2024-09-15T23:30:37.995522+0000","last_fullsized":"2024-09-15T23:30:37.995522+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994405+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994405+0000","last_peered":"2024-09-15T23:30:37.994405+0000","last_clean":"2024-09-15T23:30:37.994405+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994405+0000","last_undegraded":"2024-09-15T23:30:37.994405+0000","last_fullsized":"2024-09-15T23:30:37.994405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175377+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:30:38.175377+0000","last_peered":"2024-09-15T23:30:38.175377+0000","last_clean":"2024-09-15T23:30:38.175377+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:30:38.175377+0000","last_undegraded":"2024-09-15T23:30:38.175377+0000","last_fullsized":"2024-09-15T23:30:38.175377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989449+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989449+0000","last_peered":"2024-09-15T23:30:37.989449+0000","last_clean":"2024-09-15T23:30:37.989449+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989449+0000","last_undegraded":"2024-09-15T23:30:37.989449+0000","last_fullsized":"2024-09-15T23:30:37.989449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.178555+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.178555+0000","last_peered":"2024-09-15T23:30:38.178555+0000","last_clean":"2024-09-15T23:30:38.178555+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.178555+0000","last_undegraded":"2024-09-15T23:30:38.178555+0000","last_fullsized":"2024-09-15T23:30:38.178555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175986+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:30:38.175986+0000","last_peered":"2024-09-15T23:30:38.175986+0000","last_clean":"2024-09-15T23:30:38.175986+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:30:38.175986+0000","last_undegraded":"2024-09-15T23:30:38.175986+0000","last_fullsized":"2024-09-15T23:30:38.175986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176633+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176633+0000","last_peered":"2024-09-15T23:30:38.176633+0000","last_clean":"2024-09-15T23:30:38.176633+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176633+0000","last_undegraded":"2024-09-15T23:30:38.176633+0000","last_fullsized":"2024-09-15T23:30:38.176633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991692+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991692+0000","last_peered":"2024-09-15T23:30:37.991692+0000","last_clean":"2024-09-15T23:30:37.991692+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991692+0000","last_undegraded":"2024-09-15T23:30:37.991692+0000","last_fullsized":"2024-09-15T23:30:37.991692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175147+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:30:38.175147+0000","last_peered":"2024-09-15T23:30:38.175147+0000","last_clean":"2024-09-15T23:30:38.175147+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:30:38.175147+0000","last_undegraded":"2024-09-15T23:30:38.175147+0000","last_fullsized":"2024-09-15T23:30:38.175147+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991171+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991171+0000","last_peered":"2024-09-15T23:30:37.991171+0000","last_clean":"2024-09-15T23:30:37.991171+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991171+0000","last_undegraded":"2024-09-15T23:30:37.991171+0000","last_fullsized":"2024-09-15T23:30:37.991171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992005+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992005+0000","last_peered":"2024-09-15T23:30:37.992005+0000","last_clean":"2024-09-15T23:30:37.992005+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992005+0000","last_undegraded":"2024-09-15T23:30:37.992005+0000","last_fullsized":"2024-09-15T23:30:37.992005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991065+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:30:37.991065+0000","last_peered":"2024-09-15T23:30:37.991065+0000","last_clean":"2024-09-15T23:30:37.991065+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:30:37.991065+0000","last_undegraded":"2024-09-15T23:30:37.991065+0000","last_fullsized":"2024-09-15T23:30:37.991065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177309+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177309+0000","last_peered":"2024-09-15T23:30:38.177309+0000","last_clean":"2024-09-15T23:30:38.177309+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177309+0000","last_undegraded":"2024-09-15T23:30:38.177309+0000","last_fullsized":"2024-09-15T23:30:38.177309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989148+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:30:37.989148+0000","last_peered":"2024-09-15T23:30:37.989148+0000","last_clean":"2024-09-15T23:30:37.989148+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:30:37.989148+0000","last_undegraded":"2024-09-15T23:30:37.989148+0000","last_fullsized":"2024-09-15T23:30:37.989148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990210+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990210+0000","last_peered":"2024-09-15T23:30:37.990210+0000","last_clean":"2024-09-15T23:30:37.990210+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990210+0000","last_undegraded":"2024-09-15T23:30:37.990210+0000","last_fullsized":"2024-09-15T23:30:37.990210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176322+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176322+0000","last_peered":"2024-09-15T23:30:38.176322+0000","last_clean":"2024-09-15T23:30:38.176322+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176322+0000","last_undegraded":"2024-09-15T23:30:38.176322+0000","last_fullsized":"2024-09-15T23:30:38.176322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176626+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:30:38.176626+0000","last_peered":"2024-09-15T23:30:38.176626+0000","last_clean":"2024-09-15T23:30:38.176626+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:30:38.176626+0000","last_undegraded":"2024-09-15T23:30:38.176626+0000","last_fullsized":"2024-09-15T23:30:38.176626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996813+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996813+0000","last_peered":"2024-09-15T23:30:37.996813+0000","last_clean":"2024-09-15T23:30:37.996813+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996813+0000","last_undegraded":"2024-09-15T23:30:37.996813+0000","last_fullsized":"2024-09-15T23:30:37.996813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176838+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:30:38.176838+0000","last_peered":"2024-09-15T23:30:38.176838+0000","last_clean":"2024-09-15T23:30:38.176838+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:30:38.176838+0000","last_undegraded":"2024-09-15T23:30:38.176838+0000","last_fullsized":"2024-09-15T23:30:38.176838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175861+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175861+0000","last_peered":"2024-09-15T23:30:38.175861+0000","last_clean":"2024-09-15T23:30:38.175861+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175861+0000","last_undegraded":"2024-09-15T23:30:38.175861+0000","last_fullsized":"2024-09-15T23:30:38.175861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176144+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:30:38.176144+0000","last_peered":"2024-09-15T23:30:38.176144+0000","last_clean":"2024-09-15T23:30:38.176144+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:30:38.176144+0000","last_undegraded":"2024-09-15T23:30:38.176144+0000","last_fullsized":"2024-09-15T23:30:38.176144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991635+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991635+0000","last_peered":"2024-09-15T23:30:37.991635+0000","last_clean":"2024-09-15T23:30:37.991635+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991635+0000","last_undegraded":"2024-09-15T23:30:37.991635+0000","last_fullsized":"2024-09-15T23:30:37.991635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995151+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:30:37.995151+0000","last_peered":"2024-09-15T23:30:37.995151+0000","last_clean":"2024-09-15T23:30:37.995151+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:30:37.995151+0000","last_undegraded":"2024-09-15T23:30:37.995151+0000","last_fullsized":"2024-09-15T23:30:37.995151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997071+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997071+0000","last_peered":"2024-09-15T23:30:37.997071+0000","last_clean":"2024-09-15T23:30:37.997071+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997071+0000","last_undegraded":"2024-09-15T23:30:37.997071+0000","last_fullsized":"2024-09-15T23:30:37.997071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175993+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:30:38.175993+0000","last_peered":"2024-09-15T23:30:38.175993+0000","last_clean":"2024-09-15T23:30:38.175993+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:30:38.175993+0000","last_undegraded":"2024-09-15T23:30:38.175993+0000","last_fullsized":"2024-09-15T23:30:38.175993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175702+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:30:38.175702+0000","last_peered":"2024-09-15T23:30:38.175702+0000","last_clean":"2024-09-15T23:30:38.175702+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:30:38.175702+0000","last_undegraded":"2024-09-15T23:30:38.175702+0000","last_fullsized":"2024-09-15T23:30:38.175702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991368+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:30:37.991368+0000","last_peered":"2024-09-15T23:30:37.991368+0000","last_clean":"2024-09-15T23:30:37.991368+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:30:37.991368+0000","last_undegraded":"2024-09-15T23:30:37.991368+0000","last_fullsized":"2024-09-15T23:30:37.991368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995286+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:30:37.995286+0000","last_peered":"2024-09-15T23:30:37.995286+0000","last_clean":"2024-09-15T23:30:37.995286+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:30:37.995286+0000","last_undegraded":"2024-09-15T23:30:37.995286+0000","last_fullsized":"2024-09-15T23:30:37.995286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'31","reported_seq":168,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:57.979495+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:30:57.979495+0000","last_peered":"2024-09-15T23:30:57.979495+0000","last_clean":"2024-09-15T23:30:57.979495+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:30:57.979495+0000","last_undegraded":"2024-09-15T23:30:57.979495+0000","last_fullsized":"2024-09-15T23:30:57.979495+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64064,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":103,"num_read_kb":114,"num_write":31,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176668+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:30:38.176668+0000","last_peered":"2024-09-15T23:30:38.176668+0000","last_clean":"2024-09-15T23:30:38.176668+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:30:38.176668+0000","last_undegraded":"2024-09-15T23:30:38.176668+0000","last_fullsized":"2024-09-15T23:30:38.176668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174784+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:30:38.174784+0000","last_peered":"2024-09-15T23:30:38.174784+0000","last_clean":"2024-09-15T23:30:38.174784+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:30:38.174784+0000","last_undegraded":"2024-09-15T23:30:38.174784+0000","last_fullsized":"2024-09-15T23:30:38.174784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177128+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:30:38.177128+0000","last_peered":"2024-09-15T23:30:38.177128+0000","last_clean":"2024-09-15T23:30:38.177128+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:30:38.177128+0000","last_undegraded":"2024-09-15T23:30:38.177128+0000","last_fullsized":"2024-09-15T23:30:38.177128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174981+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.174981+0000","last_peered":"2024-09-15T23:30:38.174981+0000","last_clean":"2024-09-15T23:30:38.174981+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.174981+0000","last_undegraded":"2024-09-15T23:30:38.174981+0000","last_fullsized":"2024-09-15T23:30:38.174981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989111+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:30:37.989111+0000","last_peered":"2024-09-15T23:30:37.989111+0000","last_clean":"2024-09-15T23:30:37.989111+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:30:37.989111+0000","last_undegraded":"2024-09-15T23:30:37.989111+0000","last_fullsized":"2024-09-15T23:30:37.989111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176371+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.176371+0000","last_peered":"2024-09-15T23:30:38.176371+0000","last_clean":"2024-09-15T23:30:38.176371+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.176371+0000","last_undegraded":"2024-09-15T23:30:38.176371+0000","last_fullsized":"2024-09-15T23:30:38.176371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174788+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:30:38.174788+0000","last_peered":"2024-09-15T23:30:38.174788+0000","last_clean":"2024-09-15T23:30:38.174788+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:30:38.174788+0000","last_undegraded":"2024-09-15T23:30:38.174788+0000","last_fullsized":"2024-09-15T23:30:38.174788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175259+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:30:38.175259+0000","last_peered":"2024-09-15T23:30:38.175259+0000","last_clean":"2024-09-15T23:30:38.175259+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:30:38.175259+0000","last_undegraded":"2024-09-15T23:30:38.175259+0000","last_fullsized":"2024-09-15T23:30:38.175259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994801+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:30:37.994801+0000","last_peered":"2024-09-15T23:30:37.994801+0000","last_clean":"2024-09-15T23:30:37.994801+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:30:37.994801+0000","last_undegraded":"2024-09-15T23:30:37.994801+0000","last_fullsized":"2024-09-15T23:30:37.994801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994240+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:30:37.994240+0000","last_peered":"2024-09-15T23:30:37.994240+0000","last_clean":"2024-09-15T23:30:37.994240+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:30:37.994240+0000","last_undegraded":"2024-09-15T23:30:37.994240+0000","last_fullsized":"2024-09-15T23:30:37.994240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996385+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:30:37.996385+0000","last_peered":"2024-09-15T23:30:37.996385+0000","last_clean":"2024-09-15T23:30:37.996385+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:30:37.996385+0000","last_undegraded":"2024-09-15T23:30:37.996385+0000","last_fullsized":"2024-09-15T23:30:37.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996385+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:30:37.996385+0000","last_peered":"2024-09-15T23:30:37.996385+0000","last_clean":"2024-09-15T23:30:37.996385+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:30:37.996385+0000","last_undegraded":"2024-09-15T23:30:37.996385+0000","last_fullsized":"2024-09-15T23:30:37.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174905+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:30:38.174905+0000","last_peered":"2024-09-15T23:30:38.174905+0000","last_clean":"2024-09-15T23:30:38.174905+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:30:38.174905+0000","last_undegraded":"2024-09-15T23:30:38.174905+0000","last_fullsized":"2024-09-15T23:30:38.174905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991833+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:30:37.991833+0000","last_peered":"2024-09-15T23:30:37.991833+0000","last_clean":"2024-09-15T23:30:37.991833+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:30:37.991833+0000","last_undegraded":"2024-09-15T23:30:37.991833+0000","last_fullsized":"2024-09-15T23:30:37.991833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995032+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:30:37.995032+0000","last_peered":"2024-09-15T23:30:37.995032+0000","last_clean":"2024-09-15T23:30:37.995032+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:30:37.995032+0000","last_undegraded":"2024-09-15T23:30:37.995032+0000","last_fullsized":"2024-09-15T23:30:37.995032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996962+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:30:37.996962+0000","last_peered":"2024-09-15T23:30:37.996962+0000","last_clean":"2024-09-15T23:30:37.996962+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:30:37.996962+0000","last_undegraded":"2024-09-15T23:30:37.996962+0000","last_fullsized":"2024-09-15T23:30:37.996962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175576+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:30:38.175576+0000","last_peered":"2024-09-15T23:30:38.175576+0000","last_clean":"2024-09-15T23:30:38.175576+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:30:38.175576+0000","last_undegraded":"2024-09-15T23:30:38.175576+0000","last_fullsized":"2024-09-15T23:30:38.175576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175097+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:30:38.175097+0000","last_peered":"2024-09-15T23:30:38.175097+0000","last_clean":"2024-09-15T23:30:38.175097+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:30:38.175097+0000","last_undegraded":"2024-09-15T23:30:38.175097+0000","last_fullsized":"2024-09-15T23:30:38.175097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175195+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:30:38.175195+0000","last_peered":"2024-09-15T23:30:38.175195+0000","last_clean":"2024-09-15T23:30:38.175195+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:30:38.175195+0000","last_undegraded":"2024-09-15T23:30:38.175195+0000","last_fullsized":"2024-09-15T23:30:38.175195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177405+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:30:38.177405+0000","last_peered":"2024-09-15T23:30:38.177405+0000","last_clean":"2024-09-15T23:30:38.177405+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:30:38.177405+0000","last_undegraded":"2024-09-15T23:30:38.177405+0000","last_fullsized":"2024-09-15T23:30:38.177405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991585+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:30:37.991585+0000","last_peered":"2024-09-15T23:30:37.991585+0000","last_clean":"2024-09-15T23:30:37.991585+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:30:37.991585+0000","last_undegraded":"2024-09-15T23:30:37.991585+0000","last_fullsized":"2024-09-15T23:30:37.991585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994555+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:30:37.994555+0000","last_peered":"2024-09-15T23:30:37.994555+0000","last_clean":"2024-09-15T23:30:37.994555+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:30:37.994555+0000","last_undegraded":"2024-09-15T23:30:37.994555+0000","last_fullsized":"2024-09-15T23:30:37.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996896+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:30:37.996896+0000","last_peered":"2024-09-15T23:30:37.996896+0000","last_clean":"2024-09-15T23:30:37.996896+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:30:37.996896+0000","last_undegraded":"2024-09-15T23:30:37.996896+0000","last_fullsized":"2024-09-15T23:30:37.996896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989686+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:30:37.989686+0000","last_peered":"2024-09-15T23:30:37.989686+0000","last_clean":"2024-09-15T23:30:37.989686+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:30:37.989686+0000","last_undegraded":"2024-09-15T23:30:37.989686+0000","last_fullsized":"2024-09-15T23:30:37.989686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995581+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:30:37.995581+0000","last_peered":"2024-09-15T23:30:37.995581+0000","last_clean":"2024-09-15T23:30:37.995581+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:30:37.995581+0000","last_undegraded":"2024-09-15T23:30:37.995581+0000","last_fullsized":"2024-09-15T23:30:37.995581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176827+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:30:38.176827+0000","last_peered":"2024-09-15T23:30:38.176827+0000","last_clean":"2024-09-15T23:30:38.176827+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:30:38.176827+0000","last_undegraded":"2024-09-15T23:30:38.176827+0000","last_fullsized":"2024-09-15T23:30:38.176827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174459+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:30:38.174459+0000","last_peered":"2024-09-15T23:30:38.174459+0000","last_clean":"2024-09-15T23:30:38.174459+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:30:38.174459+0000","last_undegraded":"2024-09-15T23:30:38.174459+0000","last_fullsized":"2024-09-15T23:30:38.174459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174573+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:30:38.174573+0000","last_peered":"2024-09-15T23:30:38.174573+0000","last_clean":"2024-09-15T23:30:38.174573+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:30:38.174573+0000","last_undegraded":"2024-09-15T23:30:38.174573+0000","last_fullsized":"2024-09-15T23:30:38.174573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991488+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:30:37.991488+0000","last_peered":"2024-09-15T23:30:37.991488+0000","last_clean":"2024-09-15T23:30:37.991488+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:30:37.991488+0000","last_undegraded":"2024-09-15T23:30:37.991488+0000","last_fullsized":"2024-09-15T23:30:37.991488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989349+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:30:37.989349+0000","last_peered":"2024-09-15T23:30:37.989349+0000","last_clean":"2024-09-15T23:30:37.989349+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:30:37.989349+0000","last_undegraded":"2024-09-15T23:30:37.989349+0000","last_fullsized":"2024-09-15T23:30:37.989349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176514+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:30:38.176514+0000","last_peered":"2024-09-15T23:30:38.176514+0000","last_clean":"2024-09-15T23:30:38.176514+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:30:38.176514+0000","last_undegraded":"2024-09-15T23:30:38.176514+0000","last_fullsized":"2024-09-15T23:30:38.176514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175689+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:30:38.175689+0000","last_peered":"2024-09-15T23:30:38.175689+0000","last_clean":"2024-09-15T23:30:38.175689+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:30:38.175689+0000","last_undegraded":"2024-09-15T23:30:38.175689+0000","last_fullsized":"2024-09-15T23:30:38.175689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176688+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:30:38.176688+0000","last_peered":"2024-09-15T23:30:38.176688+0000","last_clean":"2024-09-15T23:30:38.176688+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:30:38.176688+0000","last_undegraded":"2024-09-15T23:30:38.176688+0000","last_fullsized":"2024-09-15T23:30:38.176688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174685+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:30:38.174685+0000","last_peered":"2024-09-15T23:30:38.174685+0000","last_clean":"2024-09-15T23:30:38.174685+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:30:38.174685+0000","last_undegraded":"2024-09-15T23:30:38.174685+0000","last_fullsized":"2024-09-15T23:30:38.174685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175607+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:30:38.175607+0000","last_peered":"2024-09-15T23:30:38.175607+0000","last_clean":"2024-09-15T23:30:38.175607+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:30:38.175607+0000","last_undegraded":"2024-09-15T23:30:38.175607+0000","last_fullsized":"2024-09-15T23:30:38.175607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175252+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:30:38.175252+0000","last_peered":"2024-09-15T23:30:38.175252+0000","last_clean":"2024-09-15T23:30:38.175252+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:30:38.175252+0000","last_undegraded":"2024-09-15T23:30:38.175252+0000","last_fullsized":"2024-09-15T23:30:38.175252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995052+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:30:37.995052+0000","last_peered":"2024-09-15T23:30:37.995052+0000","last_clean":"2024-09-15T23:30:37.995052+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:30:37.995052+0000","last_undegraded":"2024-09-15T23:30:37.995052+0000","last_fullsized":"2024-09-15T23:30:37.995052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990191+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:30:37.990191+0000","last_peered":"2024-09-15T23:30:37.990191+0000","last_clean":"2024-09-15T23:30:37.990191+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:30:37.990191+0000","last_undegraded":"2024-09-15T23:30:37.990191+0000","last_fullsized":"2024-09-15T23:30:37.990191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174849+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:30:38.174849+0000","last_peered":"2024-09-15T23:30:38.174849+0000","last_clean":"2024-09-15T23:30:38.174849+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:30:38.174849+0000","last_undegraded":"2024-09-15T23:30:38.174849+0000","last_fullsized":"2024-09-15T23:30:38.174849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174986+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:30:38.174986+0000","last_peered":"2024-09-15T23:30:38.174986+0000","last_clean":"2024-09-15T23:30:38.174986+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:30:38.174986+0000","last_undegraded":"2024-09-15T23:30:38.174986+0000","last_fullsized":"2024-09-15T23:30:38.174986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995485+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:30:37.995485+0000","last_peered":"2024-09-15T23:30:37.995485+0000","last_clean":"2024-09-15T23:30:37.995485+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:30:37.995485+0000","last_undegraded":"2024-09-15T23:30:37.995485+0000","last_fullsized":"2024-09-15T23:30:37.995485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64862,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":109,"num_read_kb":120,"num_write":85,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":194586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481824,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710756,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1703936,"data_stored":1161214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874282,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103216,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32784,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712368,"statfs":{"total":95995035648,"available":95961464832,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36948,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708204,"statfs":{"total":95995035648,"available":95957200896,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182473,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411406,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":570686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1097728,"data_stored":570652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:06.486 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:31:06.734 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:07.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:06 smithi077 ceph-mon[30968]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:06 smithi077 ceph-mon[30968]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:06 smithi159 ceph-mon[35472]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:06 smithi159 ceph-mon[35472]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.231+0000 7f0bef791640 1 -- 172.21.15.77:0/837537912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8106f10 msgr2=0x7f0be810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.231+0000 7f0bef791640 1 --2- 172.21.15.77:0/837537912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8106f10 0x7f0be810ea90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009ca0 tx=0x7f0be002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- 172.21.15.77:0/837537912 shutdown_connections 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- 172.21.15.77:0/837537912 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8106f10 0x7f0be810ea90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- 172.21.15.77:0/837537912 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8102790 0x7f0be81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- 172.21.15.77:0/837537912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8101de0 0x7f0be81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- 172.21.15.77:0/837537912 >> 172.21.15.77:0/837537912 conn(0x7f0be80fd8c0 msgr2=0x7f0be80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- 172.21.15.77:0/837537912 shutdown_connections 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- 172.21.15.77:0/837537912 wait complete. 2024-09-15T23:31:07.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 Processor -- start 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- start start 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 0x7f0be819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8106f10 0x7f0be819ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111f70 con 0x7f0be8101de0 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.232+0000 7f0bef791640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0be8111df0 con 0x7f0be8102790 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bef791640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0be81120f0 con 0x7f0be8106f10 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36560/0 (socket says 172.21.15.77:36560) 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 -- 172.21.15.77:0/3249648607 learned_addr learned my addr 172.21.15.77:0/3249648607 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bedd2e640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8106f10 0x7f0be819ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:07.240 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0becd2c640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 0x7f0be819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 -- 172.21.15.77:0/3249648607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8106f10 msgr2=0x7f0be819ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8106f10 0x7f0be819ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 -- 172.21.15.77:0/3249648607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 msgr2=0x7f0be819aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 0x7f0be819aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 -- 172.21.15.77:0/3249648607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0be819f500 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0becd2c640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 0x7f0be819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bed52d640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c920 tx=0x7f0be400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4007c70 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0be819f7f0 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0be4007e10 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0be4018890 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.233+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0be81a70d0 con 0x7f0be8101de0 2024-09-15T23:31:07.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.234+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0be81021c0 con 0x7f0be8101de0 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.236+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0be4018a50 con 0x7f0be8101de0 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.236+0000 7f0bde7fc640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 0x7f0bd40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.236+0000 7f0becd2c640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 0x7f0bd40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.236+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f0be40d02d0 con 0x7f0be8101de0 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.237+0000 7f0becd2c640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 0x7f0bd40a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd80094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:07.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.240+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0be4014030 con 0x7f0be8101de0 2024-09-15T23:31:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:06 smithi155 ceph-mon[35631]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:06 smithi155 ceph-mon[35631]: pgmap v336: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:07.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.424+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0be8075430 con 0x7f0bd40a32d0 2024-09-15T23:31:07.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.439+0000 7f0bde7fc640 1 -- 172.21.15.77:0/3249648607 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340285 (secure 0 0 0) 0x7f0be8075430 con 0x7f0bd40a32d0 2024-09-15T23:31:07.443 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:07.445 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 msgr2=0x7f0bd40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 0x7f0bd40a5790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bd8005fd0 tx=0x7f0bd80094d0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 msgr2=0x7f0be819a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0be400c920 tx=0x7f0be400cde0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 shutdown_connections 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0bd40a32d0 0x7f0bd40a5790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0be8106f10 0x7f0be819ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0be8102790 0x7f0be819aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 --2- 172.21.15.77:0/3249648607 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0be8101de0 0x7f0be819a550 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 >> 172.21.15.77:0/3249648607 conn(0x7f0be80fd8c0 msgr2=0x7f0be80ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:07.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 shutdown_connections 2024-09-15T23:31:07.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:07.443+0000 7f0bef791640 1 -- 172.21.15.77:0/3249648607 wait complete. 2024-09-15T23:31:08.181 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":336,"stamp":"2024-09-15T23:31:05.819110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655464,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":245,"num_read_kb":234,"num_write":268,"num_write_kb":3033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":210,"ondisk_log_size":210,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":388348,"kb_used_data":14048,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124553476,"statfs":{"total":1151940427776,"available":1151542759424,"internally_reserved":0,"allocated":14385152,"data_stored":8077514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":382973243},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003325"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989663+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989663+0000","last_peered":"2024-09-15T23:30:37.989663+0000","last_clean":"2024-09-15T23:30:37.989663+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989663+0000","last_undegraded":"2024-09-15T23:30:37.989663+0000","last_fullsized":"2024-09-15T23:30:37.989663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989550+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:30:37.989550+0000","last_peered":"2024-09-15T23:30:37.989550+0000","last_clean":"2024-09-15T23:30:37.989550+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:30:37.989550+0000","last_undegraded":"2024-09-15T23:30:37.989550+0000","last_fullsized":"2024-09-15T23:30:37.989550+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175717+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175717+0000","last_peered":"2024-09-15T23:30:38.175717+0000","last_clean":"2024-09-15T23:30:38.175717+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175717+0000","last_undegraded":"2024-09-15T23:30:38.175717+0000","last_fullsized":"2024-09-15T23:30:38.175717+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174682+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:30:38.174682+0000","last_peered":"2024-09-15T23:30:38.174682+0000","last_clean":"2024-09-15T23:30:38.174682+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:30:38.174682+0000","last_undegraded":"2024-09-15T23:30:38.174682+0000","last_fullsized":"2024-09-15T23:30:38.174682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176546+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:30:38.176546+0000","last_peered":"2024-09-15T23:30:38.176546+0000","last_clean":"2024-09-15T23:30:38.176546+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:30:38.176546+0000","last_undegraded":"2024-09-15T23:30:38.176546+0000","last_fullsized":"2024-09-15T23:30:38.176546+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175617+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:30:38.175617+0000","last_peered":"2024-09-15T23:30:38.175617+0000","last_clean":"2024-09-15T23:30:38.175617+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:30:38.175617+0000","last_undegraded":"2024-09-15T23:30:38.175617+0000","last_fullsized":"2024-09-15T23:30:38.175617+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175850+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:30:38.175850+0000","last_peered":"2024-09-15T23:30:38.175850+0000","last_clean":"2024-09-15T23:30:38.175850+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:30:38.175850+0000","last_undegraded":"2024-09-15T23:30:38.175850+0000","last_fullsized":"2024-09-15T23:30:38.175850+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175368+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:30:38.175368+0000","last_peered":"2024-09-15T23:30:38.175368+0000","last_clean":"2024-09-15T23:30:38.175368+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:30:38.175368+0000","last_undegraded":"2024-09-15T23:30:38.175368+0000","last_fullsized":"2024-09-15T23:30:38.175368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996446+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996446+0000","last_peered":"2024-09-15T23:30:37.996446+0000","last_clean":"2024-09-15T23:30:37.996446+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996446+0000","last_undegraded":"2024-09-15T23:30:37.996446+0000","last_fullsized":"2024-09-15T23:30:37.996446+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994295+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:30:37.994295+0000","last_peered":"2024-09-15T23:30:37.994295+0000","last_clean":"2024-09-15T23:30:37.994295+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:30:37.994295+0000","last_undegraded":"2024-09-15T23:30:37.994295+0000","last_fullsized":"2024-09-15T23:30:37.994295+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175289+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175289+0000","last_peered":"2024-09-15T23:30:38.175289+0000","last_clean":"2024-09-15T23:30:38.175289+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175289+0000","last_undegraded":"2024-09-15T23:30:38.175289+0000","last_fullsized":"2024-09-15T23:30:38.175289+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994666+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:30:37.994666+0000","last_peered":"2024-09-15T23:30:37.994666+0000","last_clean":"2024-09-15T23:30:37.994666+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:30:37.994666+0000","last_undegraded":"2024-09-15T23:30:37.994666+0000","last_fullsized":"2024-09-15T23:30:37.994666+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177118+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177118+0000","last_peered":"2024-09-15T23:30:38.177118+0000","last_clean":"2024-09-15T23:30:38.177118+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177118+0000","last_undegraded":"2024-09-15T23:30:38.177118+0000","last_fullsized":"2024-09-15T23:30:38.177118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175098+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:30:38.175098+0000","last_peered":"2024-09-15T23:30:38.175098+0000","last_clean":"2024-09-15T23:30:38.175098+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:30:38.175098+0000","last_undegraded":"2024-09-15T23:30:38.175098+0000","last_fullsized":"2024-09-15T23:30:38.175098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990439+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990439+0000","last_peered":"2024-09-15T23:30:37.990439+0000","last_clean":"2024-09-15T23:30:37.990439+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990439+0000","last_undegraded":"2024-09-15T23:30:37.990439+0000","last_fullsized":"2024-09-15T23:30:37.990439+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175619+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:30:38.175619+0000","last_peered":"2024-09-15T23:30:38.175619+0000","last_clean":"2024-09-15T23:30:38.175619+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:30:38.175619+0000","last_undegraded":"2024-09-15T23:30:38.175619+0000","last_fullsized":"2024-09-15T23:30:38.175619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989723+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:30:37.989723+0000","last_peered":"2024-09-15T23:30:37.989723+0000","last_clean":"2024-09-15T23:30:37.989723+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:30:37.989723+0000","last_undegraded":"2024-09-15T23:30:37.989723+0000","last_fullsized":"2024-09-15T23:30:37.989723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174513+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174513+0000","last_peered":"2024-09-15T23:30:38.174513+0000","last_clean":"2024-09-15T23:30:38.174513+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174513+0000","last_undegraded":"2024-09-15T23:30:38.174513+0000","last_fullsized":"2024-09-15T23:30:38.174513+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991854+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:30:37.991854+0000","last_peered":"2024-09-15T23:30:37.991854+0000","last_clean":"2024-09-15T23:30:37.991854+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:30:37.991854+0000","last_undegraded":"2024-09-15T23:30:37.991854+0000","last_fullsized":"2024-09-15T23:30:37.991854+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995522+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995522+0000","last_peered":"2024-09-15T23:30:37.995522+0000","last_clean":"2024-09-15T23:30:37.995522+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995522+0000","last_undegraded":"2024-09-15T23:30:37.995522+0000","last_fullsized":"2024-09-15T23:30:37.995522+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994405+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994405+0000","last_peered":"2024-09-15T23:30:37.994405+0000","last_clean":"2024-09-15T23:30:37.994405+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994405+0000","last_undegraded":"2024-09-15T23:30:37.994405+0000","last_fullsized":"2024-09-15T23:30:37.994405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175377+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:30:38.175377+0000","last_peered":"2024-09-15T23:30:38.175377+0000","last_clean":"2024-09-15T23:30:38.175377+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:30:38.175377+0000","last_undegraded":"2024-09-15T23:30:38.175377+0000","last_fullsized":"2024-09-15T23:30:38.175377+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989449+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989449+0000","last_peered":"2024-09-15T23:30:37.989449+0000","last_clean":"2024-09-15T23:30:37.989449+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989449+0000","last_undegraded":"2024-09-15T23:30:37.989449+0000","last_fullsized":"2024-09-15T23:30:37.989449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.178555+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.178555+0000","last_peered":"2024-09-15T23:30:38.178555+0000","last_clean":"2024-09-15T23:30:38.178555+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.178555+0000","last_undegraded":"2024-09-15T23:30:38.178555+0000","last_fullsized":"2024-09-15T23:30:38.178555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175986+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:30:38.175986+0000","last_peered":"2024-09-15T23:30:38.175986+0000","last_clean":"2024-09-15T23:30:38.175986+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:30:38.175986+0000","last_undegraded":"2024-09-15T23:30:38.175986+0000","last_fullsized":"2024-09-15T23:30:38.175986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176633+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176633+0000","last_peered":"2024-09-15T23:30:38.176633+0000","last_clean":"2024-09-15T23:30:38.176633+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176633+0000","last_undegraded":"2024-09-15T23:30:38.176633+0000","last_fullsized":"2024-09-15T23:30:38.176633+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991692+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991692+0000","last_peered":"2024-09-15T23:30:37.991692+0000","last_clean":"2024-09-15T23:30:37.991692+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991692+0000","last_undegraded":"2024-09-15T23:30:37.991692+0000","last_fullsized":"2024-09-15T23:30:37.991692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175147+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:30:38.175147+0000","last_peered":"2024-09-15T23:30:38.175147+0000","last_clean":"2024-09-15T23:30:38.175147+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:30:38.175147+0000","last_undegraded":"2024-09-15T23:30:38.175147+0000","last_fullsized":"2024-09-15T23:30:38.175147+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991171+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991171+0000","last_peered":"2024-09-15T23:30:37.991171+0000","last_clean":"2024-09-15T23:30:37.991171+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991171+0000","last_undegraded":"2024-09-15T23:30:37.991171+0000","last_fullsized":"2024-09-15T23:30:37.991171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992005+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992005+0000","last_peered":"2024-09-15T23:30:37.992005+0000","last_clean":"2024-09-15T23:30:37.992005+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992005+0000","last_undegraded":"2024-09-15T23:30:37.992005+0000","last_fullsized":"2024-09-15T23:30:37.992005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991065+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:30:37.991065+0000","last_peered":"2024-09-15T23:30:37.991065+0000","last_clean":"2024-09-15T23:30:37.991065+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:30:37.991065+0000","last_undegraded":"2024-09-15T23:30:37.991065+0000","last_fullsized":"2024-09-15T23:30:37.991065+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177309+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177309+0000","last_peered":"2024-09-15T23:30:38.177309+0000","last_clean":"2024-09-15T23:30:38.177309+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177309+0000","last_undegraded":"2024-09-15T23:30:38.177309+0000","last_fullsized":"2024-09-15T23:30:38.177309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989148+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:30:37.989148+0000","last_peered":"2024-09-15T23:30:37.989148+0000","last_clean":"2024-09-15T23:30:37.989148+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:30:37.989148+0000","last_undegraded":"2024-09-15T23:30:37.989148+0000","last_fullsized":"2024-09-15T23:30:37.989148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990210+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990210+0000","last_peered":"2024-09-15T23:30:37.990210+0000","last_clean":"2024-09-15T23:30:37.990210+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990210+0000","last_undegraded":"2024-09-15T23:30:37.990210+0000","last_fullsized":"2024-09-15T23:30:37.990210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176322+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176322+0000","last_peered":"2024-09-15T23:30:38.176322+0000","last_clean":"2024-09-15T23:30:38.176322+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176322+0000","last_undegraded":"2024-09-15T23:30:38.176322+0000","last_fullsized":"2024-09-15T23:30:38.176322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176626+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:30:38.176626+0000","last_peered":"2024-09-15T23:30:38.176626+0000","last_clean":"2024-09-15T23:30:38.176626+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:30:38.176626+0000","last_undegraded":"2024-09-15T23:30:38.176626+0000","last_fullsized":"2024-09-15T23:30:38.176626+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996813+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996813+0000","last_peered":"2024-09-15T23:30:37.996813+0000","last_clean":"2024-09-15T23:30:37.996813+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996813+0000","last_undegraded":"2024-09-15T23:30:37.996813+0000","last_fullsized":"2024-09-15T23:30:37.996813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176838+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:30:38.176838+0000","last_peered":"2024-09-15T23:30:38.176838+0000","last_clean":"2024-09-15T23:30:38.176838+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:30:38.176838+0000","last_undegraded":"2024-09-15T23:30:38.176838+0000","last_fullsized":"2024-09-15T23:30:38.176838+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175861+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175861+0000","last_peered":"2024-09-15T23:30:38.175861+0000","last_clean":"2024-09-15T23:30:38.175861+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175861+0000","last_undegraded":"2024-09-15T23:30:38.175861+0000","last_fullsized":"2024-09-15T23:30:38.175861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176144+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:30:38.176144+0000","last_peered":"2024-09-15T23:30:38.176144+0000","last_clean":"2024-09-15T23:30:38.176144+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:30:38.176144+0000","last_undegraded":"2024-09-15T23:30:38.176144+0000","last_fullsized":"2024-09-15T23:30:38.176144+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991635+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991635+0000","last_peered":"2024-09-15T23:30:37.991635+0000","last_clean":"2024-09-15T23:30:37.991635+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991635+0000","last_undegraded":"2024-09-15T23:30:37.991635+0000","last_fullsized":"2024-09-15T23:30:37.991635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995151+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:30:37.995151+0000","last_peered":"2024-09-15T23:30:37.995151+0000","last_clean":"2024-09-15T23:30:37.995151+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:30:37.995151+0000","last_undegraded":"2024-09-15T23:30:37.995151+0000","last_fullsized":"2024-09-15T23:30:37.995151+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997071+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997071+0000","last_peered":"2024-09-15T23:30:37.997071+0000","last_clean":"2024-09-15T23:30:37.997071+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997071+0000","last_undegraded":"2024-09-15T23:30:37.997071+0000","last_fullsized":"2024-09-15T23:30:37.997071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175993+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:30:38.175993+0000","last_peered":"2024-09-15T23:30:38.175993+0000","last_clean":"2024-09-15T23:30:38.175993+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:30:38.175993+0000","last_undegraded":"2024-09-15T23:30:38.175993+0000","last_fullsized":"2024-09-15T23:30:38.175993+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175702+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:30:38.175702+0000","last_peered":"2024-09-15T23:30:38.175702+0000","last_clean":"2024-09-15T23:30:38.175702+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:30:38.175702+0000","last_undegraded":"2024-09-15T23:30:38.175702+0000","last_fullsized":"2024-09-15T23:30:38.175702+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991368+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:30:37.991368+0000","last_peered":"2024-09-15T23:30:37.991368+0000","last_clean":"2024-09-15T23:30:37.991368+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:30:37.991368+0000","last_undegraded":"2024-09-15T23:30:37.991368+0000","last_fullsized":"2024-09-15T23:30:37.991368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995286+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:30:37.995286+0000","last_peered":"2024-09-15T23:30:37.995286+0000","last_clean":"2024-09-15T23:30:37.995286+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:30:37.995286+0000","last_undegraded":"2024-09-15T23:30:37.995286+0000","last_fullsized":"2024-09-15T23:30:37.995286+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'31","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:02.986944+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:02.986944+0000","last_peered":"2024-09-15T23:31:02.986944+0000","last_clean":"2024-09-15T23:31:02.986944+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:02.986944+0000","last_undegraded":"2024-09-15T23:31:02.986944+0000","last_fullsized":"2024-09-15T23:31:02.986944+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64064,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":113,"num_read_kb":119,"num_write":31,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176668+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:30:38.176668+0000","last_peered":"2024-09-15T23:30:38.176668+0000","last_clean":"2024-09-15T23:30:38.176668+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:30:38.176668+0000","last_undegraded":"2024-09-15T23:30:38.176668+0000","last_fullsized":"2024-09-15T23:30:38.176668+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174784+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:30:38.174784+0000","last_peered":"2024-09-15T23:30:38.174784+0000","last_clean":"2024-09-15T23:30:38.174784+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:30:38.174784+0000","last_undegraded":"2024-09-15T23:30:38.174784+0000","last_fullsized":"2024-09-15T23:30:38.174784+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177128+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:30:38.177128+0000","last_peered":"2024-09-15T23:30:38.177128+0000","last_clean":"2024-09-15T23:30:38.177128+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:30:38.177128+0000","last_undegraded":"2024-09-15T23:30:38.177128+0000","last_fullsized":"2024-09-15T23:30:38.177128+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174981+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.174981+0000","last_peered":"2024-09-15T23:30:38.174981+0000","last_clean":"2024-09-15T23:30:38.174981+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.174981+0000","last_undegraded":"2024-09-15T23:30:38.174981+0000","last_fullsized":"2024-09-15T23:30:38.174981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989111+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:30:37.989111+0000","last_peered":"2024-09-15T23:30:37.989111+0000","last_clean":"2024-09-15T23:30:37.989111+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:30:37.989111+0000","last_undegraded":"2024-09-15T23:30:37.989111+0000","last_fullsized":"2024-09-15T23:30:37.989111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176371+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.176371+0000","last_peered":"2024-09-15T23:30:38.176371+0000","last_clean":"2024-09-15T23:30:38.176371+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.176371+0000","last_undegraded":"2024-09-15T23:30:38.176371+0000","last_fullsized":"2024-09-15T23:30:38.176371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174788+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:30:38.174788+0000","last_peered":"2024-09-15T23:30:38.174788+0000","last_clean":"2024-09-15T23:30:38.174788+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:30:38.174788+0000","last_undegraded":"2024-09-15T23:30:38.174788+0000","last_fullsized":"2024-09-15T23:30:38.174788+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175259+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:30:38.175259+0000","last_peered":"2024-09-15T23:30:38.175259+0000","last_clean":"2024-09-15T23:30:38.175259+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:30:38.175259+0000","last_undegraded":"2024-09-15T23:30:38.175259+0000","last_fullsized":"2024-09-15T23:30:38.175259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994801+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:30:37.994801+0000","last_peered":"2024-09-15T23:30:37.994801+0000","last_clean":"2024-09-15T23:30:37.994801+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:30:37.994801+0000","last_undegraded":"2024-09-15T23:30:37.994801+0000","last_fullsized":"2024-09-15T23:30:37.994801+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994240+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:30:37.994240+0000","last_peered":"2024-09-15T23:30:37.994240+0000","last_clean":"2024-09-15T23:30:37.994240+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:30:37.994240+0000","last_undegraded":"2024-09-15T23:30:37.994240+0000","last_fullsized":"2024-09-15T23:30:37.994240+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996385+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:30:37.996385+0000","last_peered":"2024-09-15T23:30:37.996385+0000","last_clean":"2024-09-15T23:30:37.996385+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:30:37.996385+0000","last_undegraded":"2024-09-15T23:30:37.996385+0000","last_fullsized":"2024-09-15T23:30:37.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996385+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:30:37.996385+0000","last_peered":"2024-09-15T23:30:37.996385+0000","last_clean":"2024-09-15T23:30:37.996385+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:30:37.996385+0000","last_undegraded":"2024-09-15T23:30:37.996385+0000","last_fullsized":"2024-09-15T23:30:37.996385+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174905+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:30:38.174905+0000","last_peered":"2024-09-15T23:30:38.174905+0000","last_clean":"2024-09-15T23:30:38.174905+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:30:38.174905+0000","last_undegraded":"2024-09-15T23:30:38.174905+0000","last_fullsized":"2024-09-15T23:30:38.174905+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991833+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:30:37.991833+0000","last_peered":"2024-09-15T23:30:37.991833+0000","last_clean":"2024-09-15T23:30:37.991833+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:30:37.991833+0000","last_undegraded":"2024-09-15T23:30:37.991833+0000","last_fullsized":"2024-09-15T23:30:37.991833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995032+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:30:37.995032+0000","last_peered":"2024-09-15T23:30:37.995032+0000","last_clean":"2024-09-15T23:30:37.995032+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:30:37.995032+0000","last_undegraded":"2024-09-15T23:30:37.995032+0000","last_fullsized":"2024-09-15T23:30:37.995032+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996962+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:30:37.996962+0000","last_peered":"2024-09-15T23:30:37.996962+0000","last_clean":"2024-09-15T23:30:37.996962+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:30:37.996962+0000","last_undegraded":"2024-09-15T23:30:37.996962+0000","last_fullsized":"2024-09-15T23:30:37.996962+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175576+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:30:38.175576+0000","last_peered":"2024-09-15T23:30:38.175576+0000","last_clean":"2024-09-15T23:30:38.175576+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:30:38.175576+0000","last_undegraded":"2024-09-15T23:30:38.175576+0000","last_fullsized":"2024-09-15T23:30:38.175576+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175097+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:30:38.175097+0000","last_peered":"2024-09-15T23:30:38.175097+0000","last_clean":"2024-09-15T23:30:38.175097+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:30:38.175097+0000","last_undegraded":"2024-09-15T23:30:38.175097+0000","last_fullsized":"2024-09-15T23:30:38.175097+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175195+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:30:38.175195+0000","last_peered":"2024-09-15T23:30:38.175195+0000","last_clean":"2024-09-15T23:30:38.175195+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:30:38.175195+0000","last_undegraded":"2024-09-15T23:30:38.175195+0000","last_fullsized":"2024-09-15T23:30:38.175195+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177405+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:30:38.177405+0000","last_peered":"2024-09-15T23:30:38.177405+0000","last_clean":"2024-09-15T23:30:38.177405+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:30:38.177405+0000","last_undegraded":"2024-09-15T23:30:38.177405+0000","last_fullsized":"2024-09-15T23:30:38.177405+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991585+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:30:37.991585+0000","last_peered":"2024-09-15T23:30:37.991585+0000","last_clean":"2024-09-15T23:30:37.991585+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:30:37.991585+0000","last_undegraded":"2024-09-15T23:30:37.991585+0000","last_fullsized":"2024-09-15T23:30:37.991585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994555+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:30:37.994555+0000","last_peered":"2024-09-15T23:30:37.994555+0000","last_clean":"2024-09-15T23:30:37.994555+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:30:37.994555+0000","last_undegraded":"2024-09-15T23:30:37.994555+0000","last_fullsized":"2024-09-15T23:30:37.994555+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996896+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:30:37.996896+0000","last_peered":"2024-09-15T23:30:37.996896+0000","last_clean":"2024-09-15T23:30:37.996896+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:30:37.996896+0000","last_undegraded":"2024-09-15T23:30:37.996896+0000","last_fullsized":"2024-09-15T23:30:37.996896+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989686+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:30:37.989686+0000","last_peered":"2024-09-15T23:30:37.989686+0000","last_clean":"2024-09-15T23:30:37.989686+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:30:37.989686+0000","last_undegraded":"2024-09-15T23:30:37.989686+0000","last_fullsized":"2024-09-15T23:30:37.989686+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995581+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:30:37.995581+0000","last_peered":"2024-09-15T23:30:37.995581+0000","last_clean":"2024-09-15T23:30:37.995581+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:30:37.995581+0000","last_undegraded":"2024-09-15T23:30:37.995581+0000","last_fullsized":"2024-09-15T23:30:37.995581+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176827+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:30:38.176827+0000","last_peered":"2024-09-15T23:30:38.176827+0000","last_clean":"2024-09-15T23:30:38.176827+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:30:38.176827+0000","last_undegraded":"2024-09-15T23:30:38.176827+0000","last_fullsized":"2024-09-15T23:30:38.176827+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174459+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:30:38.174459+0000","last_peered":"2024-09-15T23:30:38.174459+0000","last_clean":"2024-09-15T23:30:38.174459+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:30:38.174459+0000","last_undegraded":"2024-09-15T23:30:38.174459+0000","last_fullsized":"2024-09-15T23:30:38.174459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174573+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:30:38.174573+0000","last_peered":"2024-09-15T23:30:38.174573+0000","last_clean":"2024-09-15T23:30:38.174573+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:30:38.174573+0000","last_undegraded":"2024-09-15T23:30:38.174573+0000","last_fullsized":"2024-09-15T23:30:38.174573+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991488+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:30:37.991488+0000","last_peered":"2024-09-15T23:30:37.991488+0000","last_clean":"2024-09-15T23:30:37.991488+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:30:37.991488+0000","last_undegraded":"2024-09-15T23:30:37.991488+0000","last_fullsized":"2024-09-15T23:30:37.991488+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989349+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:30:37.989349+0000","last_peered":"2024-09-15T23:30:37.989349+0000","last_clean":"2024-09-15T23:30:37.989349+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:30:37.989349+0000","last_undegraded":"2024-09-15T23:30:37.989349+0000","last_fullsized":"2024-09-15T23:30:37.989349+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176514+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:30:38.176514+0000","last_peered":"2024-09-15T23:30:38.176514+0000","last_clean":"2024-09-15T23:30:38.176514+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:30:38.176514+0000","last_undegraded":"2024-09-15T23:30:38.176514+0000","last_fullsized":"2024-09-15T23:30:38.176514+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175689+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:30:38.175689+0000","last_peered":"2024-09-15T23:30:38.175689+0000","last_clean":"2024-09-15T23:30:38.175689+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:30:38.175689+0000","last_undegraded":"2024-09-15T23:30:38.175689+0000","last_fullsized":"2024-09-15T23:30:38.175689+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176688+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:30:38.176688+0000","last_peered":"2024-09-15T23:30:38.176688+0000","last_clean":"2024-09-15T23:30:38.176688+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:30:38.176688+0000","last_undegraded":"2024-09-15T23:30:38.176688+0000","last_fullsized":"2024-09-15T23:30:38.176688+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174685+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:30:38.174685+0000","last_peered":"2024-09-15T23:30:38.174685+0000","last_clean":"2024-09-15T23:30:38.174685+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:30:38.174685+0000","last_undegraded":"2024-09-15T23:30:38.174685+0000","last_fullsized":"2024-09-15T23:30:38.174685+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175607+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:30:38.175607+0000","last_peered":"2024-09-15T23:30:38.175607+0000","last_clean":"2024-09-15T23:30:38.175607+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:30:38.175607+0000","last_undegraded":"2024-09-15T23:30:38.175607+0000","last_fullsized":"2024-09-15T23:30:38.175607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175252+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:30:38.175252+0000","last_peered":"2024-09-15T23:30:38.175252+0000","last_clean":"2024-09-15T23:30:38.175252+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:30:38.175252+0000","last_undegraded":"2024-09-15T23:30:38.175252+0000","last_fullsized":"2024-09-15T23:30:38.175252+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995052+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:30:37.995052+0000","last_peered":"2024-09-15T23:30:37.995052+0000","last_clean":"2024-09-15T23:30:37.995052+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:30:37.995052+0000","last_undegraded":"2024-09-15T23:30:37.995052+0000","last_fullsized":"2024-09-15T23:30:37.995052+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990191+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:30:37.990191+0000","last_peered":"2024-09-15T23:30:37.990191+0000","last_clean":"2024-09-15T23:30:37.990191+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:30:37.990191+0000","last_undegraded":"2024-09-15T23:30:37.990191+0000","last_fullsized":"2024-09-15T23:30:37.990191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174849+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:30:38.174849+0000","last_peered":"2024-09-15T23:30:38.174849+0000","last_clean":"2024-09-15T23:30:38.174849+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:30:38.174849+0000","last_undegraded":"2024-09-15T23:30:38.174849+0000","last_fullsized":"2024-09-15T23:30:38.174849+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174986+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:30:38.174986+0000","last_peered":"2024-09-15T23:30:38.174986+0000","last_clean":"2024-09-15T23:30:38.174986+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:30:38.174986+0000","last_undegraded":"2024-09-15T23:30:38.174986+0000","last_fullsized":"2024-09-15T23:30:38.174986+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995485+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:30:37.995485+0000","last_peered":"2024-09-15T23:30:37.995485+0000","last_clean":"2024-09-15T23:30:37.995485+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:30:37.995485+0000","last_undegraded":"2024-09-15T23:30:37.995485+0000","last_fullsized":"2024-09-15T23:30:37.995485+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":64862,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":119,"num_read_kb":125,"num_write":85,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":194586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71,"ondisk_log_size":71,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481825,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712956,"statfs":{"total":95995035648,"available":95962066944,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710757,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28696,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716456,"statfs":{"total":95995035648,"available":95965650944,"internally_reserved":0,"allocated":1703936,"data_stored":1161214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874283,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28044,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717108,"statfs":{"total":95995035648,"available":95966318592,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103216,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32784,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712368,"statfs":{"total":95995035648,"available":95961464832,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561081,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790015,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36948,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708204,"statfs":{"total":95995035648,"available":95957200896,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953540,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32200,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712952,"statfs":{"total":95995035648,"available":95962062848,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":570686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1097728,"data_stored":570652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:08.186 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T23:31:08.187 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T23:31:08.187 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-15T23:31:08.187 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-15T23:31:08.433 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:08.941 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 -- 172.21.15.77:0/2918311562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8103780 msgr2=0x7fa4b8107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/2918311562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8103780 0x7fa4b8107bc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0009930 tx=0x7fa4a002a420 comp rx=0 tx=0).stop 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 -- 172.21.15.77:0/2918311562 shutdown_connections 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/2918311562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4b8108300 0x7fa4b810ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/2918311562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8103780 0x7fa4b8107bc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/2918311562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 -- 172.21.15.77:0/2918311562 >> 172.21.15.77:0/2918311562 conn(0x7fa4b80fc7d0 msgr2=0x7fa4b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 -- 172.21.15.77:0/2918311562 shutdown_connections 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.909+0000 7fa4bd47b640 1 -- 172.21.15.77:0/2918311562 wait complete. 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 Processor -- start 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 -- start start 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 0x7fa4b8198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:08.942 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4b8108300 0x7fa4b819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8112070 con 0x7fa4b8102dd0 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b8111ef0 con 0x7fa4b8103780 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4bd47b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b81121f0 con 0x7fa4b8108300 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36570/0 (socket says 172.21.15.77:36570) 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 -- 172.21.15.77:0/1677750443 learned_addr learned my addr 172.21.15.77:0/1677750443 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4affff640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 0x7fa4b8198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 -- 172.21.15.77:0/1677750443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4b8108300 msgr2=0x7fa4b819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4b8108300 0x7fa4b819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 -- 172.21.15.77:0/1677750443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 msgr2=0x7fa4b8198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 0x7fa4b8198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 -- 172.21.15.77:0/1677750443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b819d5a0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.943 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4affff640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 0x7fa4b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b6ffd640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c890 tx=0x7fa4a800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.910+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a8004220 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.911+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4a80043c0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.911+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b819d890 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.911+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a80049e0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.911+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b81a5170 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.912+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b81031b0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.913+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa4a80079b0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.913+0000 7fa4b4ff9640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 0x7fa4a40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.913+0000 7fa4affff640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 0x7fa4a40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:08.944 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.914+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa4a80cfef0 con 0x7fa4b8102dd0 2024-09-15T23:31:08.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.914+0000 7fa4affff640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 0x7fa4a40a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4a002a940 tx=0x7fa4a0032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:08.945 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:08.916+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa4a80ff1b0 con 0x7fa4b8102dd0 2024-09-15T23:31:09.122 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.121+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa4b8199950 con 0x7fa4b8102dd0 2024-09-15T23:31:09.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:08 smithi077 ceph-mon[30968]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:09.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:08 smithi077 ceph-mon[30968]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:09.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.121+0000 7fa4b4ff9640 1 -- 172.21.15.77:0/1677750443 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fa4a8014030 con 0x7fa4b8102dd0 2024-09-15T23:31:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:09.123 INFO:teuthology.orchestra.run.smithi077.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T23:31:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 msgr2=0x7fa4a40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:09.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 0x7fa4a40a5810 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa4a002a940 tx=0x7fa4a0032c70 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 msgr2=0x7fa4b81985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fa4a800c890 tx=0x7fa4a800cd50 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 shutdown_connections 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa4a40a3350 0x7fa4a40a5810 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4b8108300 0x7fa4b819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa4b8103780 0x7fa4b8198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 --2- 172.21.15.77:0/1677750443 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa4b8102dd0 0x7fa4b81985f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 >> 172.21.15.77:0/1677750443 conn(0x7fa4b80fc7d0 msgr2=0x7fa4b8105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 shutdown_connections 2024-09-15T23:31:09.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:09.123+0000 7fa4bd47b640 1 -- 172.21.15.77:0/1677750443 wait complete. 2024-09-15T23:31:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:08 smithi159 ceph-mon[35472]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:08 smithi159 ceph-mon[35472]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:09.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:08 smithi155 ceph-mon[35631]: from='client.15003 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:09.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:08 smithi155 ceph-mon[35631]: pgmap v337: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:09.840 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-15T23:31:09.840 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:10.088 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:10.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:09 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1677750443' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:31:10.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1677750443' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:31:10.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:09 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1677750443' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- 172.21.15.77:0/2891816532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810100e20 msgr2=0x7f1810101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 --2- 172.21.15.77:0/2891816532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810100e20 0x7f1810101200 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1800009900 tx=0x7f180002a480 comp rx=0 tx=0).stop 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- 172.21.15.77:0/2891816532 shutdown_connections 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 --2- 172.21.15.77:0/2891816532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1810102ef0 0x7f181010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 --2- 172.21.15.77:0/2891816532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1810102570 0x7f18101029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 --2- 172.21.15.77:0/2891816532 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810100e20 0x7f1810101200 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- 172.21.15.77:0/2891816532 >> 172.21.15.77:0/2891816532 conn(0x7f18100fc7d0 msgr2=0x7f18100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- 172.21.15.77:0/2891816532 shutdown_connections 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- 172.21.15.77:0/2891816532 wait complete. 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 Processor -- start 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.604+0000 7f18167e7640 1 -- start start 2024-09-15T23:31:10.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1810100e20 0x7f18101971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1810102ef0 0x7f1810197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110ff0 con 0x7f1810102570 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1810110e70 con 0x7f1810100e20 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1810111170 con 0x7f1810102ef0 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36582/0 (socket says 172.21.15.77:36582) 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 -- 172.21.15.77:0/3940053518 learned_addr learned my addr 172.21.15.77:0/3940053518 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 -- 172.21.15.77:0/3940053518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1810102ef0 msgr2=0x7f1810197c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1810102ef0 0x7f1810197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 -- 172.21.15.77:0/3940053518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1810100e20 msgr2=0x7f18101971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1810100e20 0x7f18101971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 -- 172.21.15.77:0/3940053518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18101a6a40 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180f7fe640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17f800b4a0 tx=0x7f17f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8014070 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f17f8010af0 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18101a6d30 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f8017d10 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.605+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18101a7290 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.606+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1810101200 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.608+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f17f8017070 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.609+0000 7f180d7fa640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 0x7f17fc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.609+0000 7f180ffff640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 0x7f17fc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.609+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f17f80cf530 con 0x7f1810102570 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.609+0000 7f180ffff640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 0x7f17fc0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18000096c0 tx=0x7f1800000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:10.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.612+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f17f809be70 con 0x7f1810102570 2024-09-15T23:31:10.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.814+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f181006a560 con 0x7f1810102570 2024-09-15T23:31:10.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.815+0000 7f180d7fa640 1 -- 172.21.15.77:0/3940053518 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f181006a560 con 0x7f1810102570 2024-09-15T23:31:10.816 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:10.816 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:10.817 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:10.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 msgr2=0x7f17fc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:10.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 0x7f17fc0a5790 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f18000096c0 tx=0x7f1800000bc0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 msgr2=0x7f1810197710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f17f800b4a0 tx=0x7f17f800b960 comp rx=0 tx=0).stop 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 shutdown_connections 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17fc0a32d0 0x7f17fc0a5790 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1810102ef0 0x7f1810197c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1810102570 0x7f1810197710 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 --2- 172.21.15.77:0/3940053518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1810100e20 0x7f18101971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 >> 172.21.15.77:0/3940053518 conn(0x7f18100fc7d0 msgr2=0x7f18100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 shutdown_connections 2024-09-15T23:31:10.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:10.817+0000 7f18167e7640 1 -- 172.21.15.77:0/3940053518 wait complete. 2024-09-15T23:31:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:10 smithi077 ceph-mon[30968]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:10 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3940053518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:10 smithi159 ceph-mon[35472]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:10 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3940053518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:10 smithi155 ceph-mon[35631]: pgmap v338: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:10 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3940053518' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:11.611 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:11.868 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 -- 172.21.15.77:0/3157015889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c106a80 msgr2=0x7f412c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 --2- 172.21.15.77:0/3157015889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c106a80 0x7f412c106e60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4128009930 tx=0x7f412802a420 comp rx=0 tx=0).stop 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 -- 172.21.15.77:0/3157015889 shutdown_connections 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 --2- 172.21.15.77:0/3157015889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c101420 0x7f412c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 --2- 172.21.15.77:0/3157015889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c100a80 0x7f412c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 --2- 172.21.15.77:0/3157015889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c106a80 0x7f412c106e60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 -- 172.21.15.77:0/3157015889 >> 172.21.15.77:0/3157015889 conn(0x7f412c0fc7a0 msgr2=0x7f412c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:12.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 -- 172.21.15.77:0/3157015889 shutdown_connections 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.388+0000 7f4133c4d640 1 -- 172.21.15.77:0/3157015889 wait complete. 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 Processor -- start 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 -- start start 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 0x7f412c197800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 0x7f412c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f412c110e80 con 0x7f412c100a80 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f412c110d00 con 0x7f412c101420 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f4133c4d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f412c111000 con 0x7f412c106a80 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36600/0 (socket says 172.21.15.77:36600) 2024-09-15T23:31:12.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 -- 172.21.15.77:0/1974574308 learned_addr learned my addr 172.21.15.77:0/1974574308 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41311e8640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 0x7f412c197800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 -- 172.21.15.77:0/1974574308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 msgr2=0x7f412c19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41321ea640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 0x7f412c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 0x7f412c19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 -- 172.21.15.77:0/1974574308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 msgr2=0x7f412c197800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 0x7f412c197800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41319e9640 1 -- 172.21.15.77:0/1974574308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412c19c270 con 0x7f412c100a80 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41311e8640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 0x7f412c197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.389+0000 7f41321ea640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 0x7f412c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f41319e9640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4128009230 tx=0x7f4128004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:12.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412803f030 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4128003ad0 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412c19c500 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4128035070 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.390+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f412c1a3e40 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.391+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f412c1021c0 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.392+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4128042030 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.393+0000 7f411effd640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 0x7f41180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.393+0000 7f41311e8640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 0x7f41180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.393+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f41280f0360 con 0x7f412c100a80 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.393+0000 7f41311e8640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 0x7f41180a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41200058c0 tx=0x7f4120005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:12.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.397+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41280bcb90 con 0x7f412c100a80 2024-09-15T23:31:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.597+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f412c108ff0 con 0x7f412c100a80 2024-09-15T23:31:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.598+0000 7f411effd640 1 -- 172.21.15.77:0/1974574308 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f41280bc490 con 0x7f412c100a80 2024-09-15T23:31:12.599 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:12.599 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 msgr2=0x7f41180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 0x7f41180a5810 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41200058c0 tx=0x7f4120005850 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 msgr2=0x7f412c1972c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4128009230 tx=0x7f4128004270 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 shutdown_connections 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41180a3350 0x7f41180a5810 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f412c106a80 0x7f412c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f412c101420 0x7f412c197800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 --2- 172.21.15.77:0/1974574308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f412c100a80 0x7f412c1972c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 >> 172.21.15.77:0/1974574308 conn(0x7f412c0fc7a0 msgr2=0x7f412c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 shutdown_connections 2024-09-15T23:31:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:12.600+0000 7f4133c4d640 1 -- 172.21.15.77:0/1974574308 wait complete. 2024-09-15T23:31:13.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:12 smithi077 ceph-mon[30968]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:13.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:12 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1974574308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:12 smithi159 ceph-mon[35472]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:12 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1974574308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:12 smithi155 ceph-mon[35631]: pgmap v339: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:12 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1974574308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:13.402 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:31:13.654 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:14.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- 172.21.15.77:0/1136594554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c1036c0 msgr2=0x7fac1c10bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 --2- 172.21.15.77:0/1136594554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c1036c0 0x7fac1c10bbb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fac18009900 tx=0x7fac1802a480 comp rx=0 tx=0).stop 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- 172.21.15.77:0/1136594554 shutdown_connections 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 --2- 172.21.15.77:0/1136594554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c10c180 0x7fac1c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 --2- 172.21.15.77:0/1136594554 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c1036c0 0x7fac1c10bbb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 --2- 172.21.15.77:0/1136594554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c102da0 0x7fac1c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- 172.21.15.77:0/1136594554 >> 172.21.15.77:0/1136594554 conn(0x7fac1c0fc7a0 msgr2=0x7fac1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- 172.21.15.77:0/1136594554 shutdown_connections 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- 172.21.15.77:0/1136594554 wait complete. 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 Processor -- start 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.165+0000 7fac238f1640 1 -- start start 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c102da0 0x7fac1c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:14.187 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c1036c0 0x7fac1c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c111fa0 con 0x7fac1c10c180 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c111e20 con 0x7fac1c102da0 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c112120 con 0x7fac1c1036c0 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36620/0 (socket says 172.21.15.77:36620) 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 -- 172.21.15.77:0/1388687822 learned_addr learned my addr 172.21.15.77:0/1388687822 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac20e8c640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c1036c0 0x7fac1c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac2168d640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c102da0 0x7fac1c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 -- 172.21.15.77:0/1388687822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c1036c0 msgr2=0x7fac1c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c1036c0 0x7fac1c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 -- 172.21.15.77:0/1388687822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c102da0 msgr2=0x7fac1c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:14.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c102da0 0x7fac1c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 -- 172.21.15.77:0/1388687822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c19d440 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac21e8e640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac1400cad0 tx=0x7fac1400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1400ae20 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac14005020 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1400f6f0 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c19d730 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.166+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c1a5010 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.167+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1c103180 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.168+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac140051d0 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.169+0000 7fac127fc640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 0x7fac080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.169+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fac140d02f0 con 0x7fac1c10c180 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.169+0000 7fac2168d640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 0x7fac080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.170+0000 7fac2168d640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 0x7fac080a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a810 tx=0x7fac0c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:14.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.173+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac14014030 con 0x7fac1c10c180 2024-09-15T23:31:14.340 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.339+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac1c1997f0 con 0x7fac1c10c180 2024-09-15T23:31:14.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.342+0000 7fac127fc640 1 -- 172.21.15.77:0/1388687822 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7fac1c1997f0 con 0x7fac1c10c180 2024-09-15T23:31:14.343 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:14.343 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 msgr2=0x7fac080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 0x7fac080a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00a810 tx=0x7fac0c008040 comp rx=0 tx=0).stop 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 msgr2=0x7fac1c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fac1400cad0 tx=0x7fac1400cf90 comp rx=0 tx=0).stop 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 shutdown_connections 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac080a32d0 0x7fac080a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fac1c10c180 0x7fac1c19cd60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac1c1036c0 0x7fac1c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 --2- 172.21.15.77:0/1388687822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac1c102da0 0x7fac1c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:14.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 >> 172.21.15.77:0/1388687822 conn(0x7fac1c0fc7a0 msgr2=0x7fac1c0fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:14.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 shutdown_connections 2024-09-15T23:31:14.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:14.344+0000 7fac238f1640 1 -- 172.21.15.77:0/1388687822 wait complete. 2024-09-15T23:31:15.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:14 smithi077 ceph-mon[30968]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:15.109 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:14 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1388687822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:15.140 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:14 smithi159 ceph-mon[35472]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:14 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1388687822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:14 smithi155 ceph-mon[35631]: pgmap v340: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:14 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1388687822' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:15.388 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:15.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 -- 172.21.15.77:0/2350329644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e601036c0 msgr2=0x7f2e6010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 --2- 172.21.15.77:0/2350329644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e601036c0 0x7f2e6010bbb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009ca0 tx=0x7f2e5002a950 comp rx=0 tx=0).stop 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 -- 172.21.15.77:0/2350329644 shutdown_connections 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 --2- 172.21.15.77:0/2350329644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e6010c180 0x7f2e6010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 --2- 172.21.15.77:0/2350329644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e601036c0 0x7f2e6010bbb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 --2- 172.21.15.77:0/2350329644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e60102da0 0x7f2e60103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 -- 172.21.15.77:0/2350329644 >> 172.21.15.77:0/2350329644 conn(0x7f2e600fc7a0 msgr2=0x7f2e600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 -- 172.21.15.77:0/2350329644 shutdown_connections 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.857+0000 7f2e66e29640 1 -- 172.21.15.77:0/2350329644 wait complete. 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 Processor -- start 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 -- start start 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:15.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 0x7f2e60198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 0x7f2e6019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60111f60 con 0x7f2e60102da0 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e60111de0 con 0x7f2e6010c180 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e66e29640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2e601120e0 con 0x7f2e601036c0 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:36636/0 (socket says 172.21.15.77:36636) 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 -- 172.21.15.77:0/1400893308 learned_addr learned my addr 172.21.15.77:0/1400893308 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e653c6640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 0x7f2e6019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e5ffff640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 0x7f2e60198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 -- 172.21.15.77:0/1400893308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 msgr2=0x7f2e60198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 0x7f2e60198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 -- 172.21.15.77:0/1400893308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 msgr2=0x7f2e6019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:15.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 0x7f2e6019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e64bc5640 1 -- 172.21.15.77:0/1400893308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e6019d390 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e5ffff640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 0x7f2e60198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.858+0000 7f2e653c6640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 0x7f2e6019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e64bc5640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c890 tx=0x7f2e5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e58004220 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e580043c0 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e6019d680 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e580049e0 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.859+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e601a4f60 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.860+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e60103180 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.862+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2e580079b0 con 0x7f2e60102da0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.862+0000 7f2e5dffb640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 0x7f2e4c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.863+0000 7f2e5ffff640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 0x7f2e4c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:15.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.863+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f2e580cff40 con 0x7f2e60102da0 2024-09-15T23:31:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.863+0000 7f2e5ffff640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 0x7f2e4c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005cc0 tx=0x7f2e50005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:15.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:15.866+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2e58014030 con 0x7f2e60102da0 2024-09-15T23:31:16.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.067+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e60199740 con 0x7f2e60102da0 2024-09-15T23:31:16.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.068+0000 7f2e5dffb640 1 -- 172.21.15.77:0/1400893308 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f2e5809c770 con 0x7f2e60102da0 2024-09-15T23:31:16.069 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:16.070 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:16.070 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 msgr2=0x7f2e4c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 0x7f2e4c0a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2e50005cc0 tx=0x7f2e50005c30 comp rx=0 tx=0).stop 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 msgr2=0x7f2e601983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2e5800c890 tx=0x7f2e5800cd50 comp rx=0 tx=0).stop 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 shutdown_connections 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2e4c0a32d0 0x7f2e4c0a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e6010c180 0x7f2e6019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:16.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e601036c0 0x7f2e60198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:16.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 --2- 172.21.15.77:0/1400893308 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2e60102da0 0x7f2e601983e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:16.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 >> 172.21.15.77:0/1400893308 conn(0x7f2e600fc7a0 msgr2=0x7f2e600fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:16.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 shutdown_connections 2024-09-15T23:31:16.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:16.071+0000 7f2e66e29640 1 -- 172.21.15.77:0/1400893308 wait complete. 2024-09-15T23:31:16.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:29:31.287245+0000', 'modified': '2024-09-15T23:30:13.582797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6839/1912555419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1912555419}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1912555419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.159:6839/2481115545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 2481115545}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 2481115545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24460, 'qdb_cluster': [24460]} 2024-09-15T23:31:16.798 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:31:16.799 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T23:31:17.045 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:16 smithi077 ceph-mon[30968]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:17.143 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:16 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1400893308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:16 smithi159 ceph-mon[35472]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:16 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1400893308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:16 smithi155 ceph-mon[35631]: pgmap v341: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:16 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1400893308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 -- 172.21.15.77:0/2233134797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c0103700 msgr2=0x7f21c010bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 --2- 172.21.15.77:0/2233134797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c0103700 0x7f21c010bbf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009900 tx=0x7f21a802a480 comp rx=0 tx=0).stop 2024-09-15T23:31:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 -- 172.21.15.77:0/2233134797 shutdown_connections 2024-09-15T23:31:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 --2- 172.21.15.77:0/2233134797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c010c180 0x7f21c010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 --2- 172.21.15.77:0/2233134797 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c0103700 0x7f21c010bbf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 --2- 172.21.15.77:0/2233134797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0102de0 0x7f21c01031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 -- 172.21.15.77:0/2233134797 >> 172.21.15.77:0/2233134797 conn(0x7f21c00fc7a0 msgr2=0x7f21c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 -- 172.21.15.77:0/2233134797 shutdown_connections 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.519+0000 7f21c69a7640 1 -- 172.21.15.77:0/2233134797 wait complete. 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 Processor -- start 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 -- start start 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 0x7f21c01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 0x7f21c01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111f70 con 0x7f21c010c180 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f21c0111df0 con 0x7f21c0103700 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c69a7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f21c01120f0 con 0x7f21c0102de0 2024-09-15T23:31:17.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48592/0 (socket says 172.21.15.77:48592) 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.520+0000 7f21c4f44640 1 -- 172.21.15.77:0/555109898 learned_addr learned my addr 172.21.15.77:0/555109898 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bffff640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 0x7f21c01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 0x7f21c01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 -- 172.21.15.77:0/555109898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 msgr2=0x7f21c01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 0x7f21c01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 -- 172.21.15.77:0/555109898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 msgr2=0x7f21c01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 0x7f21c01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 -- 172.21.15.77:0/555109898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21c019d450 con 0x7f21c010c180 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bffff640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 0x7f21c01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 0x7f21c01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c4f44640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21b800eaa0 tx=0x7f21b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bd7fa640 1 -- 172.21.15.77:0/555109898 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b800cdb0 con 0x7f21c010c180 2024-09-15T23:31:17.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21c019d740 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bd7fa640 1 -- 172.21.15.77:0/555109898 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21b8005020 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21bd7fa640 1 -- 172.21.15.77:0/555109898 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b80116d0 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.521+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21c01a5020 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.523+0000 7f21bd7fa640 1 -- 172.21.15.77:0/555109898 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f21b80054d0 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 Processor -- start 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 -- start start 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bd7fa640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 0x7f21ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 0x7f21ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 0x55953e4f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bd7fa640 1 -- 172.21.15.77:0/555109898 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f21b80d0140 con 0x7f21c010c180 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4fbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.543 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55953e455090 con 0x55953e4ef2f0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55953e3fca70 con 0x55953e4ee9d0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c8d80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55953e451050 con 0x55953e4f9bb0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 0x55953e4f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:35112/0 (socket says 172.21.15.77:35112) 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21bffff640 1 -- 172.21.15.77:0/3593348768 learned_addr learned my addr 172.21.15.77:0/3593348768 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.524+0000 7f21c4f44640 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4fbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 -- 172.21.15.77:0/3593348768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 msgr2=0x55953e4fbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4fbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 -- 172.21.15.77:0/3593348768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 msgr2=0x55953e4eedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 -- 172.21.15.77:0/3593348768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55953e409130 con 0x55953e4ef2f0 2024-09-15T23:31:17.544 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bffff640 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 0x7f21ac0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21c00fee30 tx=0x7f21a8005d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 0x55953e4f9670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009230 tx=0x7f21a8044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ebdd66ca7a1a3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21b67fc640 1 -- 172.21.15.77:0/3593348768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a804f070 con 0x55953e4ef2f0 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21b67fc640 1 -- 172.21.15.77:0/3593348768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a8004400 con 0x55953e4ef2f0 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.525+0000 7f21b67fc640 1 -- 172.21.15.77:0/3593348768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21a8041030 con 0x55953e4ef2f0 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- 172.21.15.77:0/3593348768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 msgr2=0x55953e4f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 0x55953e4f9670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f21a8009230 tx=0x7f21a8044000 comp rx=0 tx=0).stop 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- 172.21.15.77:0/3593348768 shutdown_connections 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4fbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ef2f0 0x55953e4f9670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3593348768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4eedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- 172.21.15.77:0/3593348768 >> 172.21.15.77:0/3593348768 conn(0x55953e4eaf60 msgr2=0x55953e4eb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- 172.21.15.77:0/3593348768 shutdown_connections 2024-09-15T23:31:17.545 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- 172.21.15.77:0/3593348768 wait complete. 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 -- start start 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 Processor -- start 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4f9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.526+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ef2f0 0x55953e4f6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55953e4fc780 con 0x55953e4f9bb0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55953e40ff20 con 0x55953e4ee9d0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55953e4fc900 con 0x55953e4ef2f0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 10 client.0 _ll_register_callbacks cb 0x55953e3d9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48616/0 (socket says 172.21.15.77:48616) 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 -- 172.21.15.77:0/3708791146 learned_addr learned my addr 172.21.15.77:0/3708791146 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ef2f0 0x55953e4f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 -- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ef2f0 msgr2=0x55953e4f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ef2f0 0x55953e4f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21bffff640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4f9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 -- 172.21.15.77:0/3708791146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 msgr2=0x55953e4f9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4f9500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 -- 172.21.15.77:0/3708791146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55953e1c62b0 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c4f44640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21b80cd730 tx=0x7f21b809c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c7812f3ac6fa1f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f219f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b80b5060 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f21b80bc0c0 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21a8004400 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21b801f040 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 10 client.15045 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.527+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55953e5081b0 con 0x55953e4f9bb0 2024-09-15T23:31:17.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21a8004400 con 0x55953e4f9bb0 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f21b800f040 con 0x55953e4f9bb0 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 10 client.15045 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 10 client.15045 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 20 client.15045 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e50a770 0x55953e50bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 4 client.15045 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55953e462600 con 0x55953e50a770 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.528+0000 7f21bffff640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e50a770 0x55953e50bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21bffff640 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e50a770 0x55953e50bbe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35eea947b79d816f server_cookie=e581c133bd875c in_seq=0 out_seq=0 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f219f7fe640 10 client.15045 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f219f7fe640 1 -- 172.21.15.77:0/3708791146 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55953e462600 con 0x55953e50a770 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f219f7fe640 10 client.15045 handle_command_reply: tid=0 2024-09-15T23:31:17.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 client.15045 shutdown 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 msgr2=0x55953e4f6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21b80cd730 tx=0x7f21b809c2d0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 shutdown_connections 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e50a770 0x55953e50bbe0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e4f6db0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ef2f0 0x55953e4f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f219f7fe640 0 client.15045 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.529+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3708791146 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ee9d0 0x55953e4f9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.530+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 >> 172.21.15.77:0/3708791146 conn(0x55953e4eaf60 msgr2=0x55953e4f0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.530+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 shutdown_connections 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.530+0000 7f21c8d80740 1 -- 172.21.15.77:0/3708791146 wait complete. 2024-09-15T23:31:17.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.530+0000 7f21c8d80740 20 client.15045 trim_cache size 0 max 16384 2024-09-15T23:31:17.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 Processor -- start 2024-09-15T23:31:17.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 -- start start 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e4f6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55953e509f20 con 0x55953e4ee9d0 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55953e50a5f0 con 0x55953e4ef2f0 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21c8d80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55953e50acc0 con 0x55953e4f9bb0 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48630/0 (socket says 172.21.15.77:48630) 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 -- 172.21.15.77:0/3206916118 learned_addr learned my addr 172.21.15.77:0/3206916118 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 -- 172.21.15.77:0/3206916118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 msgr2=0x55953e4f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 -- 172.21.15.77:0/3206916118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 msgr2=0x55953e4f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e4f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 -- 172.21.15.77:0/3206916118 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55953e4f4da0 con 0x55953e4ee9d0 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.548+0000 7f21bffff640 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55953e50c6c0 tx=0x7f21b000c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e218369dbf1a863 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21b5ffb640 1 -- 172.21.15.77:0/3206916118 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b0004020 con 0x55953e4ee9d0 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21b5ffb640 1 -- 172.21.15.77:0/3206916118 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21b00041c0 con 0x55953e4ee9d0 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21b5ffb640 1 -- 172.21.15.77:0/3206916118 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b001a330 con 0x55953e4ee9d0 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 -- 172.21.15.77:0/3206916118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 msgr2=0x55953e50bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55953e50c6c0 tx=0x7f21b000c590 comp rx=0 tx=0).stop 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 -- 172.21.15.77:0/3206916118 shutdown_connections 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4f9bb0 0x55953e4f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e4f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 --2- 172.21.15.77:0/3206916118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4ee9d0 0x55953e50bbe0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.549+0000 7f21c8d80740 1 -- 172.21.15.77:0/3206916118 >> 172.21.15.77:0/3206916118 conn(0x55953e4eaf60 msgr2=0x55953e4e5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- 172.21.15.77:0/3206916118 shutdown_connections 2024-09-15T23:31:17.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- 172.21.15.77:0/3206916118 wait complete. 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- start start 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 Processor -- start 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ee9d0 0x55953e514260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e5147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55953e50ba60 con 0x55953e4f9bb0 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55953e50b390 con 0x55953e4ef2f0 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.550+0000 7f21c8d80740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55953e50c130 con 0x55953e4ee9d0 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c8d80740 10 client.0 _ll_register_callbacks cb 0x7f21b8009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48642/0 (socket says 172.21.15.77:48642) 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 -- 172.21.15.77:0/2801602750 learned_addr learned my addr 172.21.15.77:0/2801602750 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:17.556 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21bffff640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ee9d0 0x55953e514260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 -- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ee9d0 msgr2=0x55953e514260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21bf7fe640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e5147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ee9d0 0x55953e514260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 -- 172.21.15.77:0/2801602750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 msgr2=0x55953e5147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e5147a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 -- 172.21.15.77:0/2801602750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55953e50df90 con 0x55953e4f9bb0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c4f44640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f21b809bf10 tx=0x7f21b80cd640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e4657955f5ea6f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f219f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21b809bb70 con 0x55953e4f9bb0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f21b809b750 con 0x55953e4f9bb0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f21b00041c0 con 0x55953e4f9bb0 2024-09-15T23:31:17.557 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f21b809c910 con 0x55953e4f9bb0 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c8d80740 10 client.15051 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.551+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55953e5129f0 con 0x55953e4f9bb0 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f21b00041c0 con 0x55953e4f9bb0 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f21b809b0d0 con 0x55953e4f9bb0 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 10 client.15051 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 10 client.15051 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 20 client.15051 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e579460 0x55953e578170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 4 client.15051 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "status"}) -- 0x55953e45cb10 con 0x55953e579460 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21bffff640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e579460 0x55953e578170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:17.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f21bffff640 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e579460 0x55953e578170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=142cbd75b9e27c75 server_cookie=c7b8e9a5db0697b1 in_seq=0 out_seq=0 2024-09-15T23:31:17.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.552+0000 7f219f7fe640 10 client.15051 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:17.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f219f7fe640 1 -- 172.21.15.77:0/2801602750 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55953e45cb10 con 0x55953e579460 2024-09-15T23:31:17.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f219f7fe640 10 client.15051 handle_command_reply: tid=0 2024-09-15T23:31:17.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 client.15051 shutdown 2024-09-15T23:31:17.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 msgr2=0x55953e50d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f21b809bf10 tx=0x7f21b80cd640 comp rx=0 tx=0).stop 2024-09-15T23:31:17.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 shutdown_connections 2024-09-15T23:31:17.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55953e579460 0x55953e578170 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55953e4f9bb0 0x55953e50d790 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55953e4ef2f0 0x55953e5147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f219f7fe640 0 client.15051 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 --2- 172.21.15.77:0/2801602750 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55953e4ee9d0 0x55953e514260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 >> 172.21.15.77:0/2801602750 conn(0x55953e4eaf60 msgr2=0x55953e4f6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 shutdown_connections 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 1 -- 172.21.15.77:0/2801602750 wait complete. 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.553+0000 7f21c8d80740 20 client.15051 trim_cache size 0 max 16384 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-09-15T23:31:17.561 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24460, 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 105.858221861, 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 91, 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 125.614792335 2024-09-15T23:31:17.562 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 msgr2=0x7f21ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 0x7f21ac0a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f21c00fee30 tx=0x7f21a8005d50 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 msgr2=0x7f21c019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f21b800eaa0 tx=0x7f21b800ef60 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 shutdown_connections 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f21ac0a32d0 0x7f21ac0a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f21c010c180 0x7f21c019cd70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f21c0103700 0x7f21c01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 --2- 172.21.15.77:0/555109898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f21c0102de0 0x7f21c01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 >> 172.21.15.77:0/555109898 conn(0x7f21c00fc7a0 msgr2=0x7f21c00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:17.563 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 shutdown_connections 2024-09-15T23:31:17.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:17.554+0000 7f21c69a7640 1 -- 172.21.15.77:0/555109898 wait complete. 2024-09-15T23:31:18.373 INFO:tasks.cephadm:Setup complete, yielding 2024-09-15T23:31:18.373 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T23:31:18.383 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:31:18.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-15T23:31:18.657 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:19.092 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:18 smithi077 ceph-mon[30968]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 -- 172.21.15.77:0/48511199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408100b10 msgr2=0x7fb408100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 --2- 172.21.15.77:0/48511199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408100b10 0x7fb408100f10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009900 tx=0x7fb3f802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 -- 172.21.15.77:0/48511199 shutdown_connections 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 --2- 172.21.15.77:0/48511199 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb408108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 --2- 172.21.15.77:0/48511199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408101d10 0x7fb408102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.201 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 --2- 172.21.15.77:0/48511199 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408100b10 0x7fb408100f10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 -- 172.21.15.77:0/48511199 >> 172.21.15.77:0/48511199 conn(0x7fb4080fc2a0 msgr2=0x7fb4080fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 -- 172.21.15.77:0/48511199 shutdown_connections 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 -- 172.21.15.77:0/48511199 wait complete. 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.172+0000 7fb40e52a640 1 Processor -- start 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 -- start start 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408100b10 0x7fb4081980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb40819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb40810c870 con 0x7fb408101d10 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb40810c6f0 con 0x7fb4081026d0 2024-09-15T23:31:19.202 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40e52a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb40810c9f0 con 0x7fb408100b10 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48660/0 (socket says 172.21.15.77:48660) 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 -- 172.21.15.77:0/2744867569 learned_addr learned my addr 172.21.15.77:0/2744867569 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40cac7640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb40819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb407fff640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408100b10 0x7fb4081980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 -- 172.21.15.77:0/2744867569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408100b10 msgr2=0x7fb4081980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408100b10 0x7fb4081980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 -- 172.21.15.77:0/2744867569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 msgr2=0x7fb40819f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb40819f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb4077fe640 1 -- 172.21.15.77:0/2744867569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40819fd20 con 0x7fb408101d10 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.173+0000 7fb40cac7640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb40819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb4077fe640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00b4a0 tx=0x7fb3fc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:19.203 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc014070 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40819ffb0 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb3fc010af0 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc017d10 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.174+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4081a0540 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.175+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4081a07d0 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.177+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb3fc017070 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.177+0000 7fb4057fa640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 0x7fb3f00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.177+0000 7fb407fff640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 0x7fb3f00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.177+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb3fc0cf4a0 con 0x7fb408101d10 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.178+0000 7fb407fff640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 0x7fb3f00a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006010 tx=0x7fb3f8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:19.204 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.181+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3fc09bde0 con 0x7fb408101d10 2024-09-15T23:31:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:18 smithi155 ceph-mon[35631]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:19.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.363+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fb4081a09a0 con 0x7fb3f00a3300 2024-09-15T23:31:19.365 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.364+0000 7fb4057fa640 1 -- 172.21.15.77:0/2744867569 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb4081a09a0 con 0x7fb3f00a3300 2024-09-15T23:31:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:Backend: cephadm 2024-09-15T23:31:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:Available: Yes 2024-09-15T23:31:19.366 INFO:teuthology.orchestra.run.smithi077.stdout:Paused: No 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 msgr2=0x7fb3f00a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 0x7fb3f00a57c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8006010 tx=0x7fb3f8000bc0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 msgr2=0x7fb408198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00b4a0 tx=0x7fb3fc00b960 comp rx=0 tx=0).stop 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 shutdown_connections 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3f00a3300 0x7fb3f00a57c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb4081026d0 0x7fb40819f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.368 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.366+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb408101d10 0x7fb408198630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.367+0000 7fb40e52a640 1 --2- 172.21.15.77:0/2744867569 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb408100b10 0x7fb4081980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:19.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.367+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 >> 172.21.15.77:0/2744867569 conn(0x7fb4080fc2a0 msgr2=0x7fb40806a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:19.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.367+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 shutdown_connections 2024-09-15T23:31:19.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:19.367+0000 7fb40e52a640 1 -- 172.21.15.77:0/2744867569 wait complete. 2024-09-15T23:31:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:18 smithi159 ceph-mon[35472]: pgmap v342: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:20.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-15T23:31:20.321 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 -- 172.21.15.77:0/4199345831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c100b10 msgr2=0x7f8d0c100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 --2- 172.21.15.77:0/4199345831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c100b10 0x7f8d0c100f10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009900 tx=0x7f8d0002a410 comp rx=0 tx=0).stop 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 -- 172.21.15.77:0/4199345831 shutdown_connections 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 --2- 172.21.15.77:0/4199345831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c1026d0 0x7f8d0c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 --2- 172.21.15.77:0/4199345831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c101d10 0x7f8d0c102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 --2- 172.21.15.77:0/4199345831 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c100b10 0x7f8d0c100f10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 -- 172.21.15.77:0/4199345831 >> 172.21.15.77:0/4199345831 conn(0x7f8d0c0fc2a0 msgr2=0x7f8d0c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 -- 172.21.15.77:0/4199345831 shutdown_connections 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 -- 172.21.15.77:0/4199345831 wait complete. 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.779+0000 7f8d14090640 1 Processor -- start 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 -- start start 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 0x7f8d0c06b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c1026d0 0x7f8d0c19f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c10c7f0 con 0x7f8d0c101d10 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c10c670 con 0x7f8d0c100b10 2024-09-15T23:31:20.794 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d14090640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8d0c10c970 con 0x7f8d0c1026d0 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48676/0 (socket says 172.21.15.77:48676) 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 -- 172.21.15.77:0/705816642 learned_addr learned my addr 172.21.15.77:0/705816642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1262d640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c1026d0 0x7f8d0c19f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 -- 172.21.15.77:0/705816642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c1026d0 msgr2=0x7f8d0c19f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c1026d0 0x7f8d0c19f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 -- 172.21.15.77:0/705816642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 msgr2=0x7f8d0c06b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d11e2c640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 0x7f8d0c06b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 0x7f8d0c06b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.795 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 -- 172.21.15.77:0/705816642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d0c19fba0 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d11e2c640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 0x7f8d0c06b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8d1162b640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c890 tx=0x7f8d0800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d08004220 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.780+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d080043c0 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.781+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d0c19fe90 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.781+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d080049e0 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.781+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d0c1a03c0 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.781+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d0c107f60 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.783+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8d080079b0 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.783+0000 7f8cfeffd640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 0x7f8cf80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.783+0000 7f8d11e2c640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 0x7f8cf80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.783+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f8d080d0080 con 0x7f8d0c101d10 2024-09-15T23:31:20.796 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.784+0000 7f8d11e2c640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 0x7f8cf80a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000c00 tx=0x7f8d00031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:20.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.786+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d08014030 con 0x7f8d0c101d10 2024-09-15T23:31:20.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.965+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d0c062630 con 0x7f8cf80a32d0 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.977+0000 7f8cfeffd640 1 -- 172.21.15.77:0/705816642 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4061 (secure 0 0 0) 0x7f8d0c062630 con 0x7f8cf80a32d0 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.a smithi077 running (2m) 51s ago 2m 13.3M - 19.1.1-326-g8921c8ef f1455bd0219c 8af6fdb0fd06 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.b smithi155 running (2m) 52s ago 2m 16.3M - 19.1.1-326-g8921c8ef f1455bd0219c f12973b6cc49 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.c smithi159 running (2m) 52s ago 2m 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 850bdef74836 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.d smithi077 running (2m) 51s ago 2m 14.4M - 19.1.1-326-g8921c8ef f1455bd0219c 615a18e09a34 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.e smithi155 running (2m) 52s ago 2m 13.5M - 19.1.1-326-g8921c8ef f1455bd0219c 2dc79a9abda8 2024-09-15T23:31:20.979 INFO:teuthology.orchestra.run.smithi077.stdout:mds.f smithi159 running (2m) 52s ago 2m 15.8M - 19.1.1-326-g8921c8ef f1455bd0219c 92cb175125b2 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.g smithi077 running (2m) 51s ago 2m 13.3M - 19.1.1-326-g8921c8ef f1455bd0219c 3f3bf29ec5f7 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.h smithi155 running (2m) 52s ago 2m 14.2M - 19.1.1-326-g8921c8ef f1455bd0219c 826bfcd2ac34 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.i smithi159 running (2m) 52s ago 2m 26.3M - 19.1.1-326-g8921c8ef f1455bd0219c f24a60fcc394 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.j smithi077 running (2m) 51s ago 2m 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c 78bd4c296a84 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.k smithi155 running (2m) 52s ago 2m 13.5M - 19.1.1-326-g8921c8ef f1455bd0219c 89b973726bbb 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mds.l smithi159 running (2m) 52s ago 2m 15.9M - 19.1.1-326-g8921c8ef f1455bd0219c 5b4eaeabb227 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.x smithi077 *:9283,8765 running (9m) 51s ago 9m 509M - 19.1.1-326-g8921c8ef f1455bd0219c 050d268db99d 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.y smithi155 *:8443,8765 running (7m) 52s ago 7m 444M - 19.1.1-326-g8921c8ef f1455bd0219c 068e27337b17 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mgr.z smithi159 *:8443,8765 running (7m) 52s ago 7m 442M - 19.1.1-326-g8921c8ef f1455bd0219c 8267f6261036 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mon.a smithi077 running (9m) 51s ago 9m 50.2M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 2d1a8069c95d 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mon.b smithi155 running (8m) 52s ago 8m 39.8M 2048M 19.1.1-326-g8921c8ef f1455bd0219c e914e6154849 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:mon.c smithi159 running (8m) 52s ago 8m 39.3M 2048M 19.1.1-326-g8921c8ef f1455bd0219c 443ac49a2963 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 smithi077 running (7m) 51s ago 7m 54.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 26328b44314e 2024-09-15T23:31:20.980 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 smithi155 running (7m) 52s ago 7m 46.4M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 3e051f21ee01 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 smithi159 running (6m) 52s ago 6m 47.0M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 2fb8c0e14a50 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 smithi077 running (6m) 51s ago 6m 55.7M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 15fe49ed4d9c 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 smithi155 running (5m) 52s ago 5m 51.1M 4272M 19.1.1-326-g8921c8ef f1455bd0219c c8945bdb197b 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 smithi159 running (5m) 52s ago 5m 53.8M 4272M 19.1.1-326-g8921c8ef f1455bd0219c d8b19189e342 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 smithi077 running (4m) 51s ago 4m 50.0M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 5618ce7e33ad 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 smithi155 running (4m) 52s ago 4m 53.9M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 3b6fd7b44141 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.8 smithi159 running (4m) 52s ago 4m 49.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 8c25e13928d4 2024-09-15T23:31:20.981 INFO:teuthology.orchestra.run.smithi077.stdout:osd.9 smithi077 running (3m) 51s ago 3m 41.3M 4272M 19.1.1-326-g8921c8ef f1455bd0219c b771b7a25e25 2024-09-15T23:31:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:osd.10 smithi155 running (3m) 52s ago 3m 44.5M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 6ec6dee72db1 2024-09-15T23:31:20.982 INFO:teuthology.orchestra.run.smithi077.stdout:osd.11 smithi159 running (2m) 52s ago 2m 49.2M 4272M 19.1.1-326-g8921c8ef f1455bd0219c 084471086bf2 2024-09-15T23:31:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.979+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 msgr2=0x7f8cf80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.979+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 0x7f8cf80a5790 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8d00000c00 tx=0x7f8d00031400 comp rx=0 tx=0).stop 2024-09-15T23:31:20.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 msgr2=0x7f8d0c19cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800c890 tx=0x7f8d0800cd50 comp rx=0 tx=0).stop 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 shutdown_connections 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8cf80a32d0 0x7f8cf80a5790 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d0c1026d0 0x7f8d0c19f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d0c101d10 0x7f8d0c19cc90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 --2- 172.21.15.77:0/705816642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d0c100b10 0x7f8d0c06b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:20.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 >> 172.21.15.77:0/705816642 conn(0x7f8d0c0fc2a0 msgr2=0x7f8d0c105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 shutdown_connections 2024-09-15T23:31:20.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:20.980+0000 7f8d14090640 1 -- 172.21.15.77:0/705816642 wait complete. 2024-09-15T23:31:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:20 smithi159 ceph-mon[35472]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:20 smithi159 ceph-mon[35472]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:20 smithi155 ceph-mon[35631]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:20 smithi155 ceph-mon[35631]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:21.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:20 smithi077 ceph-mon[30968]: from='client.15057 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:20 smithi077 ceph-mon[30968]: pgmap v343: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:21.803 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-15T23:31:22.051 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:22.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:21 smithi077 ceph-mon[30968]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:21 smithi155 ceph-mon[35631]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:22.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:21 smithi159 ceph-mon[35472]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:22.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 -- 172.21.15.77:0/3092226142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384101d10 msgr2=0x7f4384102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:22.503 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3092226142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384101d10 0x7f4384102190 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4374009900 tx=0x7f437402a410 comp rx=0 tx=0).stop 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 -- 172.21.15.77:0/3092226142 shutdown_connections 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3092226142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43841026d0 0x7f4384108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3092226142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4384101d10 0x7f4384102190 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3092226142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4384100b10 0x7f4384100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 -- 172.21.15.77:0/3092226142 >> 172.21.15.77:0/3092226142 conn(0x7f43840fc2a0 msgr2=0x7f43840fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 -- 172.21.15.77:0/3092226142 shutdown_connections 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.498+0000 7f438c7ff640 1 -- 172.21.15.77:0/3092226142 wait complete. 2024-09-15T23:31:22.504 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 Processor -- start 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 -- start start 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 0x7f438410b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4384101d10 0x7f4384109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f438410d8c0 con 0x7f43841026d0 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f438410d740 con 0x7f4384100b10 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438c7ff640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f438410da40 con 0x7f4384101d10 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48700/0 (socket says 172.21.15.77:48700) 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 -- 172.21.15.77:0/3800533564 learned_addr learned my addr 172.21.15.77:0/3800533564 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438a59b640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 0x7f438410b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:22.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 -- 172.21.15.77:0/3800533564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4384101d10 msgr2=0x7f4384109ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4384101d10 0x7f4384109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 -- 172.21.15.77:0/3800533564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 msgr2=0x7f438410b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 0x7f438410b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 -- 172.21.15.77:0/3800533564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438410a8e0 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438a59b640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 0x7f438410b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.499+0000 7f438ad9c640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f437c00eaa0 tx=0x7f437c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.500+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c00cdb0 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.500+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f437c005020 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.500+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43841a20b0 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.500+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c0116b0 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.500+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43841a25c0 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.501+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4384100f10 con 0x7f43841026d0 2024-09-15T23:31:22.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.502+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f437c005560 con 0x7f43841026d0 2024-09-15T23:31:22.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.503+0000 7f437b7fe640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 0x7f43700a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:22.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.503+0000 7f438a59b640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 0x7f43700a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:22.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.503+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f437c0d03d0 con 0x7f43841026d0 2024-09-15T23:31:22.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.503+0000 7f438a59b640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 0x7f43700a5810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43800058c0 tx=0x7f4380005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:22.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.506+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f437c016030 con 0x7f43841026d0 2024-09-15T23:31:22.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.684+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f4384062630 con 0x7f43700a3350 2024-09-15T23:31:22.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.690+0000 7f437b7fe640 1 -- 172.21.15.77:0/3800533564 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f4384062630 con 0x7f43700a3350 2024-09-15T23:31:22.691 INFO:teuthology.orchestra.run.smithi077.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-15T23:31:22.691 INFO:teuthology.orchestra.run.smithi077.stdout:mds.all 12/12 54s ago 2m smithi077=a;smithi077=d;smithi077=g;smithi077=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi159=c;smithi159=f;smithi159=i;smithi159=l;count:12 2024-09-15T23:31:22.691 INFO:teuthology.orchestra.run.smithi077.stdout:mgr 3/3 54s ago 7m smithi077=x;smithi155=y;smithi159=z;count:3 2024-09-15T23:31:22.692 INFO:teuthology.orchestra.run.smithi077.stdout:mon 3/3 54s ago 8m smithi077:172.21.15.77=a;smithi155:172.21.15.155=b;smithi159:172.21.15.159=c;count:3 2024-09-15T23:31:22.692 INFO:teuthology.orchestra.run.smithi077.stdout:osd 12 54s ago - 2024-09-15T23:31:22.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 msgr2=0x7f43700a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:22.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 0x7f43700a5810 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43800058c0 tx=0x7f4380005850 comp rx=0 tx=0).stop 2024-09-15T23:31:22.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 msgr2=0x7f438410a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f437c00eaa0 tx=0x7f437c00ef60 comp rx=0 tx=0).stop 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 shutdown_connections 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43700a3350 0x7f43700a5810 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f43841026d0 0x7f438410a020 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4384101d10 0x7f4384109ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 --2- 172.21.15.77:0/3800533564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4384100b10 0x7f438410b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 >> 172.21.15.77:0/3800533564 conn(0x7f43840fc2a0 msgr2=0x7f4384105100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 shutdown_connections 2024-09-15T23:31:22.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:22.692+0000 7f438c7ff640 1 -- 172.21.15.77:0/3800533564 wait complete. 2024-09-15T23:31:23.356 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:22 smithi077 ceph-mon[30968]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:23.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:22 smithi155 ceph-mon[35631]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:23.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:22 smithi159 ceph-mon[35472]: pgmap v344: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:23.471 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-15T23:31:23.715 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:24.105 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:23 smithi077 ceph-mon[30968]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- 172.21.15.77:0/3590418540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128102df0 msgr2=0x7ff128103270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 --2- 172.21.15.77:0/3590418540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128102df0 0x7ff128103270 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7ff118009900 tx=0x7ff11802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- 172.21.15.77:0/3590418540 shutdown_connections 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 --2- 172.21.15.77:0/3590418540 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff1281037b0 0x7ff12810a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 --2- 172.21.15.77:0/3590418540 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff128102df0 0x7ff128103270 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 --2- 172.21.15.77:0/3590418540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128101bf0 0x7ff128101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- 172.21.15.77:0/3590418540 >> 172.21.15.77:0/3590418540 conn(0x7ff1280fd3c0 msgr2=0x7ff1280ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- 172.21.15.77:0/3590418540 shutdown_connections 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- 172.21.15.77:0/3590418540 wait complete. 2024-09-15T23:31:24.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 Processor -- start 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 -- start start 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.186+0000 7ff130792640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff128101bf0 0x7ff128075f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 0x7ff1280745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810d850 con 0x7ff1281037b0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810d6d0 con 0x7ff128101bf0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff12810d9d0 con 0x7ff128102df0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48716/0 (socket says 172.21.15.77:48716) 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 -- 172.21.15.77:0/3049560465 learned_addr learned my addr 172.21.15.77:0/3049560465 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12dd2d640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 0x7ff1280745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 -- 172.21.15.77:0/3049560465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 msgr2=0x7ff1280745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12e52e640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff128101bf0 0x7ff128075f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:24.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 0x7ff1280745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 -- 172.21.15.77:0/3049560465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff128101bf0 msgr2=0x7ff128075f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff128101bf0 0x7ff128075f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 -- 172.21.15.77:0/3049560465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1280753e0 con 0x7ff1281037b0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12dd2d640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 0x7ff1280745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff12ed2f640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff120009fd0 tx=0x7ff12000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff120017070 con 0x7ff1281037b0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff120003e50 con 0x7ff1281037b0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1281a1fa0 con 0x7ff1281037b0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1200106c0 con 0x7ff1281037b0 2024-09-15T23:31:24.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.187+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1281a2460 con 0x7ff1281037b0 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.188+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff128108f70 con 0x7ff1281037b0 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.189+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff120003970 con 0x7ff1281037b0 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.190+0000 7ff11f7fe640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 0x7ff1140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.190+0000 7ff12e52e640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 0x7ff1140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.190+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff1200cfc60 con 0x7ff1281037b0 2024-09-15T23:31:24.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.191+0000 7ff12e52e640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 0x7ff1140a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff124005fd0 tx=0x7ff124005ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:24.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.194+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff12009c490 con 0x7ff1281037b0 2024-09-15T23:31:24.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:23 smithi155 ceph-mon[35631]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:24.369 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.367+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff128062630 con 0x7ff1140a32d0 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.369+0000 7ff11f7fe640 1 -- 172.21.15.77:0/3049560465 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ff128062630 con 0x7ff1140a32d0 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:HOST ADDR LABELS STATUS 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 172.21.15.77 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:smithi155 172.21.15.155 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:smithi159 172.21.15.159 2024-09-15T23:31:24.370 INFO:teuthology.orchestra.run.smithi077.stdout:3 hosts in cluster 2024-09-15T23:31:24.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 msgr2=0x7ff1140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:24.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 0x7ff1140a5790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff124005fd0 tx=0x7ff124005ce0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 msgr2=0x7ff128074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff120009fd0 tx=0x7ff12000b260 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 shutdown_connections 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff1140a32d0 0x7ff1140a5790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff1281037b0 0x7ff128074b20 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff128102df0 0x7ff1280745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 --2- 172.21.15.77:0/3049560465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff128101bf0 0x7ff128075f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 >> 172.21.15.77:0/3049560465 conn(0x7ff1280fd3c0 msgr2=0x7ff128106140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 shutdown_connections 2024-09-15T23:31:24.373 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:24.371+0000 7ff130792640 1 -- 172.21.15.77:0/3049560465 wait complete. 2024-09-15T23:31:24.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:23 smithi159 ceph-mon[35472]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:25.023 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-15T23:31:25.265 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:24 smithi155 ceph-mon[35631]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:25.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:24 smithi077 ceph-mon[30968]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:25.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:24 smithi159 ceph-mon[35472]: pgmap v345: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:25.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 -- 172.21.15.77:0/2651656497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970101c00 msgr2=0x7fa970102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:25.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 --2- 172.21.15.77:0/2651656497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970101c00 0x7fa970102000 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009900 tx=0x7fa96c02a410 comp rx=0 tx=0).stop 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 -- 172.21.15.77:0/2651656497 shutdown_connections 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 --2- 172.21.15.77:0/2651656497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 0x7fa97010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 --2- 172.21.15.77:0/2651656497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970102e00 0x7fa970103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 --2- 172.21.15.77:0/2651656497 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970101c00 0x7fa970102000 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 -- 172.21.15.77:0/2651656497 >> 172.21.15.77:0/2651656497 conn(0x7fa9700fd390 msgr2=0x7fa9700ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 -- 172.21.15.77:0/2651656497 shutdown_connections 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.710+0000 7fa977ac2640 1 -- 172.21.15.77:0/2651656497 wait complete. 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 Processor -- start 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 -- start start 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970101c00 0x7fa970197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 0x7fa97019f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:25.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa97010d8e0 con 0x7fa970102e00 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa97010d760 con 0x7fa970101c00 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa977ac2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa97010da60 con 0x7fa9701037c0 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa97505d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa97505d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48728/0 (socket says 172.21.15.77:48728) 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.711+0000 7fa97505d640 1 -- 172.21.15.77:0/3075536597 learned_addr learned my addr 172.21.15.77:0/3075536597 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97585e640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970101c00 0x7fa970197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97605f640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 0x7fa97019f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 -- 172.21.15.77:0/3075536597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 msgr2=0x7fa97019f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 0x7fa97019f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 -- 172.21.15.77:0/3075536597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970101c00 msgr2=0x7fa970197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970101c00 0x7fa970197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 -- 172.21.15.77:0/3075536597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97019fb60 con 0x7fa970102e00 2024-09-15T23:31:25.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa97505d640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b4a0 tx=0x7fa96000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960014070 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa960010af0 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa97019fe50 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa960017d10 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.712+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9701a0380 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.713+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa970108fb0 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.714+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa960017070 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.715+0000 7fa966ffd640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 0x7fa95c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.715+0000 7fa97585e640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 0x7fa95c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.715+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa9600cf500 con 0x7fa970102e00 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.715+0000 7fa97585e640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 0x7fa95c0a57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa96c006010 tx=0x7fa96c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:25.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.718+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa96009bde0 con 0x7fa970102e00 2024-09-15T23:31:25.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.889+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fa970062630 con 0x7fa95c0a3300 2024-09-15T23:31:25.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.891+0000 7fa966ffd640 1 -- 172.21.15.77:0/3075536597 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fa970062630 con 0x7fa95c0a3300 2024-09-15T23:31:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-15T23:31:25.892 INFO:teuthology.orchestra.run.smithi077.stdout:smithi077 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZJ400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T23:31:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-15T23:31:25.893 INFO:teuthology.orchestra.run.smithi077.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-15T23:31:25.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 msgr2=0x7fa95c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:25.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 0x7fa95c0a57c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa96c006010 tx=0x7fa96c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.894 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 msgr2=0x7fa970198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa96000b4a0 tx=0x7fa96000b960 comp rx=0 tx=0).stop 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 shutdown_connections 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa95c0a3300 0x7fa95c0a57c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9701037c0 0x7fa97019f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa970102e00 0x7fa970198470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 --2- 172.21.15.77:0/3075536597 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa970101c00 0x7fa970197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 >> 172.21.15.77:0/3075536597 conn(0x7fa9700fd390 msgr2=0x7fa970106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 shutdown_connections 2024-09-15T23:31:25.895 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:25.893+0000 7fa977ac2640 1 -- 172.21.15.77:0/3075536597 wait complete. 2024-09-15T23:31:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:25 smithi155 ceph-mon[35631]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:26.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:25 smithi077 ceph-mon[30968]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:25 smithi159 ceph-mon[35472]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:26.623 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-15T23:31:26.631 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:31:26.632 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-15T23:31:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:27.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:26 smithi077 ceph-mon[30968]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:27.291 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:26 smithi077 ceph-mon[30968]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:27.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 -- 172.21.15.77:0/1104890737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 msgr2=0x7f918c109d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:27.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 --2- 172.21.15.77:0/1104890737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c109d60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9184009ca0 tx=0x7f918402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 -- 172.21.15.77:0/1104890737 shutdown_connections 2024-09-15T23:31:27.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 --2- 172.21.15.77:0/1104890737 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c109d60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 --2- 172.21.15.77:0/1104890737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 0x7f918c107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 --2- 172.21.15.77:0/1104890737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 0x7f918c104b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 -- 172.21.15.77:0/1104890737 >> 172.21.15.77:0/1104890737 conn(0x7f918c0fc290 msgr2=0x7f918c0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 -- 172.21.15.77:0/1104890737 shutdown_connections 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.289+0000 7f919139a640 1 -- 172.21.15.77:0/1104890737 wait complete. 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 Processor -- start 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 -- start start 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 0x7f918c197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 0x7f918c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f918c10d8b0 con 0x7f918c107970 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f918c10d730 con 0x7f918c105040 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f919139a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f918c10da30 con 0x7f918c102710 2024-09-15T23:31:27.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.290+0000 7f918b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34300/0 (socket says 172.21.15.77:34300) 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 -- 172.21.15.77:0/1691273913 learned_addr learned my addr 172.21.15.77:0/1691273913 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918affd640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 0x7f918c197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918a7fc640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 0x7f918c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 -- 172.21.15.77:0/1691273913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 msgr2=0x7f918c197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 0x7f918c197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 -- 172.21.15.77:0/1691273913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 msgr2=0x7f918c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 0x7f918c198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 -- 172.21.15.77:0/1691273913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918c19fb40 con 0x7f918c107970 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f918b7fe640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9184031ae0 tx=0x7f9184031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9184003c30 con 0x7f918c107970 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f918c100500 con 0x7f918c107970 2024-09-15T23:31:27.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9184003dd0 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f918402fcb0 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.291+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f918c100a90 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.292+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918c0fdd80 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.294+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9184004050 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.294+0000 7f9173fff640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 0x7f91740a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.295+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f91840f11d0 con 0x7f918c107970 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.295+0000 7f918affd640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 0x7f91740a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.295+0000 7f918affd640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 0x7f91740a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9180009bd0 tx=0x7f9180005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:27.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.298+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91840bdb10 con 0x7f918c107970 2024-09-15T23:31:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:26 smithi155 ceph-mon[35631]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:26 smithi155 ceph-mon[35631]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:26 smithi159 ceph-mon[35472]: pgmap v346: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:27.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:26 smithi159 ceph-mon[35472]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-15T23:31:27.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.511+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f918c101e70 con 0x7f918c107970 2024-09-15T23:31:27.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.511+0000 7f9173fff640 1 -- 172.21.15.77:0/1691273913 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) ==== 76+0+3054 (secure 0 0 0) 0x7f91840bd410 con 0x7f918c107970 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:e21 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:btime 2024-09-15T23:30:13:893908+0000 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:legacy client fscid: 1 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:Filesystem 'cephfs' (1) 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:fs_name cephfs 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 21 2024-09-15T23:31:27.513 INFO:teuthology.orchestra.run.smithi077.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-15T23:29:31.287245+0000 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-15T23:30:13.582797+0000 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:tableserver 0 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:root 0 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:session_timeout 300 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:session_autoclose 300 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:max_file_size 1099511627776 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:max_xattr_size 65536 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:required_client_features {} 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure 0 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:last_failure_osd_epoch 0 2024-09-15T23:31:27.514 INFO:teuthology.orchestra.run.smithi077.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:max_mds 1 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:in 0 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:up {0=24460} 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:failed 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:damaged 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:stopped 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:data_pools [3,4] 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:metadata_pool 2 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:inline_data disabled 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:balancer 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:bal_rank_mask -1 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:standby_count_wanted 0 2024-09-15T23:31:27.515 INFO:teuthology.orchestra.run.smithi077.stdout:qdb_cluster leader: 24460 members: 24460 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.i{0:24460} state up:active seq 6 addr [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.b{0:24455} state up:standby-replay seq 1 addr [v2:172.21.15.155:6838/1912555419,v1:172.21.15.155:6839/1912555419] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:Standby daemons: 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.j{-1:14535} state up:standby seq 1 addr [v2:172.21.15.77:6834/2999536599,v1:172.21.15.77:6835/2999536599] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.77:6836/1486038623,v1:172.21.15.77:6837/1486038623] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.g{-1:14592} state up:standby seq 1 addr [v2:172.21.15.77:6838/1197951857,v1:172.21.15.77:6839/1197951857] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.a{-1:14598} state up:standby seq 1 addr [v2:172.21.15.77:6840/1286272134,v1:172.21.15.77:6841/1286272134] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.k{-1:24383} state up:standby seq 1 addr [v2:172.21.15.155:6832/2847751419,v1:172.21.15.155:6833/2847751419] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.e{-1:24407} state up:standby seq 1 addr [v2:172.21.15.155:6834/31263925,v1:172.21.15.155:6835/31263925] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.516 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.l{-1:24421} state up:standby seq 1 addr [v2:172.21.15.159:6832/1148226209,v1:172.21.15.159:6833/1148226209] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.h{-1:24428} state up:standby seq 1 addr [v2:172.21.15.155:6836/1039901701,v1:172.21.15.155:6837/1039901701] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.f{-1:24439} state up:standby seq 1 addr [v2:172.21.15.159:6834/3015432739,v1:172.21.15.159:6835/3015432739] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:[mds.c{-1:24445} state up:standby seq 1 addr [v2:172.21.15.159:6836/2654057278,v1:172.21.15.159:6837/2654057278] compat {c=[1],r=[1],i=[1fff]}] 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 msgr2=0x7f91740a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 0x7f91740a57c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9180009bd0 tx=0x7f9180005f90 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 msgr2=0x7f918c19f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9184031ae0 tx=0x7f9184031ee0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 shutdown_connections 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91740a3300 0x7f91740a57c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f918c107970 0x7f918c19f4d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f918c105040 0x7f918c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 --2- 172.21.15.77:0/1691273913 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f918c102710 0x7f918c197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:27.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 >> 172.21.15.77:0/1691273913 conn(0x7f918c0fc290 msgr2=0x7f918c1030d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 shutdown_connections 2024-09-15T23:31:27.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:27.513+0000 7f919139a640 1 -- 172.21.15.77:0/1691273913 wait complete. 2024-09-15T23:31:28.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:27 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1691273913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:31:28.301 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-15T23:31:28.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:27 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1691273913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:31:28.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:27 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1691273913' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-15T23:31:28.550 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 -- 172.21.15.77:0/177425471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac102e00 msgr2=0x7f4cac103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 --2- 172.21.15.77:0/177425471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac102e00 0x7f4cac103280 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009900 tx=0x7f4c9c02a410 comp rx=0 tx=0).stop 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 -- 172.21.15.77:0/177425471 shutdown_connections 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 --2- 172.21.15.77:0/177425471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 0x7f4cac10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 --2- 172.21.15.77:0/177425471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac102e00 0x7f4cac103280 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 --2- 172.21.15.77:0/177425471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac101c00 0x7f4cac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 -- 172.21.15.77:0/177425471 >> 172.21.15.77:0/177425471 conn(0x7f4cac0fd390 msgr2=0x7f4cac0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 -- 172.21.15.77:0/177425471 shutdown_connections 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.010+0000 7f4cb0870640 1 -- 172.21.15.77:0/177425471 wait complete. 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 Processor -- start 2024-09-15T23:31:29.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 -- start start 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 0x7f4cac1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 0x7f4cac19f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac10d980 con 0x7f4cac101c00 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac10d800 con 0x7f4cac1037c0 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4cb0870640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac10db00 con 0x7f4cac102e00 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34308/0 (socket says 172.21.15.77:34308) 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4caa59c640 1 -- 172.21.15.77:0/3584901572 learned_addr learned my addr 172.21.15.77:0/3584901572 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.011+0000 7f4caad9d640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 0x7f4cac19f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4ca9d9b640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 0x7f4cac1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 -- 172.21.15.77:0/3584901572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 msgr2=0x7f4cac1985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:29.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 0x7f4cac1985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 -- 172.21.15.77:0/3584901572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 msgr2=0x7f4cac19f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 0x7f4cac19f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 -- 172.21.15.77:0/3584901572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac19fcc0 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4ca9d9b640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 0x7f4cac1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4caa59c640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000b450 tx=0x7f4ca000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0015020 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ca0011d70 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac19ffb0 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000f340 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.012+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac1a0480 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.013+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac109070 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.014+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4ca0018020 con 0x7f4cac101c00 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.015+0000 7f4c9b7fe640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 0x7f4c940a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:29.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.015+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f4ca00cf840 con 0x7f4cac101c00 2024-09-15T23:31:29.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.015+0000 7f4ca9d9b640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 0x7f4c940a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:29.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.015+0000 7f4ca9d9b640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 0x7f4c940a57c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:29.022 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.019+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f4ca001f020 con 0x7f4cac101c00 2024-09-15T23:31:29.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.187+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f4cac02d9c0 con 0x7f4cac101c00 2024-09-15T23:31:29.189 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:28 smithi077 ceph-mon[30968]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:29.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.188+0000 7f4c9b7fe640 1 -- 172.21.15.77:0/3584901572 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5648 (secure 0 0 0) 0x7f4ca000d040 con 0x7f4cac101c00 2024-09-15T23:31:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:epoch 91 2024-09-15T23:31:29.189 INFO:teuthology.orchestra.run.smithi077.stdout:fsid 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:created 2024-09-15T23:21:49.385550+0000 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:modified 2024-09-15T23:30:37.982445+0000 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:crush_version 27 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:full_ratio 0.95 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:backfillfull_ratio 0.9 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:nearfull_ratio 0.85 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:require_min_compat_client luminous 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:min_compat_client luminous 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:require_osd_release squid 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:stretch_mode_enabled false 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-15T23:31:29.190 INFO:teuthology.orchestra.run.smithi077.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 89 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:max_osd 12 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.0 up in weight 1 up_from 8 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6802/1105167923,v1:172.21.15.77:6803/1105167923] [v2:172.21.15.77:6804/1105167923,v1:172.21.15.77:6805/1105167923] exists,up ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/3752689492,v1:172.21.15.155:6801/3752689492] [v2:172.21.15.155:6802/3752689492,v1:172.21.15.155:6803/3752689492] exists,up 0c74b13c-72a8-46ce-8a2d-e59a12ca72e0 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/1459216762,v1:172.21.15.159:6801/1459216762] [v2:172.21.15.159:6802/1459216762,v1:172.21.15.159:6803/1459216762] exists,up 8d6d28da-532b-4afd-ba6b-116531ce058a 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.3 up in weight 1 up_from 25 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6810/3522993793,v1:172.21.15.77:6811/3522993793] [v2:172.21.15.77:6812/3522993793,v1:172.21.15.77:6813/3522993793] exists,up 507a52c1-e858-4adb-97e8-073b33f574aa 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.4 up in weight 1 up_from 32 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6808/1067866253,v1:172.21.15.155:6809/1067866253] [v2:172.21.15.155:6810/1067866253,v1:172.21.15.155:6811/1067866253] exists,up 7b175e86-d9a2-41a5-872e-9b979b709070 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.5 up in weight 1 up_from 37 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/1369347099,v1:172.21.15.159:6809/1369347099] [v2:172.21.15.159:6810/1369347099,v1:172.21.15.159:6811/1369347099] exists,up 2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.6 up in weight 1 up_from 44 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6818/2986107738,v1:172.21.15.77:6819/2986107738] [v2:172.21.15.77:6820/2986107738,v1:172.21.15.77:6821/2986107738] exists,up a70f9349-8a28-4915-a236-68f7a4ba7045 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.7 up in weight 1 up_from 50 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6816/649069233,v1:172.21.15.155:6817/649069233] [v2:172.21.15.155:6818/649069233,v1:172.21.15.155:6819/649069233] exists,up 49b06105-0357-42ce-8a9e-a322dc8a07bc 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.8 up in weight 1 up_from 58 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/2918585527,v1:172.21.15.159:6817/2918585527] [v2:172.21.15.159:6818/2918585527,v1:172.21.15.159:6819/2918585527] exists,up 0f0baf0c-70da-4e75-a6ee-018aba7a4232 2024-09-15T23:31:29.191 INFO:teuthology.orchestra.run.smithi077.stdout:osd.9 up in weight 1 up_from 65 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.77:6826/1779757892,v1:172.21.15.77:6827/1779757892] [v2:172.21.15.77:6828/1779757892,v1:172.21.15.77:6829/1779757892] exists,up 8c4453cd-f940-4154-a304-1c0d4631e409 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:osd.10 up in weight 1 up_from 70 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6824/3242099303,v1:172.21.15.155:6825/3242099303] [v2:172.21.15.155:6826/3242099303,v1:172.21.15.155:6827/3242099303] exists,up 2041bfe6-5aff-493b-be41-ece230318b08 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:osd.11 up in weight 1 up_from 77 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/296038473,v1:172.21.15.159:6825/296038473] [v2:172.21.15.159:6826/296038473,v1:172.21.15.159:6827/296038473] exists,up d887c196-e9e9-4265-99c6-63bf61151831 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.4 [2,11] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 2.b [8,11] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.0 [4,8] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.2 [3,9] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.17 [4,6] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.1e [3,9] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.34 [4,9] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 3.37 [5,7] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 4.2 [9,1] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 4.6 [5,8] 2024-09-15T23:31:29.192 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 4.16 [9,8] 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:pg_upmap_items 4.1f [9,8] 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/21470712 expires 2024-09-16T23:22:35.713071+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6801/301680494 expires 2024-09-16T23:22:35.713071+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6800/301680494 expires 2024-09-16T23:22:35.713071+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/152076836 expires 2024-09-16T23:22:35.713071+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6801/85632469 expires 2024-09-16T23:22:13.033320+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/1758888302 expires 2024-09-16T23:22:35.713071+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:6800/85632469 expires 2024-09-16T23:22:13.033320+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/3827072978 expires 2024-09-16T23:22:13.033320+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/1375913164 expires 2024-09-16T23:22:13.033320+0000 2024-09-15T23:31:29.193 INFO:teuthology.orchestra.run.smithi077.stdout:blocklist 172.21.15.77:0/1069420314 expires 2024-09-16T23:22:13.033320+0000 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 msgr2=0x7f4c940a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 0x7f4c940a57c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c000c00 tx=0x7f4c9c031400 comp rx=0 tx=0).stop 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 msgr2=0x7f4cac198090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000b450 tx=0x7f4ca000b910 comp rx=0 tx=0).stop 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 shutdown_connections 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f4c940a3300 0x7f4c940a57c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4cac1037c0 0x7f4cac19f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac102e00 0x7f4cac1985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 --2- 172.21.15.77:0/3584901572 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4cac101c00 0x7f4cac198090 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:29.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 >> 172.21.15.77:0/3584901572 conn(0x7f4cac0fd390 msgr2=0x7f4cac106240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:29.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 shutdown_connections 2024-09-15T23:31:29.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:29.191+0000 7f4cb0870640 1 -- 172.21.15.77:0/3584901572 wait complete. 2024-09-15T23:31:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:28 smithi155 ceph-mon[35631]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:29.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:28 smithi159 ceph-mon[35472]: pgmap v347: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:29.930 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-15T23:31:29.942 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:30.192 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:30.311 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:29 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3584901572' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:31:30.311 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:29 smithi077 ceph-mon[30968]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:30.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:29 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3584901572' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:31:30.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:29 smithi155 ceph-mon[35631]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:30.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:29 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3584901572' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-15T23:31:30.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:29 smithi159 ceph-mon[35472]: pgmap v348: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 -- 172.21.15.77:0/3624861320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168106a80 msgr2=0x7f7168106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 --2- 172.21.15.77:0/3624861320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168106a80 0x7f7168106e60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7164009cd0 tx=0x7f716402a8e0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 -- 172.21.15.77:0/3624861320 shutdown_connections 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 --2- 172.21.15.77:0/3624861320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168101420 0x7f716810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 --2- 172.21.15.77:0/3624861320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f7168100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 --2- 172.21.15.77:0/3624861320 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168106a80 0x7f7168106e60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 -- 172.21.15.77:0/3624861320 >> 172.21.15.77:0/3624861320 conn(0x7f71680fc7a0 msgr2=0x7f71680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 -- 172.21.15.77:0/3624861320 shutdown_connections 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.700+0000 7f716f463640 1 -- 172.21.15.77:0/3624861320 wait complete. 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 Processor -- start 2024-09-15T23:31:30.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 -- start start 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f71681984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168106a80 0x7f716819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111fa0 con 0x7f7168101420 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7168111e20 con 0x7f7168106a80 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716f463640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7168112120 con 0x7f7168100a80 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34326/0 (socket says 172.21.15.77:34326) 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 -- 172.21.15.77:0/3411260936 learned_addr learned my addr 172.21.15.77:0/3411260936 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:30.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716da00640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168106a80 0x7f716819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716d1ff640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f71681984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 -- 172.21.15.77:0/3411260936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 msgr2=0x7f71681984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f71681984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 -- 172.21.15.77:0/3411260936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168106a80 msgr2=0x7f716819cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168106a80 0x7f716819cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 -- 172.21.15.77:0/3411260936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f716819d450 con 0x7f7168101420 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716d1ff640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f71681984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.701+0000 7f716c9fe640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f715800e9f0 tx=0x7f715800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.702+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715800cd80 con 0x7f7168101420 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.702+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7158005500 con 0x7f7168101420 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.702+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f716819d740 con 0x7f7168101420 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.702+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7158010690 con 0x7f7168101420 2024-09-15T23:31:30.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.702+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71681a5020 con 0x7f7168101420 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.703+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7168100ee0 con 0x7f7168101420 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.704+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f71580046c0 con 0x7f7168101420 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.705+0000 7f715e7fc640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 0x7f71540a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.705+0000 7f716d1ff640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 0x7f71540a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.705+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f71580d0530 con 0x7f7168101420 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.705+0000 7f716d1ff640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 0x7f71540a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f80 tx=0x7f7164031430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:30.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.708+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f71580541b0 con 0x7f7168101420 2024-09-15T23:31:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.949+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7168199800 con 0x7f7168101420 2024-09-15T23:31:30.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.950+0000 7f715e7fc640 1 -- 172.21.15.77:0/3411260936 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f7168199800 con 0x7f7168101420 2024-09-15T23:31:30.951 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:30.952 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:30.952 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 msgr2=0x7f71540a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 0x7f71540a5810 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7164000f80 tx=0x7f7164031430 comp rx=0 tx=0).stop 2024-09-15T23:31:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 msgr2=0x7f71681989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f715800e9f0 tx=0x7f715800edf0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 shutdown_connections 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f71540a3350 0x7f71540a5810 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7168106a80 0x7f716819cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7168101420 0x7f71681989e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 --2- 172.21.15.77:0/3411260936 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7168100a80 0x7f71681984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 >> 172.21.15.77:0/3411260936 conn(0x7f71680fc7a0 msgr2=0x7f71680fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 shutdown_connections 2024-09-15T23:31:30.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:30.952+0000 7f716f463640 1 -- 172.21.15.77:0/3411260936 wait complete. 2024-09-15T23:31:31.174 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:30 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:31:31.174 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:30 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3411260936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:31.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:30 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:31:31.292 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:30 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3411260936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:30 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:31:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:30 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3411260936' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:32.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:32.570 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:33.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:32 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.023 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:32 smithi077 ceph-mon[30968]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:32 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:32 smithi155 ceph-mon[35631]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:33.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1264416724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201036f0 msgr2=0x7f0e2010bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:33.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1264416724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201036f0 0x7f0e2010bbe0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009900 tx=0x7f0e0c02a480 comp rx=0 tx=0).stop 2024-09-15T23:31:33.131 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1264416724 shutdown_connections 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1264416724 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e2010c1b0 0x7f0e2010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1264416724 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e201036f0 0x7f0e2010bbe0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1264416724 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e20102dd0 0x7f0e201031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1264416724 >> 172.21.15.77:0/1264416724 conn(0x7f0e200fc7d0 msgr2=0x7f0e200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1264416724 shutdown_connections 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.104+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1264416724 wait complete. 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 Processor -- start 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 -- start start 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e20102dd0 0x7f0e20198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e201036f0 0x7f0e20198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:33.132 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20111fd0 con 0x7f0e2010c1b0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20111e50 con 0x7f0e20102dd0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e26c6e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20112150 con 0x7f0e201036f0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34350/0 (socket says 172.21.15.77:34350) 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 -- 172.21.15.77:0/1273836769 learned_addr learned my addr 172.21.15.77:0/1273836769 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e1ffff640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e201036f0 0x7f0e20198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e24a0a640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e20102dd0 0x7f0e20198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 -- 172.21.15.77:0/1273836769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e201036f0 msgr2=0x7f0e20198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e201036f0 0x7f0e20198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 -- 172.21.15.77:0/1273836769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e20102dd0 msgr2=0x7f0e20198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e20102dd0 0x7f0e20198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.105+0000 7f0e2520b640 1 -- 172.21.15.77:0/1273836769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2019d540 con 0x7f0e2010c1b0 2024-09-15T23:31:33.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e2520b640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cad0 tx=0x7f0e1800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800ae20 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2019d830 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0e18005020 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800f6f0 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.106+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e201a5110 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.107+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e201031b0 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.108+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0e180051d0 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.109+0000 7f0e1dffb640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 0x7f0e100a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.109+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f0e180cfe60 con 0x7f0e2010c1b0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.109+0000 7f0e24a0a640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 0x7f0e100a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.109+0000 7f0e24a0a640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 0x7f0e100a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e14005fd0 tx=0x7f0e14005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:33.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.113+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0e18014030 con 0x7f0e2010c1b0 2024-09-15T23:31:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:32 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:32 smithi159 ceph-mon[35472]: pgmap v349: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:33.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.353+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0e201071f0 con 0x7f0e2010c1b0 2024-09-15T23:31:33.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.353+0000 7f0e1dffb640 1 -- 172.21.15.77:0/1273836769 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f0e1809c690 con 0x7f0e2010c1b0 2024-09-15T23:31:33.355 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:33.355 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:33.355 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 msgr2=0x7f0e100a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 0x7f0e100a5790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0e14005fd0 tx=0x7f0e14005850 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 msgr2=0x7f0e2019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800cad0 tx=0x7f0e1800cf90 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 shutdown_connections 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0e100a32d0 0x7f0e100a5790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0e2010c1b0 0x7f0e2019ce60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0e201036f0 0x7f0e20198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 --2- 172.21.15.77:0/1273836769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0e20102dd0 0x7f0e20198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.355+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 >> 172.21.15.77:0/1273836769 conn(0x7f0e200fc7d0 msgr2=0x7f0e200fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.356+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 shutdown_connections 2024-09-15T23:31:33.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:33.356+0000 7f0e26c6e640 1 -- 172.21.15.77:0/1273836769 wait complete. 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:33 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1273836769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:34.083 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:33 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1273836769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:34.329 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:34.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:31:34.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:31:34.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:31:34.365 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:33 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1273836769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:34.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- 172.21.15.77:0/2452318853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 msgr2=0x7f88a8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:34.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 --2- 172.21.15.77:0/2452318853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a8105920 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8898009900 tx=0x7f889802a470 comp rx=0 tx=0).stop 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- 172.21.15.77:0/2452318853 shutdown_connections 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 --2- 172.21.15.77:0/2452318853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 0x7f88a81063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 --2- 172.21.15.77:0/2452318853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a8105920 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 --2- 172.21.15.77:0/2452318853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 0x7f88a8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- 172.21.15.77:0/2452318853 >> 172.21.15.77:0/2452318853 conn(0x7f88a80fc7a0 msgr2=0x7f88a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- 172.21.15.77:0/2452318853 shutdown_connections 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- 172.21.15.77:0/2452318853 wait complete. 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 Processor -- start 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.796+0000 7f88af743640 1 -- start start 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 0x7f88a81a4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 0x7f88a819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f88a8118540 con 0x7f88a8101450 2024-09-15T23:31:34.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81183c0 con 0x7f88a8100b30 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88af743640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f88a81186c0 con 0x7f88a8105f40 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34358/0 (socket says 172.21.15.77:34358) 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 -- 172.21.15.77:0/1222486376 learned_addr learned my addr 172.21.15.77:0/1222486376 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88ad4df640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 0x7f88a81a4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88adce0640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 0x7f88a819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 -- 172.21.15.77:0/1222486376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 msgr2=0x7f88a819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 0x7f88a819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 -- 172.21.15.77:0/1222486376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 msgr2=0x7f88a81a4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 0x7f88a81a4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.797+0000 7f88accde640 1 -- 172.21.15.77:0/1222486376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a819efb0 con 0x7f88a8101450 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f88accde640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8898006010 tx=0x7f88980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:34.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889803f030 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8898003ce0 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898035070 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a819f240 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.798+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a81ab4f0 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.799+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a806b070 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.800+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8898042030 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.801+0000 7f889e7fc640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 0x7f88940a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.801+0000 7f88ad4df640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 0x7f88940a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.801+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f88980f0640 con 0x7f88a8101450 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.801+0000 7f88ad4df640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 0x7f88940a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88a400bbc0 tx=0x7f88a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:34.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.804+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f88980bced0 con 0x7f88a8101450 2024-09-15T23:31:34.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.973+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88a81ab6c0 con 0x7f88a8101450 2024-09-15T23:31:34.974 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:34 smithi077 ceph-mon[30968]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:34.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.975+0000 7f889e7fc640 1 -- 172.21.15.77:0/1222486376 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7f88980bc7d0 con 0x7f88a8101450 2024-09-15T23:31:34.977 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:34.977 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 msgr2=0x7f88940a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 0x7f88940a5790 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f88a400bbc0 tx=0x7f88a400b390 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 msgr2=0x7f88a81a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8898006010 tx=0x7f88980042f0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 shutdown_connections 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f88940a32d0 0x7f88940a5790 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f88a8105f40 0x7f88a819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f88a8101450 0x7f88a81a4bd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 --2- 172.21.15.77:0/1222486376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f88a8100b30 0x7f88a81a4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.977+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 >> 172.21.15.77:0/1222486376 conn(0x7f88a80fc7a0 msgr2=0x7f88a81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:34.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.978+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 shutdown_connections 2024-09-15T23:31:34.980 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:34.978+0000 7f88af743640 1 -- 172.21.15.77:0/1222486376 wait complete. 2024-09-15T23:31:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:34 smithi159 ceph-mon[35472]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:34 smithi155 ceph-mon[35631]: pgmap v350: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:35.641 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:29:31.287245+0000', 'modified': '2024-09-15T23:30:13.582797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6839/1912555419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1912555419}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1912555419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.159:6839/2481115545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 2481115545}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 2481115545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24460, 'qdb_cluster': [24460]} 2024-09-15T23:31:35.642 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:31:35.642 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T23:31:35.916 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:36.164 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:35 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1222486376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:35 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1222486376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:36.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:35 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1222486376' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 -- 172.21.15.77:0/4247187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4106a80 msgr2=0x7fe2c4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/4247187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4106a80 0x7fe2c4106e60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009930 tx=0x7fe2b402a420 comp rx=0 tx=0).stop 2024-09-15T23:31:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 -- 172.21.15.77:0/4247187999 shutdown_connections 2024-09-15T23:31:36.405 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/4247187999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 0x7fe2c410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/4247187999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4100a80 0x7fe2c4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/4247187999 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4106a80 0x7fe2c4106e60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 -- 172.21.15.77:0/4247187999 >> 172.21.15.77:0/4247187999 conn(0x7fe2c40fc7a0 msgr2=0x7fe2c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 -- 172.21.15.77:0/4247187999 shutdown_connections 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.399+0000 7fe2c8e10640 1 -- 172.21.15.77:0/4247187999 wait complete. 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 Processor -- start 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 -- start start 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 0x7fe2c41999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 0x7fe2c41a4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4110f20 con 0x7fe2c4100a80 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4110da0 con 0x7fe2c4101420 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c8e10640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c41110a0 con 0x7fe2c4106a80 2024-09-15T23:31:36.406 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34368/0 (socket says 172.21.15.77:34368) 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c259c640 1 -- 172.21.15.77:0/3646549743 learned_addr learned my addr 172.21.15.77:0/3646549743 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 0x7fe2c41a4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.400+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 0x7fe2c41999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 -- 172.21.15.77:0/3646549743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 msgr2=0x7fe2c41a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 0x7fe2c41a4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 -- 172.21.15.77:0/3646549743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 msgr2=0x7fe2c41999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 0x7fe2c41999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 -- 172.21.15.77:0/3646549743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c41a4a50 con 0x7fe2c4100a80 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 0x7fe2c41a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c259c640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009a50 tx=0x7fe2b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/3646549743 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b403f030 con 0x7fe2c4100a80 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/3646549743 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2b4003ce0 con 0x7fe2c4100a80 2024-09-15T23:31:36.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c41a4c20 con 0x7fe2c4100a80 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/3646549743 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4035070 con 0x7fe2c4100a80 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.401+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c41a5070 con 0x7fe2c4100a80 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.403+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/3646549743 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe2b4042030 con 0x7fe2c4100a80 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 Processor -- start 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 -- start start 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264842f0 0x55f32648e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326490fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f3263ea090 con 0x55f3264839d0 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f326391a70 con 0x55f32648ebb0 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f3263e6050 con 0x55f3264842f0 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2bb7fe640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 0x7fe2b00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34370/0 (socket says 172.21.15.77:34370) 2024-09-15T23:31:36.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/1508090298 learned_addr learned my addr 172.21.15.77:0/1508090298 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:36.412 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326490fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.404+0000 7fe2c259c640 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264842f0 0x55f32648e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 0x7fe2b00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2bb7fe640 1 -- 172.21.15.77:0/3646549743 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe2b40f0330 con 0x7fe2c4100a80 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/1508090298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264842f0 msgr2=0x55f32648e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264842f0 0x55f32648e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/1508090298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 msgr2=0x55f326490fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326490fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/1508090298 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f32639e130 con 0x55f3264839d0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00cbf0 tx=0x7fe2bc007680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49859a011e6e594d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1508090298 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc015070 con 0x55f3264839d0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1508090298 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2bc01e070 con 0x55f3264839d0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2b8ff9640 1 -- 172.21.15.77:0/1508090298 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc022d10 con 0x55f3264839d0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.405+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 0x7fe2b00a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc023000 tx=0x7fe2bc01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1508090298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 msgr2=0x55f326483db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00cbf0 tx=0x7fe2bc007680 comp rx=0 tx=0).stop 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1508090298 shutdown_connections 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326490fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264842f0 0x55f32648e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1508090298 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264839d0 0x55f326483db0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1508090298 >> 172.21.15.77:0/1508090298 conn(0x55f32647ff60 msgr2=0x55f326480340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1508090298 shutdown_connections 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1508090298 wait complete. 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 -- start start 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.406+0000 7fe2cb1e9740 1 Processor -- start 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264839d0 0x55f32648e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 0x55f32648bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f326491780 con 0x55f3264842f0 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f3263a4f20 con 0x55f3264839d0 2024-09-15T23:31:36.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f326491900 con 0x55f32648ebb0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2cb1e9740 10 client.0 _ll_register_callbacks cb 0x55f32636e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34376/0 (socket says 172.21.15.77:34376) 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/446322545 learned_addr learned my addr 172.21.15.77:0/446322545 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c259c640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264839d0 0x55f32648e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 0x55f32648bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 msgr2=0x55f32648bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 0x55f32648bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/446322545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264839d0 msgr2=0x55f32648e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264839d0 0x55f32648e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/446322545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f32615b2b0 con 0x55f3264842f0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 0x55f32648bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00bf90 tx=0x7fe2ac00f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1958afadb5892df3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.407+0000 7fe2a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:36.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac018020 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2bc01e070 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe2ac014870 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac023050 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 10 client.15123 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f32649d180 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2bc01e070 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe2ac013b50 con 0x55f3264842f0 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 10 client.15123 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 10 client.15123 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 20 client.15123 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:36.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32649f840 0x55f3264a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 4 client.15123 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.408+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3263f7600 con 0x55f32649f840 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.409+0000 7fe2c259c640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32649f840 0x55f3264a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.409+0000 7fe2c259c640 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32649f840 0x55f3264a0cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccde3979efa96de6 server_cookie=834379ff78f1548b in_seq=0 out_seq=0 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.409+0000 7fe2a9ffb640 10 client.15123 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/446322545 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f3263f7600 con 0x55f32649f840 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2a9ffb640 10 client.15123 handle_command_reply: tid=0 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 client.15123 shutdown 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 msgr2=0x55f32648b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00bf90 tx=0x7fe2ac00f670 comp rx=0 tx=0).stop 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 shutdown_connections 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32649f840 0x55f3264a0cb0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f32648ebb0 0x55f32648bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f32648b7b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/446322545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264839d0 0x55f32648e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 >> 172.21.15.77:0/446322545 conn(0x55f32647ff60 msgr2=0x55f326485c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2a9ffb640 0 client.15123 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:36.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 shutdown_connections 2024-09-15T23:31:36.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/446322545 wait complete. 2024-09-15T23:31:36.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.410+0000 7fe2cb1e9740 20 client.15123 trim_cache size 0 max 16384 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.427+0000 7fe2cb1e9740 1 Processor -- start 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 -- start start 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f32648a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264842f0 0x55f3264a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f32649eff0 con 0x55f32648ebb0 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f32649f6c0 con 0x55f3264842f0 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f32649fd90 con 0x55f3264839d0 2024-09-15T23:31:36.431 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34384/0 (socket says 172.21.15.77:34384) 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/2471359079 learned_addr learned my addr 172.21.15.77:0/2471359079 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c259c640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f32648a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/2471359079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 msgr2=0x55f32648a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f32648a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/2471359079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264842f0 msgr2=0x55f3264a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264842f0 0x55f3264a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264842f0 0x55f3264a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 -- 172.21.15.77:0/2471359079 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f32648c2f0 con 0x55f32648ebb0 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c259c640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f32648a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.428+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007b80 tx=0x7fe2bc009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73bc9b5af838bd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2abfff640 1 -- 172.21.15.77:0/2471359079 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc02f020 con 0x55f32648ebb0 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2abfff640 1 -- 172.21.15.77:0/2471359079 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2bc016040 con 0x55f32648ebb0 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2abfff640 1 -- 172.21.15.77:0/2471359079 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc015040 con 0x55f32648ebb0 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/2471359079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 msgr2=0x55f3264a94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc007b80 tx=0x7fe2bc009ce0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/2471359079 shutdown_connections 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f32648ebb0 0x55f3264a94d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f3264842f0 0x55f3264a8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/2471359079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f32648a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/2471359079 >> 172.21.15.77:0/2471359079 conn(0x55f32647ff60 msgr2=0x55f32648a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.429+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/2471359079 shutdown_connections 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/2471359079 wait complete. 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 -- start start 2024-09-15T23:31:36.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 Processor -- start 2024-09-15T23:31:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f3264a4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326507f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f3264a0b30 con 0x55f3264842f0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f3264a0460 con 0x55f32648ebb0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f3264a1200 con 0x55f3264839d0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2cb1e9740 10 client.0 _ll_register_callbacks cb 0x7fe2ac00b2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2c1d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34388/0 (socket says 172.21.15.77:34388) 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.430+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/1366239690 learned_addr learned my addr 172.21.15.77:0/1366239690 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c2d9d640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326507f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c259c640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f3264a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 msgr2=0x55f3264a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f3264a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/1366239690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 msgr2=0x55f326507f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326507f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 -- 172.21.15.77:0/1366239690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f326508480 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2c1d9b640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac001eb0 tx=0x7fe2ac00ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b78e24c4cc0faa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac02b070 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe2ac01cdc0 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2bc016040 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe2ac037050 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2cb1e9740 10 client.15129 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.431+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f326509570 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe2bc016040 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe2ac014b50 con 0x55f3264842f0 2024-09-15T23:31:36.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 10 client.15129 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 10 client.15129 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 20 client.15129 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32650e0b0 0x55f32650cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 4 client.15129 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "status"}) -- 0x55f3263f1b10 con 0x55f32650e0b0 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.432+0000 7fe2c259c640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32650e0b0 0x55f32650cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:36.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2c259c640 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32650e0b0 0x55f32650cdc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7468a65db363f0d3 server_cookie=958067c2ec392c43 in_seq=0 out_seq=0 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2a9ffb640 10 client.15129 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2a9ffb640 1 -- 172.21.15.77:0/1366239690 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f3263f1b10 con 0x55f32650e0b0 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2a9ffb640 10 client.15129 handle_command_reply: tid=0 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 client.15129 shutdown 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 msgr2=0x55f3264a4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac001eb0 tx=0x7fe2ac00ba90 comp rx=0 tx=0).stop 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 shutdown_connections 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f32650e0b0 0x55f32650cdc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f32648ebb0 0x55f326507f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f3264842f0 0x55f3264a4650 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 --2- 172.21.15.77:0/1366239690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f3264839d0 0x55f3264a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2a9ffb640 0 client.15129 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:36.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 >> 172.21.15.77:0/1366239690 conn(0x55f32647ff60 msgr2=0x55f32648a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 shutdown_connections 2024-09-15T23:31:36.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 1 -- 172.21.15.77:0/1366239690 wait complete. 2024-09-15T23:31:36.442 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.433+0000 7fe2cb1e9740 20 client.15129 trim_cache size 0 max 16384 2024-09-15T23:31:36.442 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:31:36.442 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24460, 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 124.73839022600001, 2024-09-15T23:31:36.443 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-09-15T23:31:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 91, 2024-09-15T23:31:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T23:31:36.444 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 144.49495968799999 2024-09-15T23:31:36.444 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:31:36.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 msgr2=0x7fe2b00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 0x7fe2b00a5700 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc023000 tx=0x7fe2bc01e000 comp rx=0 tx=0).stop 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 msgr2=0x7fe2c4199490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4009a50 tx=0x7fe2b4004270 comp rx=0 tx=0).stop 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 shutdown_connections 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe2b00a3240 0x7fe2b00a5700 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe2c4106a80 0x7fe2c41a4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe2c4101420 0x7fe2c41999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 --2- 172.21.15.77:0/3646549743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe2c4100a80 0x7fe2c4199490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 >> 172.21.15.77:0/3646549743 conn(0x7fe2c40fc7a0 msgr2=0x7fe2c40fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 shutdown_connections 2024-09-15T23:31:36.446 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:36.434+0000 7fe2c8e10640 1 -- 172.21.15.77:0/3646549743 wait complete. 2024-09-15T23:31:37.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:36 smithi077 ceph-mon[30968]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:37.049 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:36 smithi077 ceph-mon[30968]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T23:31:37.077 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T23:31:37.086 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T23:31:37.086 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T23:31:37.087 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T23:31:37.087 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T23:31:37.140 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T23:31:37.140 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-15T23:31:37.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:37.140 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-15T23:31:37.157 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T23:31:37.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:37.158 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T23:31:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:36 smithi159 ceph-mon[35472]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:36 smithi159 ceph-mon[35472]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T23:31:37.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:37.225 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-15T23:31:37.329 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-15T23:31:37.329 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T23:31:37.329 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:31:37.329 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-15T23:31:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:36 smithi155 ceph-mon[35631]: pgmap v351: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-15T23:31:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:36 smithi155 ceph-mon[35631]: mgrmap e18: x(active, since 9m), standbys: z, y 2024-09-15T23:31:37.575 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 -- 172.21.15.77:0/2351098806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380106a80 msgr2=0x7f4380106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 --2- 172.21.15.77:0/2351098806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380106a80 0x7f4380106e60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f437c009930 tx=0x7f437c02a420 comp rx=0 tx=0).stop 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 -- 172.21.15.77:0/2351098806 shutdown_connections 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 --2- 172.21.15.77:0/2351098806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380101420 0x7f438010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 --2- 172.21.15.77:0/2351098806 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380100a80 0x7f4380100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 --2- 172.21.15.77:0/2351098806 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380106a80 0x7f4380106e60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 -- 172.21.15.77:0/2351098806 >> 172.21.15.77:0/2351098806 conn(0x7f43800fc7a0 msgr2=0x7f43800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:38.208 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 -- 172.21.15.77:0/2351098806 shutdown_connections 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.062+0000 7f4386aaf640 1 -- 172.21.15.77:0/2351098806 wait complete. 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 Processor -- start 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 -- start start 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380101420 0x7f4380198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380106a80 0x7f438019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4380110ea0 con 0x7f4380100a80 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4380110d20 con 0x7f4380101420 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f4386aaf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4380111020 con 0x7f4380106a80 2024-09-15T23:31:38.209 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f438484b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f438484b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46100/0 (socket says 172.21.15.77:46100) 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.063+0000 7f438484b640 1 -- 172.21.15.77:0/3239112676 learned_addr learned my addr 172.21.15.77:0/3239112676 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438504c640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380106a80 0x7f438019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4377fff640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380101420 0x7f4380198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 -- 172.21.15.77:0/3239112676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380106a80 msgr2=0x7f438019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380106a80 0x7f438019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 -- 172.21.15.77:0/3239112676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380101420 msgr2=0x7f4380198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380101420 0x7f4380198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 -- 172.21.15.77:0/3239112676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438019d4d0 con 0x7f4380100a80 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f438484b640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f437c009a50 tx=0x7f437c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:38.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c03f030 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f437c003ce0 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438019d760 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437c035070 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.064+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43801a50a0 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.065+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43801021c0 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.067+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f437c042030 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.067+0000 7f4375ffb640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 0x7f43680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.067+0000 7f4377fff640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 0x7f43680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.067+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f437c0f0350 con 0x7f4380100a80 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.068+0000 7f4377fff640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 0x7f43680a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4380105210 tx=0x7f4370008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:38.211 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.071+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f437c0bcc80 con 0x7f4380100a80 2024-09-15T23:31:38.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.273+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f438010a000 con 0x7f4380100a80 2024-09-15T23:31:38.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.274+0000 7f4375ffb640 1 -- 172.21.15.77:0/3239112676 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+88 (secure 0 0 0) 0x7f437c0bc580 con 0x7f4380100a80 2024-09-15T23:31:38.275 INFO:teuthology.orchestra.run.smithi077.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 msgr2=0x7f43680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 0x7f43680a5700 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4380105210 tx=0x7f4370008040 comp rx=0 tx=0).stop 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 msgr2=0x7f4380198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f437c009a50 tx=0x7f437c004270 comp rx=0 tx=0).stop 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 shutdown_connections 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f43680a3240 0x7f43680a5700 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4380106a80 0x7f438019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4380101420 0x7f4380198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 --2- 172.21.15.77:0/3239112676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4380100a80 0x7f4380198520 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:38.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 >> 172.21.15.77:0/3239112676 conn(0x7f43800fc7a0 msgr2=0x7f438006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:38.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 shutdown_connections 2024-09-15T23:31:38.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:38.276+0000 7f4386aaf640 1 -- 172.21.15.77:0/3239112676 wait complete. 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi077.front.sepia.ceph.com 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T23:31:38.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T23:31:38.901 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T23:31:38.901 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:31:38.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:38.901 DEBUG:teuthology.orchestra.run.smithi077:> ip addr 2024-09-15T23:31:38.919 INFO:teuthology.orchestra.run.smithi077.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T23:31:38.919 INFO:teuthology.orchestra.run.smithi077.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T23:31:38.919 INFO:teuthology.orchestra.run.smithi077.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T23:31:38.919 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:31:38.919 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 ::1/128 scope host 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d8 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f0 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:d8:d9:d9 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: altname enp7s0f1 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d2 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:31:38.920 INFO:teuthology.orchestra.run.smithi077.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T23:31:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: link/ether 0c:c4:7a:8f:d3:d3 brd ff:ff:ff:ff:ff:ff 2024-09-15T23:31:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: inet 172.21.15.77/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-15T23:31:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-09-15T23:31:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: inet6 fe80::ec4:7aff:fe8f:d3d3/64 scope link noprefixroute 2024-09-15T23:31:38.921 INFO:teuthology.orchestra.run.smithi077.stdout: valid_lft forever preferred_lft forever 2024-09-15T23:31:38.921 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add name ceph-brx type bridge 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr flush dev ceph-brx 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set ceph-brx up 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T23:31:38.922 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:31:39.010 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:39.018 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:38 smithi077 ceph-mon[30968]: pgmap v352: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:39.018 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:38 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3239112676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:31:39.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:39.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.062 DEBUG:teuthology.orchestra.run.smithi077:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T23:31:39.085 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-15T23:31:39.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.087 DEBUG:teuthology.orchestra.run.smithi077:> route 2024-09-15T23:31:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:Kernel IP routing table 2024-09-15T23:31:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T23:31:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T23:31:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T23:31:39.144 INFO:teuthology.orchestra.run.smithi077.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T23:31:39.145 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:31:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:38 smithi159 ceph-mon[35472]: pgmap v352: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:38 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3239112676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:31:39.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:39.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:39.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.270 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-15T23:31:39.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.286 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list-id 2024-09-15T23:31:39.341 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:31:39.342 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:31:39.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:31:39.342 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T23:31:39.342 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:31:39.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:38 smithi155 ceph-mon[35631]: pgmap v352: 129 pgs: 129 active+clean; 640 KiB data, 379 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:31:39.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:38 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3239112676' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-15T23:31:39.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:39.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:39.458 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T23:31:39.458 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:31:39.458 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T23:31:39.459 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:31:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:39.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:39.571 DEBUG:teuthology.orchestra.run.smithi077:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T23:31:39.571 DEBUG:teuthology.orchestra.run.smithi077:> set -e 2024-09-15T23:31:39.571 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set brx.0 up 2024-09-15T23:31:39.572 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T23:31:39.572 DEBUG:teuthology.orchestra.run.smithi077:> ') 2024-09-15T23:31:39.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:39.642 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:39.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:31:39.648 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T23:31:39.663 INFO:teuthology.orchestra.run.smithi077.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T23:31:39.663 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T23:31:39.663 DEBUG:teuthology.orchestra.run.smithi077:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:31:39.717 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-15T23:31:39.717 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-15T23:31:39.718 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/bfae9bf3-7de9-4f27-8020-9419b60ab028 2024-09-15T23:31:39.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.718 DEBUG:teuthology.orchestra.run.smithi077:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/bfae9bf3-7de9-4f27-8020-9419b60ab028 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T23:31:39.800 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T23:31:39.801 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-15T23:31:39.938 INFO:teuthology.orchestra.run.smithi077.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=crc,wsync,nofallback 2024-09-15T23:31:39.938 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync". 2024-09-15T23:31:39.938 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: resolved to: "172.21.15.77:3300,172.21.15.155:3300,172.21.15.159:3300" 2024-09-15T23:31:39.938 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: trying mount with new device syntax: 0@1be60238-73b9-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/bfae9bf3-7de9-4f27-8020-9419b60ab028 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=crc,wsync,name=0,key=0,mon_addr=172.21.15.77:3300/172.21.15.155:3300/172.21.15.159:3300" will pass to kernel 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: You just mounted a file system that supports labels which does not 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: applications will generate AVC messages and not be allowed access to 2024-09-15T23:31:39.939 INFO:teuthology.orchestra.run.smithi077.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-15T23:31:39.941 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T23:31:39.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:31:39.941 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T23:31:40.008 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:31:40.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:31:40.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:40.104 INFO:teuthology.orchestra.run.smithi077.stdout:client15138 2024-09-15T23:31:40.104 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:31:40.104 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:31:40.122 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:31:40.210 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:31:40.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:40.218 INFO:teuthology.orchestra.run.smithi077.stdout:client15138 2024-09-15T23:31:40.218 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T23:31:40.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T23:31:40.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:40.273 INFO:teuthology.orchestra.run.smithi077.stdout:client15138 2024-09-15T23:31:40.273 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/1be60238-73b9-11ef-bceb-c7b262605968.client15138/status') 2024-09-15T23:31:40.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T23:31:40.331 INFO:teuthology.orchestra.run.smithi077.stdout:instance: client.15138 (3)192.168.0.1:0/2671958760 2024-09-15T23:31:40.331 INFO:teuthology.orchestra.run.smithi077.stdout:blocklisted: false 2024-09-15T23:31:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records in 2024-09-15T23:31:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:0+1 records out 2024-09-15T23:31:40.331 INFO:teuthology.orchestra.run.smithi077.stderr:70 bytes copied, 2.0589e-05 s, 3.4 MB/s 2024-09-15T23:31:40.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T23:31:40.338 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-15T23:31:40.349 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-15T23:31:40.431 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:31:40.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 -- 172.21.15.77:0/4233314528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3841056a0 msgr2=0x7fb384105b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.533 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 --2- 172.21.15.77:0/4233314528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3841056a0 0x7fb384105b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb37c009ca0 tx=0x7fb37c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 -- 172.21.15.77:0/4233314528 shutdown_connections 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 --2- 172.21.15.77:0/4233314528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3841056a0 0x7fb384105b50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 --2- 172.21.15.77:0/4233314528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb384102cf0 0x7fb384105160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 --2- 172.21.15.77:0/4233314528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 0x7fb3841027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 -- 172.21.15.77:0/4233314528 >> 172.21.15.77:0/4233314528 conn(0x7fb3840fc1b0 msgr2=0x7fb3840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 -- 172.21.15.77:0/4233314528 shutdown_connections 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.530+0000 7fb38c065640 1 -- 172.21.15.77:0/4233314528 wait complete. 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 Processor -- start 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 -- start start 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 0x7fb38419e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 0x7fb3841a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb384113de0 con 0x7fb384102cf0 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb384113c60 con 0x7fb3841056a0 2024-09-15T23:31:40.534 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38c065640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb384113f60 con 0x7fb3841003a0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46112/0 (socket says 172.21.15.77:46112) 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 -- 172.21.15.77:0/3324895628 learned_addr learned my addr 172.21.15.77:0/3324895628 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38a602640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 0x7fb3841a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389e01640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 0x7fb38419e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 -- 172.21.15.77:0/3324895628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 msgr2=0x7fb38419e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 0x7fb38419e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 -- 172.21.15.77:0/3324895628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 msgr2=0x7fb3841a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 0x7fb3841a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 -- 172.21.15.77:0/3324895628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3841a6040 con 0x7fb384102cf0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb38a602640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 0x7fb3841a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.531+0000 7fb389600640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e9f0 tx=0x7fb37400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.532+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37400cd80 con 0x7fb384102cf0 2024-09-15T23:31:40.535 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.532+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb374010910 con 0x7fb384102cf0 2024-09-15T23:31:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.532+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374018990 con 0x7fb384102cf0 2024-09-15T23:31:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.532+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3841a6330 con 0x7fb384102cf0 2024-09-15T23:31:40.536 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.532+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3841a6880 con 0x7fb384102cf0 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.533+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3840fdca0 con 0x7fb384102cf0 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.534+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb374010ac0 con 0x7fb384102cf0 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.534+0000 7fb37affd640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 0x7fb3700a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.534+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb3740d0110 con 0x7fb384102cf0 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.534+0000 7fb389e01640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 0x7fb3700a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.537 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.535+0000 7fb389e01640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 0x7fb3700a5710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb380005fd0 tx=0x7fb380005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:40.539 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.539+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb37409caa0 con 0x7fb384102cf0 2024-09-15T23:31:40.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.706+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb384062e20 con 0x7fb384102cf0 2024-09-15T23:31:40.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.707+0000 7fb37affd640 1 -- 172.21.15.77:0/3324895628 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7fb37409c3a0 con 0x7fb384102cf0 2024-09-15T23:31:40.709 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:40.709 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:31:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 msgr2=0x7fb3700a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 0x7fb3700a5710 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb380005fd0 tx=0x7fb380005850 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 msgr2=0x7fb38419e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb37400e9f0 tx=0x7fb37400eeb0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 shutdown_connections 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3700a3250 0x7fb3700a5710 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3841056a0 0x7fb3841a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb384102cf0 0x7fb38419e960 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 --2- 172.21.15.77:0/3324895628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3841003a0 0x7fb38419e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 >> 172.21.15.77:0/3324895628 conn(0x7fb3840fc1b0 msgr2=0x7fb3841035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 shutdown_connections 2024-09-15T23:31:40.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.709+0000 7fb38c065640 1 -- 172.21.15.77:0/3324895628 wait complete. 2024-09-15T23:31:40.722 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:24:50.012656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:29:26.912021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:29:29.489806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T23:29:35.970801+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T23:31:40.723 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- 172.21.15.77:0/4116018753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c104f50 msgr2=0x7f8d7c107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 --2- 172.21.15.77:0/4116018753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c104f50 0x7f8d7c107340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009900 tx=0x7f8d6c02a410 comp rx=0 tx=0).stop 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- 172.21.15.77:0/4116018753 shutdown_connections 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 --2- 172.21.15.77:0/4116018753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c107880 0x7f8d7c109c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 --2- 172.21.15.77:0/4116018753 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c104f50 0x7f8d7c107340 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 --2- 172.21.15.77:0/4116018753 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c102620 0x7f8d7c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.828 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- 172.21.15.77:0/4116018753 >> 172.21.15.77:0/4116018753 conn(0x7f8d7c0fc140 msgr2=0x7f8d7c0fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- 172.21.15.77:0/4116018753 shutdown_connections 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- 172.21.15.77:0/4116018753 wait complete. 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 Processor -- start 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.825+0000 7f8d838f1640 1 -- start start 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c102620 0x7f8d7c198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 0x7f8d7c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10d890 con 0x7f8d7c107880 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10d710 con 0x7f8d7c104f50 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c10da10 con 0x7f8d7c102620 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46144/0 (socket says 172.21.15.77:46144) 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 -- 172.21.15.77:0/1620379321 learned_addr learned my addr 172.21.15.77:0/1620379321 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:40.829 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d8168d640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c102620 0x7f8d7c198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d80e8c640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 0x7f8d7c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 -- 172.21.15.77:0/1620379321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c102620 msgr2=0x7f8d7c198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c102620 0x7f8d7c198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 -- 172.21.15.77:0/1620379321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 msgr2=0x7f8d7c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 0x7f8d7c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 -- 172.21.15.77:0/1620379321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c19fc50 con 0x7f8d7c107880 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d80e8c640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 0x7f8d7c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d81e8e640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800b3f0 tx=0x7f8d7800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78015020 con 0x7f8d7c107880 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d78011d10 con 0x7f8d7c107880 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c19ff40 con 0x7f8d7c107880 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.826+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800f2e0 con 0x7f8d7c107880 2024-09-15T23:31:40.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.827+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c1a03d0 con 0x7f8d7c107880 2024-09-15T23:31:40.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.828+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c0fdc30 con 0x7f8d7c107880 2024-09-15T23:31:40.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.829+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8d78018020 con 0x7f8d7c107880 2024-09-15T23:31:40.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.829+0000 7f8d727fc640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 0x7f8d680a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:40.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.830+0000 7f8d8168d640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 0x7f8d680a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:40.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.830+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f8d780cf570 con 0x7f8d7c107880 2024-09-15T23:31:40.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.830+0000 7f8d8168d640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 0x7f8d680a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400a400 tx=0x7f8d7400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:40.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:40.834+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f8d7801f020 con 0x7f8d7c107880 2024-09-15T23:31:41.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.003+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d7c062e90 con 0x7f8d7c107880 2024-09-15T23:31:41.005 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.004+0000 7f8d727fc640 1 -- 172.21.15.77:0/1620379321 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7f8d7809bf00 con 0x7f8d7c107880 2024-09-15T23:31:41.005 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-09-15T23:31:41.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 msgr2=0x7f8d680a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 0x7f8d680a5710 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400a400 tx=0x7f8d7400d040 comp rx=0 tx=0).stop 2024-09-15T23:31:41.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 msgr2=0x7f8d7c19f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.007 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800b3f0 tx=0x7f8d7800b8b0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 shutdown_connections 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8d680a3250 0x7f8d680a5710 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8d7c107880 0x7f8d7c19f5e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d7c104f50 0x7f8d7c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 --2- 172.21.15.77:0/1620379321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d7c102620 0x7f8d7c198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 >> 172.21.15.77:0/1620379321 conn(0x7f8d7c0fc140 msgr2=0x7f8d7c102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 shutdown_connections 2024-09-15T23:31:41.008 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.006+0000 7f8d838f1640 1 -- 172.21.15.77:0/1620379321 wait complete. 2024-09-15T23:31:41.017 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:40 smithi077 ceph-mon[30968]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:41.017 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:40 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3324895628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:41.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 -- 172.21.15.77:0/2194185325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538101c20 msgr2=0x7fa5381020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/2194185325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538101c20 0x7fa5381020a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa524009900 tx=0x7fa52402a410 comp rx=0 tx=0).stop 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 -- 172.21.15.77:0/2194185325 shutdown_connections 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/2194185325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 0x7fa538108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/2194185325 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538101c20 0x7fa5381020a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/2194185325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538100a30 0x7fa538100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 -- 172.21.15.77:0/2194185325 >> 172.21.15.77:0/2194185325 conn(0x7fa5380fc1b0 msgr2=0x7fa5380fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 -- 172.21.15.77:0/2194185325 shutdown_connections 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.119+0000 7fa53ec1e640 1 -- 172.21.15.77:0/2194185325 wait complete. 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 Processor -- start 2024-09-15T23:31:41.123 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 -- start start 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538101c20 0x7fa538198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 0x7fa53819f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810d800 con 0x7fa538100a30 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810d680 con 0x7fa538101c20 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53ec1e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa53810d980 con 0x7fa5381025e0 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46162/0 (socket says 172.21.15.77:46162) 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 -- 172.21.15.77:0/253744226 learned_addr learned my addr 172.21.15.77:0/253744226 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53d1bb640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 0x7fa53819f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa537fff640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538101c20 0x7fa538198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 -- 172.21.15.77:0/253744226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 msgr2=0x7fa53819f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.124 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 0x7fa53819f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 -- 172.21.15.77:0/253744226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538101c20 msgr2=0x7fa538198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538101c20 0x7fa538198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 -- 172.21.15.77:0/253744226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa53819fb00 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.120+0000 7fa53c9ba640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d770 tx=0x7fa52c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.121+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c017070 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.121+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa52c009c30 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.121+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa53819fdf0 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.121+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa52c003dd0 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.121+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5381a0250 con 0x7fa538100a30 2024-09-15T23:31:41.125 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.122+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa538107f10 con 0x7fa538100a30 2024-09-15T23:31:41.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.123+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa52c003f70 con 0x7fa538100a30 2024-09-15T23:31:41.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.124+0000 7fa535ffb640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 0x7fa5280a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.124+0000 7fa537fff640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 0x7fa5280a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.124+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa52c0cf6f0 con 0x7fa538100a30 2024-09-15T23:31:41.126 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.124+0000 7fa537fff640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 0x7fa5280a5710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5381993f0 tx=0x7fa5240315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.128 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.127+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fa52c09c080 con 0x7fa538100a30 2024-09-15T23:31:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:40 smithi159 ceph-mon[35472]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:40 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3324895628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:41.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.294+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa538062630 con 0x7fa538100a30 2024-09-15T23:31:41.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.294+0000 7fa535ffb640 1 -- 172.21.15.77:0/253744226 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7fa52c009de0 con 0x7fa538100a30 2024-09-15T23:31:41.296 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.296+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 msgr2=0x7fa5280a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.296+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 0x7fa5280a5710 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa5381993f0 tx=0x7fa5240315b0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 msgr2=0x7fa538197ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa52c00d770 tx=0x7fa52c00dc30 comp rx=0 tx=0).stop 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 shutdown_connections 2024-09-15T23:31:41.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa5280a3250 0x7fa5280a5710 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5381025e0 0x7fa53819f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa538101c20 0x7fa538198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 --2- 172.21.15.77:0/253744226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa538100a30 0x7fa538197ee0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 >> 172.21.15.77:0/253744226 conn(0x7fa5380fc1b0 msgr2=0x7fa5381050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 shutdown_connections 2024-09-15T23:31:41.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.297+0000 7fa53ec1e640 1 -- 172.21.15.77:0/253744226 wait complete. 2024-09-15T23:31:41.309 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:31:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:40 smithi155 ceph-mon[35631]: pgmap v353: 129 pgs: 129 active+clean; 640 KiB data, 383 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:40 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3324895628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:41.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 -- 172.21.15.77:0/2067902034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 msgr2=0x7fc1b4104970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/2067902034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4104970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009900 tx=0x7fc1a402a410 comp rx=0 tx=0).stop 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 -- 172.21.15.77:0/2067902034 shutdown_connections 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/2067902034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b41077e0 0x7fc1b4109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/2067902034 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b4104eb0 0x7fc1b41072a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/2067902034 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4104970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 -- 172.21.15.77:0/2067902034 >> 172.21.15.77:0/2067902034 conn(0x7fc1b40fc140 msgr2=0x7fc1b40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 -- 172.21.15.77:0/2067902034 shutdown_connections 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 -- 172.21.15.77:0/2067902034 wait complete. 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.410+0000 7fc1b9a42640 1 Processor -- start 2024-09-15T23:31:41.414 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 -- start start 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b4104eb0 0x7fc1b41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b41077e0 0x7fc1b419f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b410d7f0 con 0x7fc1b4102580 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b410d670 con 0x7fc1b41077e0 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b9a42640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b410d970 con 0x7fc1b4104eb0 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46190/0 (socket says 172.21.15.77:46190) 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 -- 172.21.15.77:0/4083820417 learned_addr learned my addr 172.21.15.77:0/4083820417 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b27fc640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b4104eb0 0x7fc1b41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 -- 172.21.15.77:0/4083820417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b4104eb0 msgr2=0x7fc1b41984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.415 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b4104eb0 0x7fc1b41984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 -- 172.21.15.77:0/4083820417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b41077e0 msgr2=0x7fc1b419f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b37fe640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b41077e0 0x7fc1b419f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b41077e0 0x7fc1b419f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 -- 172.21.15.77:0/4083820417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b419fbb0 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b2ffd640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009230 tx=0x7fc1a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a403f030 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.411+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1a4003ce0 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.412+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b419fe40 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.412+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a4035070 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.412+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41a02a0 con 0x7fc1b4102580 2024-09-15T23:31:41.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.413+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b40fdc30 con 0x7fc1b4102580 2024-09-15T23:31:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.414+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc1a4042030 con 0x7fc1b4102580 2024-09-15T23:31:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.414+0000 7fc1b8a40640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 0x7fc19c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.414+0000 7fc1b27fc640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 0x7fc19c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.415+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fc1a40f06c0 con 0x7fc1b4102580 2024-09-15T23:31:41.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.415+0000 7fc1b27fc640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 0x7fc19c0a5710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1b41994a0 tx=0x7fc1a8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.418 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.417+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc1a40bd050 con 0x7fc1b4102580 2024-09-15T23:31:41.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.582+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc1b402da30 con 0x7fc1b4102580 2024-09-15T23:31:41.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.582+0000 7fc1b8a40640 1 -- 172.21.15.77:0/4083820417 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7fc1a40bc950 con 0x7fc1b4102580 2024-09-15T23:31:41.584 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-09-15T23:31:41.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 msgr2=0x7fc19c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 0x7fc19c0a5710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc1b41994a0 tx=0x7fc1a8005f90 comp rx=0 tx=0).stop 2024-09-15T23:31:41.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 msgr2=0x7fc1b4197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009230 tx=0x7fc1a40042f0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 shutdown_connections 2024-09-15T23:31:41.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc19c0a3250 0x7fc19c0a5710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc1b41077e0 0x7fc1b419f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b4104eb0 0x7fc1b41984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 --2- 172.21.15.77:0/4083820417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc1b4102580 0x7fc1b4197f90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 >> 172.21.15.77:0/4083820417 conn(0x7fc1b40fc140 msgr2=0x7fc1b4104380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 shutdown_connections 2024-09-15T23:31:41.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.584+0000 7fc1b9a42640 1 -- 172.21.15.77:0/4083820417 wait complete. 2024-09-15T23:31:41.596 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T23:31:41.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3180210016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a8100cf0 msgr2=0x7fb3a8101170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3180210016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8101170 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fb398009900 tx=0x7fb39802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:41.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3180210016 shutdown_connections 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3180210016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a81016b0 0x7fb3a8108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3180210016 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8101170 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3180210016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 0x7fb3a81023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3180210016 >> 172.21.15.77:0/3180210016 conn(0x7fb3a80fb950 msgr2=0x7fb3a80fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3180210016 shutdown_connections 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.698+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3180210016 wait complete. 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 Processor -- start 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 -- start start 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 0x7fb3a819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810d810 con 0x7fb3a81016b0 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810d690 con 0x7fb3a8101fc0 2024-09-15T23:31:41.702 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3b07cf640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a810d990 con 0x7fb3a8100cf0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46204/0 (socket says 172.21.15.77:46204) 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 -- 172.21.15.77:0/3169456584 learned_addr learned my addr 172.21.15.77:0/3169456584 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3aed6c640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 0x7fb3a819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3ae56b640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 -- 172.21.15.77:0/3169456584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a8100cf0 msgr2=0x7fb3a8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 -- 172.21.15.77:0/3169456584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 msgr2=0x7fb3a819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 0x7fb3a819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 -- 172.21.15.77:0/3169456584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a819fb30 con 0x7fb3a81016b0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.699+0000 7fb3add6a640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb398005940 tx=0x7fb3980042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.700+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39803f030 con 0x7fb3a81016b0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.700+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a819fdc0 con 0x7fb3a81016b0 2024-09-15T23:31:41.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.700+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb398003ce0 con 0x7fb3a81016b0 2024-09-15T23:31:41.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.700+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398035070 con 0x7fb3a81016b0 2024-09-15T23:31:41.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.700+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a81a0220 con 0x7fb3a81016b0 2024-09-15T23:31:41.704 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.701+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a8107ff0 con 0x7fb3a81016b0 2024-09-15T23:31:41.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.702+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb398042030 con 0x7fb3a81016b0 2024-09-15T23:31:41.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.702+0000 7fb39f7fe640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 0x7fb3940a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:41.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.703+0000 7fb3ae56b640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 0x7fb3940a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:41.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.703+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb3980f01d0 con 0x7fb3a81016b0 2024-09-15T23:31:41.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.703+0000 7fb3ae56b640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 0x7fb3940a5710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3a806a0e0 tx=0x7fb3a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:41.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.707+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fb3980bcb60 con 0x7fb3a81016b0 2024-09-15T23:31:41.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.874+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb3a8062e90 con 0x7fb3a81016b0 2024-09-15T23:31:41.876 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.875+0000 7fb39f7fe640 1 -- 172.21.15.77:0/3169456584 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7fb3980bc460 con 0x7fb3a81016b0 2024-09-15T23:31:41.877 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-09-15T23:31:41.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 msgr2=0x7fb3940a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 0x7fb3940a5710 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3a806a0e0 tx=0x7fb3a4005f90 comp rx=0 tx=0).stop 2024-09-15T23:31:41.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 msgr2=0x7fb3a8198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:41.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb398005940 tx=0x7fb3980042f0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 shutdown_connections 2024-09-15T23:31:41.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb3940a3250 0x7fb3940a5710 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a8101fc0 0x7fb3a819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb3a81016b0 0x7fb3a8198450 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 --2- 172.21.15.77:0/3169456584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3a8100cf0 0x7fb3a8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:41.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 >> 172.21.15.77:0/3169456584 conn(0x7fb3a80fb950 msgr2=0x7fb3a81051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:41.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 shutdown_connections 2024-09-15T23:31:41.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:41.877+0000 7fb3b07cf640 1 -- 172.21.15.77:0/3169456584 wait complete. 2024-09-15T23:31:41.890 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-15T23:31:41.890 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:42.141 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:41 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1620379321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:41 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/253744226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:41 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/4083820417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:41 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3169456584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.261 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:41 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1620379321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:41 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/253744226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:41 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4083820417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.262 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:41 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3169456584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:41 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1620379321' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:41 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/253744226' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:41 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/4083820417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:41 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3169456584' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:31:42.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.650+0000 7f0278a29640 1 -- 172.21.15.77:0/25473813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 msgr2=0x7f0274100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:42.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 --2- 172.21.15.77:0/25473813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274100ed0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f025c009930 tx=0x7f025c02a420 comp rx=0 tx=0).stop 2024-09-15T23:31:42.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 -- 172.21.15.77:0/25473813 shutdown_connections 2024-09-15T23:31:42.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 --2- 172.21.15.77:0/25473813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274101410 0x7f027410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 --2- 172.21.15.77:0/25473813 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274100ed0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 --2- 172.21.15.77:0/25473813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274106a70 0x7f0274106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 -- 172.21.15.77:0/25473813 >> 172.21.15.77:0/25473813 conn(0x7f02740fc790 msgr2=0x7f02740febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 -- 172.21.15.77:0/25473813 shutdown_connections 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 -- 172.21.15.77:0/25473813 wait complete. 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.651+0000 7f0278a29640 1 Processor -- start 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 -- start start 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274101410 0x7f0274199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 0x7f02741a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0274110e70 con 0x7f0274100a70 2024-09-15T23:31:42.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0274110cf0 con 0x7f0274106a70 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0278a29640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0274110ff0 con 0x7f0274101410 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46222/0 (socket says 172.21.15.77:46222) 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 -- 172.21.15.77:0/4107770567 learned_addr learned my addr 172.21.15.77:0/4107770567 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f026bfff640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274101410 0x7f0274199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0272d9d640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 0x7f02741a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 -- 172.21.15.77:0/4107770567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274101410 msgr2=0x7f0274199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274101410 0x7f0274199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 -- 172.21.15.77:0/4107770567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 msgr2=0x7f02741a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 0x7f02741a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 -- 172.21.15.77:0/4107770567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02741a48e0 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f0272d9d640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 0x7f02741a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.652+0000 7f027259c640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f026400e9f0 tx=0x7f026400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.653+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026400cd80 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.653+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0264010910 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.653+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02741a4ab0 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.653+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0264018990 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.653+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02741a4f70 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.654+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02741021b0 con 0x7f0274100a70 2024-09-15T23:31:42.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.656+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0264010ac0 con 0x7f0274100a70 2024-09-15T23:31:42.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.656+0000 7f026b7fe640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 0x7f02600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:42.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.657+0000 7f026bfff640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 0x7f02600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:42.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.657+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f02640d0080 con 0x7f0274100a70 2024-09-15T23:31:42.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.657+0000 7f026bfff640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 0x7f02600a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:42.690 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.661+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f026409ca10 con 0x7f0274100a70 2024-09-15T23:31:42.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.864+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0274108fe0 con 0x7f0274100a70 2024-09-15T23:31:42.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.865+0000 7f026b7fe640 1 -- 172.21.15.77:0/4107770567 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f026409c310 con 0x7f0274100a70 2024-09-15T23:31:42.869 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:42.869 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 msgr2=0x7f02600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 0x7f02600a5700 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f025c000c00 tx=0x7f025c005a20 comp rx=0 tx=0).stop 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 msgr2=0x7f0274199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f026400e9f0 tx=0x7f026400eeb0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 shutdown_connections 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f02600a3240 0x7f02600a5700 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0274106a70 0x7f02741a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0274101410 0x7f0274199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 --2- 172.21.15.77:0/4107770567 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0274100a70 0x7f0274199320 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 >> 172.21.15.77:0/4107770567 conn(0x7f02740fc790 msgr2=0x7f02740fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 shutdown_connections 2024-09-15T23:31:42.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:42.867+0000 7f0278a29640 1 -- 172.21.15.77:0/4107770567 wait complete. 2024-09-15T23:31:43.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:42 smithi077 ceph-mon[30968]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:43.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:42 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4107770567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:42 smithi159 ceph-mon[35472]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:42 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/4107770567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:42 smithi155 ceph-mon[35631]: pgmap v354: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:42 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/4107770567' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:43.519 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-15T23:31:43.520 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-15T23:31:43.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 -- 172.21.15.77:0/1426141854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 msgr2=0x7fbf74100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1426141854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74100e10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009900 tx=0x7fbf6802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 -- 172.21.15.77:0/1426141854 shutdown_connections 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1426141854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf74108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1426141854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 0x7fbf74102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1426141854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74100e10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 -- 172.21.15.77:0/1426141854 >> 172.21.15.77:0/1426141854 conn(0x7fbf740fc170 msgr2=0x7fbf740fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 -- 172.21.15.77:0/1426141854 shutdown_connections 2024-09-15T23:31:43.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.623+0000 7fbf7b027640 1 -- 172.21.15.77:0/1426141854 wait complete. 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 Processor -- start 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 -- start start 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 0x7fbf741031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf741036e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410c690 con 0x7fbf74100a10 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410c510 con 0x7fbf741025c0 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf7b027640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410c810 con 0x7fbf74101c00 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46234/0 (socket says 172.21.15.77:46234) 2024-09-15T23:31:43.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 -- 172.21.15.77:0/1237554876 learned_addr learned my addr 172.21.15.77:0/1237554876 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf73fff640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 0x7fbf741031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf795c4640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf741036e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 -- 172.21.15.77:0/1237554876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 msgr2=0x7fbf741031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 0x7fbf741031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 -- 172.21.15.77:0/1237554876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 msgr2=0x7fbf741036e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf741036e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf78dc3640 1 -- 172.21.15.77:0/1237554876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf74103f70 con 0x7fbf74100a10 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.624+0000 7fbf795c4640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf741036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf78dc3640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbf68031610 tx=0x7fbf680043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf6803f030 con 0x7fbf74100a10 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbf68003ce0 con 0x7fbf74100a10 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741a1ec0 con 0x7fbf74100a10 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68035070 con 0x7fbf74100a10 2024-09-15T23:31:43.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.625+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a22d0 con 0x7fbf74100a10 2024-09-15T23:31:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.626+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf741a2560 con 0x7fbf74100a10 2024-09-15T23:31:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.627+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fbf68042030 con 0x7fbf74100a10 2024-09-15T23:31:43.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.628+0000 7fbf71ffb640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 0x7fbf640a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.628+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fbf680f01d0 con 0x7fbf74100a10 2024-09-15T23:31:43.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.628+0000 7fbf73fff640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 0x7fbf640a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.628+0000 7fbf73fff640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 0x7fbf640a5710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf741048d0 tx=0x7fbf6000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:43.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.632+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fbf680bcb60 con 0x7fbf74100a10 2024-09-15T23:31:43.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.802+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf74069a90 con 0x7fbf640a3250 2024-09-15T23:31:43.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.810+0000 7fbf71ffb640 1 -- 172.21.15.77:0/1237554876 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340506 (secure 0 0 0) 0x7fbf74069a90 con 0x7fbf640a3250 2024-09-15T23:31:43.815 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:43.817 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 msgr2=0x7fbf640a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 0x7fbf640a5710 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fbf741048d0 tx=0x7fbf6000b390 comp rx=0 tx=0).stop 2024-09-15T23:31:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 msgr2=0x7fbf74104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fbf68031610 tx=0x7fbf680043b0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 shutdown_connections 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fbf640a3250 0x7fbf640a5710 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbf741025c0 0x7fbf741036e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf74101c00 0x7fbf741031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 --2- 172.21.15.77:0/1237554876 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fbf74100a10 0x7fbf74104b60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 >> 172.21.15.77:0/1237554876 conn(0x7fbf740fc170 msgr2=0x7fbf74069380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 shutdown_connections 2024-09-15T23:31:43.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.814+0000 7fbf7b027640 1 -- 172.21.15.77:0/1237554876 wait complete. 2024-09-15T23:31:43.826 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2024-09-15T23:31:41.828432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655713,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":316,"num_read_kb":270,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":714,"ondisk_log_size":714,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396576,"kb_used_data":14048,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545248,"statfs":{"total":1151940427776,"available":1151534333952,"internally_reserved":0,"allocated":14385152,"data_stored":8078569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003128"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989709+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989709+0000","last_peered":"2024-09-15T23:30:37.989709+0000","last_clean":"2024-09-15T23:30:37.989709+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989709+0000","last_undegraded":"2024-09-15T23:30:37.989709+0000","last_fullsized":"2024-09-15T23:30:37.989709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814394+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.814394+0000","last_peered":"2024-09-15T23:31:35.814394+0000","last_clean":"2024-09-15T23:31:35.814394+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.814394+0000","last_undegraded":"2024-09-15T23:31:35.814394+0000","last_fullsized":"2024-09-15T23:31:35.814394+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813821+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.813821+0000","last_peered":"2024-09-15T23:31:35.813821+0000","last_clean":"2024-09-15T23:31:35.813821+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.813821+0000","last_undegraded":"2024-09-15T23:31:35.813821+0000","last_fullsized":"2024-09-15T23:31:35.813821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.780816+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.780816+0000","last_peered":"2024-09-15T23:31:35.780816+0000","last_clean":"2024-09-15T23:31:35.780816+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.780816+0000","last_undegraded":"2024-09-15T23:31:35.780816+0000","last_fullsized":"2024-09-15T23:31:35.780816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:36.718410+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:36.718410+0000","last_peered":"2024-09-15T23:31:36.718410+0000","last_clean":"2024-09-15T23:31:36.718410+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:36.718410+0000","last_undegraded":"2024-09-15T23:31:36.718410+0000","last_fullsized":"2024-09-15T23:31:36.718410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994405+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994405+0000","last_peered":"2024-09-15T23:30:37.994405+0000","last_clean":"2024-09-15T23:30:37.994405+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994405+0000","last_undegraded":"2024-09-15T23:30:37.994405+0000","last_fullsized":"2024-09-15T23:30:37.994405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.178555+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.178555+0000","last_peered":"2024-09-15T23:30:38.178555+0000","last_clean":"2024-09-15T23:30:38.178555+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.178555+0000","last_undegraded":"2024-09-15T23:30:38.178555+0000","last_fullsized":"2024-09-15T23:30:38.178555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991692+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991692+0000","last_peered":"2024-09-15T23:30:37.991692+0000","last_clean":"2024-09-15T23:30:37.991692+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991692+0000","last_undegraded":"2024-09-15T23:30:37.991692+0000","last_fullsized":"2024-09-15T23:30:37.991692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992005+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992005+0000","last_peered":"2024-09-15T23:30:37.992005+0000","last_clean":"2024-09-15T23:30:37.992005+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992005+0000","last_undegraded":"2024-09-15T23:30:37.992005+0000","last_fullsized":"2024-09-15T23:30:37.992005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818758+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818758+0000","last_peered":"2024-09-15T23:31:35.818758+0000","last_clean":"2024-09-15T23:31:35.818758+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818758+0000","last_undegraded":"2024-09-15T23:31:35.818758+0000","last_fullsized":"2024-09-15T23:31:35.818758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176322+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176322+0000","last_peered":"2024-09-15T23:30:38.176322+0000","last_clean":"2024-09-15T23:30:38.176322+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176322+0000","last_undegraded":"2024-09-15T23:30:38.176322+0000","last_fullsized":"2024-09-15T23:30:38.176322+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822180+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822180+0000","last_peered":"2024-09-15T23:31:35.822180+0000","last_clean":"2024-09-15T23:31:35.822180+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822180+0000","last_undegraded":"2024-09-15T23:31:35.822180+0000","last_fullsized":"2024-09-15T23:31:35.822180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996813+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996813+0000","last_peered":"2024-09-15T23:30:37.996813+0000","last_clean":"2024-09-15T23:30:37.996813+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996813+0000","last_undegraded":"2024-09-15T23:30:37.996813+0000","last_fullsized":"2024-09-15T23:30:37.996813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816078+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816078+0000","last_peered":"2024-09-15T23:31:35.816078+0000","last_clean":"2024-09-15T23:31:35.816078+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816078+0000","last_undegraded":"2024-09-15T23:31:35.816078+0000","last_fullsized":"2024-09-15T23:31:35.816078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175861+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175861+0000","last_peered":"2024-09-15T23:30:38.175861+0000","last_clean":"2024-09-15T23:30:38.175861+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175861+0000","last_undegraded":"2024-09-15T23:30:38.175861+0000","last_fullsized":"2024-09-15T23:30:38.175861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822752+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822752+0000","last_peered":"2024-09-15T23:31:35.822752+0000","last_clean":"2024-09-15T23:31:35.822752+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822752+0000","last_undegraded":"2024-09-15T23:31:35.822752+0000","last_fullsized":"2024-09-15T23:31:35.822752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991635+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991635+0000","last_peered":"2024-09-15T23:30:37.991635+0000","last_clean":"2024-09-15T23:30:37.991635+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991635+0000","last_undegraded":"2024-09-15T23:30:37.991635+0000","last_fullsized":"2024-09-15T23:30:37.991635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814875+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.814875+0000","last_peered":"2024-09-15T23:31:35.814875+0000","last_clean":"2024-09-15T23:31:35.814875+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.814875+0000","last_undegraded":"2024-09-15T23:31:35.814875+0000","last_fullsized":"2024-09-15T23:31:35.814875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997071+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997071+0000","last_peered":"2024-09-15T23:30:37.997071+0000","last_clean":"2024-09-15T23:30:37.997071+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997071+0000","last_undegraded":"2024-09-15T23:30:37.997071+0000","last_fullsized":"2024-09-15T23:30:37.997071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813715+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.813715+0000","last_peered":"2024-09-15T23:31:35.813715+0000","last_clean":"2024-09-15T23:31:35.813715+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.813715+0000","last_undegraded":"2024-09-15T23:31:35.813715+0000","last_fullsized":"2024-09-15T23:31:35.813715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815907+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815907+0000","last_peered":"2024-09-15T23:31:35.815907+0000","last_clean":"2024-09-15T23:31:35.815907+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815907+0000","last_undegraded":"2024-09-15T23:31:35.815907+0000","last_fullsized":"2024-09-15T23:31:35.815907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814161+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814161+0000","last_peered":"2024-09-15T23:31:35.814161+0000","last_clean":"2024-09-15T23:31:35.814161+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814161+0000","last_undegraded":"2024-09-15T23:31:35.814161+0000","last_fullsized":"2024-09-15T23:31:35.814161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810996+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.810996+0000","last_peered":"2024-09-15T23:31:35.810996+0000","last_clean":"2024-09-15T23:31:35.810996+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.810996+0000","last_undegraded":"2024-09-15T23:31:35.810996+0000","last_fullsized":"2024-09-15T23:31:35.810996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":252,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.039999+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:38.039999+0000","last_peered":"2024-09-15T23:31:38.039999+0000","last_clean":"2024-09-15T23:31:38.039999+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:38.039999+0000","last_undegraded":"2024-09-15T23:31:38.039999+0000","last_fullsized":"2024-09-15T23:31:38.039999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64313,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":34,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816098+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816098+0000","last_peered":"2024-09-15T23:31:35.816098+0000","last_clean":"2024-09-15T23:31:35.816098+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816098+0000","last_undegraded":"2024-09-15T23:31:35.816098+0000","last_fullsized":"2024-09-15T23:31:35.816098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176371+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.176371+0000","last_peered":"2024-09-15T23:30:38.176371+0000","last_clean":"2024-09-15T23:30:38.176371+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.176371+0000","last_undegraded":"2024-09-15T23:30:38.176371+0000","last_fullsized":"2024-09-15T23:30:38.176371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814609+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814609+0000","last_peered":"2024-09-15T23:31:35.814609+0000","last_clean":"2024-09-15T23:31:35.814609+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814609+0000","last_undegraded":"2024-09-15T23:31:35.814609+0000","last_fullsized":"2024-09-15T23:31:35.814609+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813654+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813654+0000","last_peered":"2024-09-15T23:31:35.813654+0000","last_clean":"2024-09-15T23:31:35.813654+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813654+0000","last_undegraded":"2024-09-15T23:31:35.813654+0000","last_fullsized":"2024-09-15T23:31:35.813654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821843+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821843+0000","last_peered":"2024-09-15T23:31:35.821843+0000","last_clean":"2024-09-15T23:31:35.821843+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821843+0000","last_undegraded":"2024-09-15T23:31:35.821843+0000","last_fullsized":"2024-09-15T23:31:35.821843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817442+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817442+0000","last_peered":"2024-09-15T23:31:35.817442+0000","last_clean":"2024-09-15T23:31:35.817442+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817442+0000","last_undegraded":"2024-09-15T23:31:35.817442+0000","last_fullsized":"2024-09-15T23:31:35.817442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810319+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810319+0000","last_peered":"2024-09-15T23:31:35.810319+0000","last_clean":"2024-09-15T23:31:35.810319+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810319+0000","last_undegraded":"2024-09-15T23:31:35.810319+0000","last_fullsized":"2024-09-15T23:31:35.810319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818601+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818601+0000","last_peered":"2024-09-15T23:31:35.818601+0000","last_clean":"2024-09-15T23:31:35.818601+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818601+0000","last_undegraded":"2024-09-15T23:31:35.818601+0000","last_fullsized":"2024-09-15T23:31:35.818601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.803949+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.803949+0000","last_peered":"2024-09-15T23:31:35.803949+0000","last_clean":"2024-09-15T23:31:35.803949+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.803949+0000","last_undegraded":"2024-09-15T23:31:35.803949+0000","last_fullsized":"2024-09-15T23:31:35.803949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817512+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817512+0000","last_peered":"2024-09-15T23:31:35.817512+0000","last_clean":"2024-09-15T23:31:35.817512+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817512+0000","last_undegraded":"2024-09-15T23:31:35.817512+0000","last_fullsized":"2024-09-15T23:31:35.817512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817475+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817475+0000","last_peered":"2024-09-15T23:31:35.817475+0000","last_clean":"2024-09-15T23:31:35.817475+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817475+0000","last_undegraded":"2024-09-15T23:31:35.817475+0000","last_fullsized":"2024-09-15T23:31:35.817475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814272+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814272+0000","last_peered":"2024-09-15T23:31:35.814272+0000","last_clean":"2024-09-15T23:31:35.814272+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814272+0000","last_undegraded":"2024-09-15T23:31:35.814272+0000","last_fullsized":"2024-09-15T23:31:35.814272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816156+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816156+0000","last_peered":"2024-09-15T23:31:35.816156+0000","last_clean":"2024-09-15T23:31:35.816156+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816156+0000","last_undegraded":"2024-09-15T23:31:35.816156+0000","last_fullsized":"2024-09-15T23:31:35.816156+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65111,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":190,"num_read_kb":161,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":195641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710764,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1161463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874290,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103223,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":570935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":571209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:43.832 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.966+0000 7f3cb460e640 1 -- 172.21.15.77:0/2857537608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac1077f0 msgr2=0x7f3cac109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.966+0000 7f3cb460e640 1 --2- 172.21.15.77:0/2857537608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac1077f0 0x7f3cac109c60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3ca4009900 tx=0x7f3ca402a410 comp rx=0 tx=0).stop 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- 172.21.15.77:0/2857537608 shutdown_connections 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- 172.21.15.77:0/2857537608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac1077f0 0x7f3cac109c60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- 172.21.15.77:0/2857537608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac104ec0 0x7f3cac1072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- 172.21.15.77:0/2857537608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cac102590 0x7f3cac104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- 172.21.15.77:0/2857537608 >> 172.21.15.77:0/2857537608 conn(0x7f3cac0fc170 msgr2=0x7f3cac0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- 172.21.15.77:0/2857537608 shutdown_connections 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- 172.21.15.77:0/2857537608 wait complete. 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 Processor -- start 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- start start 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cac104ec0 0x7f3cac198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 0x7f3cac19f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10d8a0 con 0x7f3cac102590 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10d720 con 0x7f3cac104ec0 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.967+0000 7f3cb460e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3cac10da20 con 0x7f3cac1077f0 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46256/0 (socket says 172.21.15.77:46256) 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 -- 172.21.15.77:0/3148326819 learned_addr learned my addr 172.21.15.77:0/3148326819 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:43.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb2bab640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 0x7f3cac19f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 -- 172.21.15.77:0/3148326819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 msgr2=0x7f3cac19f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 0x7f3cac19f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 -- 172.21.15.77:0/3148326819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cac104ec0 msgr2=0x7f3cac198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cac104ec0 0x7f3cac198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 -- 172.21.15.77:0/3148326819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cac19fc00 con 0x7f3cac102590 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb2bab640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 0x7f3cac19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb23aa640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ba50 tx=0x7f3c9c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c019070 con 0x7f3cac102590 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3c9c00cbe0 con 0x7f3cac102590 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cac19fef0 con 0x7f3cac102590 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c9c0076e0 con 0x7f3cac102590 2024-09-15T23:31:43.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.968+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cac1a0430 con 0x7f3cac102590 2024-09-15T23:31:43.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.969+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cac0fdc60 con 0x7f3cac102590 2024-09-15T23:31:43.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.971+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3c9c01c070 con 0x7f3cac102590 2024-09-15T23:31:43.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.971+0000 7f3cab7fe640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 0x7f3c940a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:43.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.971+0000 7f3cb1ba9640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 0x7f3c940a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:43.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.971+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3c9c0cf300 con 0x7f3cac102590 2024-09-15T23:31:43.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.972+0000 7f3cb1ba9640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 0x7f3c940a5710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cac1994f0 tx=0x7f3ca0006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:43.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:43.975+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3c9c09bc90 con 0x7f3cac102590 2024-09-15T23:31:44.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.139+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cac062630 con 0x7f3c940a3250 2024-09-15T23:31:44.147 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.146+0000 7f3cab7fe640 1 -- 172.21.15.77:0/3148326819 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340478 (secure 0 0 0) 0x7f3cac062630 con 0x7f3c940a3250 2024-09-15T23:31:44.151 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:44.153 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 msgr2=0x7f3c940a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 0x7f3c940a5710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3cac1994f0 tx=0x7f3ca0006c90 comp rx=0 tx=0).stop 2024-09-15T23:31:44.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 msgr2=0x7f3cac197fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3c9c00ba50 tx=0x7f3c9c00bf10 comp rx=0 tx=0).stop 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 shutdown_connections 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3c940a3250 0x7f3c940a5710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cac1077f0 0x7f3cac19f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cac104ec0 0x7f3cac198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 --2- 172.21.15.77:0/3148326819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cac102590 0x7f3cac197fe0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 >> 172.21.15.77:0/3148326819 conn(0x7f3cac0fc170 msgr2=0x7f3cac103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 shutdown_connections 2024-09-15T23:31:44.156 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.150+0000 7f3cb460e640 1 -- 172.21.15.77:0/3148326819 wait complete. 2024-09-15T23:31:44.162 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-15T23:31:43.828901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655713,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":316,"num_read_kb":270,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":714,"ondisk_log_size":714,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396576,"kb_used_data":14048,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545248,"statfs":{"total":1151940427776,"available":1151534333952,"internally_reserved":0,"allocated":14385152,"data_stored":8078569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003082"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989709+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989709+0000","last_peered":"2024-09-15T23:30:37.989709+0000","last_clean":"2024-09-15T23:30:37.989709+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989709+0000","last_undegraded":"2024-09-15T23:30:37.989709+0000","last_fullsized":"2024-09-15T23:30:37.989709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817995+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.817995+0000","last_peered":"2024-09-15T23:31:35.817995+0000","last_clean":"2024-09-15T23:31:35.817995+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.817995+0000","last_undegraded":"2024-09-15T23:31:35.817995+0000","last_fullsized":"2024-09-15T23:31:35.817995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813821+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.813821+0000","last_peered":"2024-09-15T23:31:35.813821+0000","last_clean":"2024-09-15T23:31:35.813821+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.813821+0000","last_undegraded":"2024-09-15T23:31:35.813821+0000","last_fullsized":"2024-09-15T23:31:35.813821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814437+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.814437+0000","last_peered":"2024-09-15T23:31:35.814437+0000","last_clean":"2024-09-15T23:31:35.814437+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.814437+0000","last_undegraded":"2024-09-15T23:31:35.814437+0000","last_fullsized":"2024-09-15T23:31:35.814437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:36.718410+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:36.718410+0000","last_peered":"2024-09-15T23:31:36.718410+0000","last_clean":"2024-09-15T23:31:36.718410+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:36.718410+0000","last_undegraded":"2024-09-15T23:31:36.718410+0000","last_fullsized":"2024-09-15T23:31:36.718410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994405+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994405+0000","last_peered":"2024-09-15T23:30:37.994405+0000","last_clean":"2024-09-15T23:30:37.994405+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994405+0000","last_undegraded":"2024-09-15T23:30:37.994405+0000","last_fullsized":"2024-09-15T23:30:37.994405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.179058+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.179058+0000","last_peered":"2024-09-15T23:30:38.179058+0000","last_clean":"2024-09-15T23:30:38.179058+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.179058+0000","last_undegraded":"2024-09-15T23:30:38.179058+0000","last_fullsized":"2024-09-15T23:30:38.179058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991734+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991734+0000","last_peered":"2024-09-15T23:30:37.991734+0000","last_clean":"2024-09-15T23:30:37.991734+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991734+0000","last_undegraded":"2024-09-15T23:30:37.991734+0000","last_fullsized":"2024-09-15T23:30:37.991734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992005+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992005+0000","last_peered":"2024-09-15T23:30:37.992005+0000","last_clean":"2024-09-15T23:30:37.992005+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992005+0000","last_undegraded":"2024-09-15T23:30:37.992005+0000","last_fullsized":"2024-09-15T23:30:37.992005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818758+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818758+0000","last_peered":"2024-09-15T23:31:35.818758+0000","last_clean":"2024-09-15T23:31:35.818758+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818758+0000","last_undegraded":"2024-09-15T23:31:35.818758+0000","last_fullsized":"2024-09-15T23:31:35.818758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176384+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176384+0000","last_peered":"2024-09-15T23:30:38.176384+0000","last_clean":"2024-09-15T23:30:38.176384+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176384+0000","last_undegraded":"2024-09-15T23:30:38.176384+0000","last_fullsized":"2024-09-15T23:30:38.176384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822180+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822180+0000","last_peered":"2024-09-15T23:31:35.822180+0000","last_clean":"2024-09-15T23:31:35.822180+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822180+0000","last_undegraded":"2024-09-15T23:31:35.822180+0000","last_fullsized":"2024-09-15T23:31:35.822180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996813+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996813+0000","last_peered":"2024-09-15T23:30:37.996813+0000","last_clean":"2024-09-15T23:30:37.996813+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996813+0000","last_undegraded":"2024-09-15T23:30:37.996813+0000","last_fullsized":"2024-09-15T23:30:37.996813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816078+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816078+0000","last_peered":"2024-09-15T23:31:35.816078+0000","last_clean":"2024-09-15T23:31:35.816078+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816078+0000","last_undegraded":"2024-09-15T23:31:35.816078+0000","last_fullsized":"2024-09-15T23:31:35.816078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175861+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175861+0000","last_peered":"2024-09-15T23:30:38.175861+0000","last_clean":"2024-09-15T23:30:38.175861+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175861+0000","last_undegraded":"2024-09-15T23:30:38.175861+0000","last_fullsized":"2024-09-15T23:30:38.175861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822752+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822752+0000","last_peered":"2024-09-15T23:31:35.822752+0000","last_clean":"2024-09-15T23:31:35.822752+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822752+0000","last_undegraded":"2024-09-15T23:31:35.822752+0000","last_fullsized":"2024-09-15T23:31:35.822752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991635+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991635+0000","last_peered":"2024-09-15T23:30:37.991635+0000","last_clean":"2024-09-15T23:30:37.991635+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991635+0000","last_undegraded":"2024-09-15T23:30:37.991635+0000","last_fullsized":"2024-09-15T23:30:37.991635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814875+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.814875+0000","last_peered":"2024-09-15T23:31:35.814875+0000","last_clean":"2024-09-15T23:31:35.814875+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.814875+0000","last_undegraded":"2024-09-15T23:31:35.814875+0000","last_fullsized":"2024-09-15T23:31:35.814875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997109+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997109+0000","last_peered":"2024-09-15T23:30:37.997109+0000","last_clean":"2024-09-15T23:30:37.997109+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997109+0000","last_undegraded":"2024-09-15T23:30:37.997109+0000","last_fullsized":"2024-09-15T23:30:37.997109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813715+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.813715+0000","last_peered":"2024-09-15T23:31:35.813715+0000","last_clean":"2024-09-15T23:31:35.813715+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.813715+0000","last_undegraded":"2024-09-15T23:31:35.813715+0000","last_fullsized":"2024-09-15T23:31:35.813715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815907+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815907+0000","last_peered":"2024-09-15T23:31:35.815907+0000","last_clean":"2024-09-15T23:31:35.815907+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815907+0000","last_undegraded":"2024-09-15T23:31:35.815907+0000","last_fullsized":"2024-09-15T23:31:35.815907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814161+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814161+0000","last_peered":"2024-09-15T23:31:35.814161+0000","last_clean":"2024-09-15T23:31:35.814161+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814161+0000","last_undegraded":"2024-09-15T23:31:35.814161+0000","last_fullsized":"2024-09-15T23:31:35.814161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810996+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.810996+0000","last_peered":"2024-09-15T23:31:35.810996+0000","last_clean":"2024-09-15T23:31:35.810996+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.810996+0000","last_undegraded":"2024-09-15T23:31:35.810996+0000","last_fullsized":"2024-09-15T23:31:35.810996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":252,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.039999+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:38.039999+0000","last_peered":"2024-09-15T23:31:38.039999+0000","last_clean":"2024-09-15T23:31:38.039999+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:38.039999+0000","last_undegraded":"2024-09-15T23:31:38.039999+0000","last_fullsized":"2024-09-15T23:31:38.039999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64313,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":34,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816098+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816098+0000","last_peered":"2024-09-15T23:31:35.816098+0000","last_clean":"2024-09-15T23:31:35.816098+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816098+0000","last_undegraded":"2024-09-15T23:31:35.816098+0000","last_fullsized":"2024-09-15T23:31:35.816098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176371+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.176371+0000","last_peered":"2024-09-15T23:30:38.176371+0000","last_clean":"2024-09-15T23:30:38.176371+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.176371+0000","last_undegraded":"2024-09-15T23:30:38.176371+0000","last_fullsized":"2024-09-15T23:30:38.176371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814725+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814725+0000","last_peered":"2024-09-15T23:31:35.814725+0000","last_clean":"2024-09-15T23:31:35.814725+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814725+0000","last_undegraded":"2024-09-15T23:31:35.814725+0000","last_fullsized":"2024-09-15T23:31:35.814725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813654+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813654+0000","last_peered":"2024-09-15T23:31:35.813654+0000","last_clean":"2024-09-15T23:31:35.813654+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813654+0000","last_undegraded":"2024-09-15T23:31:35.813654+0000","last_fullsized":"2024-09-15T23:31:35.813654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821843+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821843+0000","last_peered":"2024-09-15T23:31:35.821843+0000","last_clean":"2024-09-15T23:31:35.821843+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821843+0000","last_undegraded":"2024-09-15T23:31:35.821843+0000","last_fullsized":"2024-09-15T23:31:35.821843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817442+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817442+0000","last_peered":"2024-09-15T23:31:35.817442+0000","last_clean":"2024-09-15T23:31:35.817442+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817442+0000","last_undegraded":"2024-09-15T23:31:35.817442+0000","last_fullsized":"2024-09-15T23:31:35.817442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810319+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810319+0000","last_peered":"2024-09-15T23:31:35.810319+0000","last_clean":"2024-09-15T23:31:35.810319+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810319+0000","last_undegraded":"2024-09-15T23:31:35.810319+0000","last_fullsized":"2024-09-15T23:31:35.810319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818601+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818601+0000","last_peered":"2024-09-15T23:31:35.818601+0000","last_clean":"2024-09-15T23:31:35.818601+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818601+0000","last_undegraded":"2024-09-15T23:31:35.818601+0000","last_fullsized":"2024-09-15T23:31:35.818601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.803949+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.803949+0000","last_peered":"2024-09-15T23:31:35.803949+0000","last_clean":"2024-09-15T23:31:35.803949+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.803949+0000","last_undegraded":"2024-09-15T23:31:35.803949+0000","last_fullsized":"2024-09-15T23:31:35.803949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817512+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817512+0000","last_peered":"2024-09-15T23:31:35.817512+0000","last_clean":"2024-09-15T23:31:35.817512+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817512+0000","last_undegraded":"2024-09-15T23:31:35.817512+0000","last_fullsized":"2024-09-15T23:31:35.817512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817475+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817475+0000","last_peered":"2024-09-15T23:31:35.817475+0000","last_clean":"2024-09-15T23:31:35.817475+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817475+0000","last_undegraded":"2024-09-15T23:31:35.817475+0000","last_fullsized":"2024-09-15T23:31:35.817475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814272+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814272+0000","last_peered":"2024-09-15T23:31:35.814272+0000","last_clean":"2024-09-15T23:31:35.814272+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814272+0000","last_undegraded":"2024-09-15T23:31:35.814272+0000","last_fullsized":"2024-09-15T23:31:35.814272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816156+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816156+0000","last_peered":"2024-09-15T23:31:35.816156+0000","last_clean":"2024-09-15T23:31:35.816156+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816156+0000","last_undegraded":"2024-09-15T23:31:35.816156+0000","last_fullsized":"2024-09-15T23:31:35.816156+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65111,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":190,"num_read_kb":161,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":195641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710764,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1161463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874290,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103224,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":570935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":571209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:44.168 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-15T23:31:44.168 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 -- 172.21.15.77:0/23152598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e0102d20 msgr2=0x7f59e01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 --2- 172.21.15.77:0/23152598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e0102d20 0x7f59e01031a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009900 tx=0x7f59c802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 -- 172.21.15.77:0/23152598 shutdown_connections 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 --2- 172.21.15.77:0/23152598 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e01036e0 0x7f59e0109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 --2- 172.21.15.77:0/23152598 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e0102d20 0x7f59e01031a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 --2- 172.21.15.77:0/23152598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0101b30 0x7f59e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 -- 172.21.15.77:0/23152598 >> 172.21.15.77:0/23152598 conn(0x7f59e00fd2b0 msgr2=0x7f59e00ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 -- 172.21.15.77:0/23152598 shutdown_connections 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.301+0000 7f59e5296640 1 -- 172.21.15.77:0/23152598 wait complete. 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 Processor -- start 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 -- start start 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e0101b30 0x7f59e0075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0102d20 0x7f59e00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d7b0 con 0x7f59e01036e0 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d630 con 0x7f59e0101b30 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59e5296640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f59e010d930 con 0x7f59e0102d20 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46278/0 (socket says 172.21.15.77:46278) 2024-09-15T23:31:44.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 -- 172.21.15.77:0/1632584590 learned_addr learned my addr 172.21.15.77:0/1632584590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59deffd640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e0101b30 0x7f59e0075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59d7fff640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0102d20 0x7f59e00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 -- 172.21.15.77:0/1632584590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0102d20 msgr2=0x7f59e00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0102d20 0x7f59e00745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 -- 172.21.15.77:0/1632584590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e0101b30 msgr2=0x7f59e0075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e0101b30 0x7f59e0075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 -- 172.21.15.77:0/1632584590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e00753b0 con 0x7f59e01036e0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.302+0000 7f59df7fe640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f59d800cce0 tx=0x7f59d800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.303+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d800f450 con 0x7f59e01036e0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.303+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e01a1f50 con 0x7f59e01036e0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.303+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f59d800fad0 con 0x7f59e01036e0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.303+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8018c10 con 0x7f59e01036e0 2024-09-15T23:31:44.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.303+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e01a2360 con 0x7f59e01036e0 2024-09-15T23:31:44.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.304+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e0108e70 con 0x7f59e01036e0 2024-09-15T23:31:44.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.305+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f59d800f5f0 con 0x7f59e01036e0 2024-09-15T23:31:44.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.305+0000 7f59dcff9640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 0x7f59cc0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:44.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.306+0000 7f59deffd640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 0x7f59cc0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:44.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.306+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f59d80d0350 con 0x7f59e01036e0 2024-09-15T23:31:44.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.306+0000 7f59deffd640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 0x7f59cc0a5710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f59d00058c0 tx=0x7f59d000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:44.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.310+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f59d8014030 con 0x7f59e01036e0 2024-09-15T23:31:44.475 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.473+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59e0062630 con 0x7f59cc0a3250 2024-09-15T23:31:44.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.481+0000 7f59dcff9640 1 -- 172.21.15.77:0/1632584590 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340478 (secure 0 0 0) 0x7f59e0062630 con 0x7f59cc0a3250 2024-09-15T23:31:44.486 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:44.488 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:44.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 msgr2=0x7f59cc0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 0x7f59cc0a5710 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f59d00058c0 tx=0x7f59d000a4c0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 msgr2=0x7f59e0074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f59d800cce0 tx=0x7f59d800a620 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 shutdown_connections 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f59cc0a3250 0x7f59cc0a5710 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f59e01036e0 0x7f59e0074b20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e0102d20 0x7f59e00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 --2- 172.21.15.77:0/1632584590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f59e0101b30 0x7f59e0075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 >> 172.21.15.77:0/1632584590 conn(0x7f59e00fd2b0 msgr2=0x7f59e0106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 shutdown_connections 2024-09-15T23:31:44.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:44.485+0000 7f59e5296640 1 -- 172.21.15.77:0/1632584590 wait complete. 2024-09-15T23:31:44.497 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2024-09-15T23:31:43.828901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655713,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":316,"num_read_kb":270,"num_write":273,"num_write_kb":3036,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":714,"ondisk_log_size":714,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396576,"kb_used_data":14048,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545248,"statfs":{"total":1151940427776,"available":1151534333952,"internally_reserved":0,"allocated":14385152,"data_stored":8078569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":249,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003082"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989709+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989709+0000","last_peered":"2024-09-15T23:30:37.989709+0000","last_clean":"2024-09-15T23:30:37.989709+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989709+0000","last_undegraded":"2024-09-15T23:30:37.989709+0000","last_fullsized":"2024-09-15T23:30:37.989709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817995+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.817995+0000","last_peered":"2024-09-15T23:31:35.817995+0000","last_clean":"2024-09-15T23:31:35.817995+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.817995+0000","last_undegraded":"2024-09-15T23:31:35.817995+0000","last_fullsized":"2024-09-15T23:31:35.817995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813821+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.813821+0000","last_peered":"2024-09-15T23:31:35.813821+0000","last_clean":"2024-09-15T23:31:35.813821+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.813821+0000","last_undegraded":"2024-09-15T23:31:35.813821+0000","last_fullsized":"2024-09-15T23:31:35.813821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814437+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.814437+0000","last_peered":"2024-09-15T23:31:35.814437+0000","last_clean":"2024-09-15T23:31:35.814437+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.814437+0000","last_undegraded":"2024-09-15T23:31:35.814437+0000","last_fullsized":"2024-09-15T23:31:35.814437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:36.718410+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:36.718410+0000","last_peered":"2024-09-15T23:31:36.718410+0000","last_clean":"2024-09-15T23:31:36.718410+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:36.718410+0000","last_undegraded":"2024-09-15T23:31:36.718410+0000","last_fullsized":"2024-09-15T23:31:36.718410+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994405+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994405+0000","last_peered":"2024-09-15T23:30:37.994405+0000","last_clean":"2024-09-15T23:30:37.994405+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994405+0000","last_undegraded":"2024-09-15T23:30:37.994405+0000","last_fullsized":"2024-09-15T23:30:37.994405+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.179058+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.179058+0000","last_peered":"2024-09-15T23:30:38.179058+0000","last_clean":"2024-09-15T23:30:38.179058+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.179058+0000","last_undegraded":"2024-09-15T23:30:38.179058+0000","last_fullsized":"2024-09-15T23:30:38.179058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991734+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991734+0000","last_peered":"2024-09-15T23:30:37.991734+0000","last_clean":"2024-09-15T23:30:37.991734+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991734+0000","last_undegraded":"2024-09-15T23:30:37.991734+0000","last_fullsized":"2024-09-15T23:30:37.991734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992005+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992005+0000","last_peered":"2024-09-15T23:30:37.992005+0000","last_clean":"2024-09-15T23:30:37.992005+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992005+0000","last_undegraded":"2024-09-15T23:30:37.992005+0000","last_fullsized":"2024-09-15T23:30:37.992005+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":27,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818758+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818758+0000","last_peered":"2024-09-15T23:31:35.818758+0000","last_clean":"2024-09-15T23:31:35.818758+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818758+0000","last_undegraded":"2024-09-15T23:31:35.818758+0000","last_fullsized":"2024-09-15T23:31:35.818758+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176384+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176384+0000","last_peered":"2024-09-15T23:30:38.176384+0000","last_clean":"2024-09-15T23:30:38.176384+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176384+0000","last_undegraded":"2024-09-15T23:30:38.176384+0000","last_fullsized":"2024-09-15T23:30:38.176384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822180+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822180+0000","last_peered":"2024-09-15T23:31:35.822180+0000","last_clean":"2024-09-15T23:31:35.822180+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822180+0000","last_undegraded":"2024-09-15T23:31:35.822180+0000","last_fullsized":"2024-09-15T23:31:35.822180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996813+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996813+0000","last_peered":"2024-09-15T23:30:37.996813+0000","last_clean":"2024-09-15T23:30:37.996813+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996813+0000","last_undegraded":"2024-09-15T23:30:37.996813+0000","last_fullsized":"2024-09-15T23:30:37.996813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816078+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816078+0000","last_peered":"2024-09-15T23:31:35.816078+0000","last_clean":"2024-09-15T23:31:35.816078+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816078+0000","last_undegraded":"2024-09-15T23:31:35.816078+0000","last_fullsized":"2024-09-15T23:31:35.816078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175861+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175861+0000","last_peered":"2024-09-15T23:30:38.175861+0000","last_clean":"2024-09-15T23:30:38.175861+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175861+0000","last_undegraded":"2024-09-15T23:30:38.175861+0000","last_fullsized":"2024-09-15T23:30:38.175861+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822752+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822752+0000","last_peered":"2024-09-15T23:31:35.822752+0000","last_clean":"2024-09-15T23:31:35.822752+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822752+0000","last_undegraded":"2024-09-15T23:31:35.822752+0000","last_fullsized":"2024-09-15T23:31:35.822752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991635+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991635+0000","last_peered":"2024-09-15T23:30:37.991635+0000","last_clean":"2024-09-15T23:30:37.991635+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991635+0000","last_undegraded":"2024-09-15T23:30:37.991635+0000","last_fullsized":"2024-09-15T23:30:37.991635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814875+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.814875+0000","last_peered":"2024-09-15T23:31:35.814875+0000","last_clean":"2024-09-15T23:31:35.814875+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.814875+0000","last_undegraded":"2024-09-15T23:31:35.814875+0000","last_fullsized":"2024-09-15T23:31:35.814875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997109+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997109+0000","last_peered":"2024-09-15T23:30:37.997109+0000","last_clean":"2024-09-15T23:30:37.997109+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997109+0000","last_undegraded":"2024-09-15T23:30:37.997109+0000","last_fullsized":"2024-09-15T23:30:37.997109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813715+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.813715+0000","last_peered":"2024-09-15T23:31:35.813715+0000","last_clean":"2024-09-15T23:31:35.813715+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.813715+0000","last_undegraded":"2024-09-15T23:31:35.813715+0000","last_fullsized":"2024-09-15T23:31:35.813715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815907+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815907+0000","last_peered":"2024-09-15T23:31:35.815907+0000","last_clean":"2024-09-15T23:31:35.815907+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815907+0000","last_undegraded":"2024-09-15T23:31:35.815907+0000","last_fullsized":"2024-09-15T23:31:35.815907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814161+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814161+0000","last_peered":"2024-09-15T23:31:35.814161+0000","last_clean":"2024-09-15T23:31:35.814161+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814161+0000","last_undegraded":"2024-09-15T23:31:35.814161+0000","last_fullsized":"2024-09-15T23:31:35.814161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810996+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.810996+0000","last_peered":"2024-09-15T23:31:35.810996+0000","last_clean":"2024-09-15T23:31:35.810996+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.810996+0000","last_undegraded":"2024-09-15T23:31:35.810996+0000","last_fullsized":"2024-09-15T23:31:35.810996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'34","reported_seq":252,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.039999+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:38.039999+0000","last_peered":"2024-09-15T23:31:38.039999+0000","last_clean":"2024-09-15T23:31:38.039999+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:38.039999+0000","last_undegraded":"2024-09-15T23:31:38.039999+0000","last_fullsized":"2024-09-15T23:31:38.039999+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64313,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":184,"num_read_kb":155,"num_write":34,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816098+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816098+0000","last_peered":"2024-09-15T23:31:35.816098+0000","last_clean":"2024-09-15T23:31:35.816098+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816098+0000","last_undegraded":"2024-09-15T23:31:35.816098+0000","last_fullsized":"2024-09-15T23:31:35.816098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176371+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.176371+0000","last_peered":"2024-09-15T23:30:38.176371+0000","last_clean":"2024-09-15T23:30:38.176371+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.176371+0000","last_undegraded":"2024-09-15T23:30:38.176371+0000","last_fullsized":"2024-09-15T23:30:38.176371+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814725+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814725+0000","last_peered":"2024-09-15T23:31:35.814725+0000","last_clean":"2024-09-15T23:31:35.814725+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814725+0000","last_undegraded":"2024-09-15T23:31:35.814725+0000","last_fullsized":"2024-09-15T23:31:35.814725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813654+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813654+0000","last_peered":"2024-09-15T23:31:35.813654+0000","last_clean":"2024-09-15T23:31:35.813654+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813654+0000","last_undegraded":"2024-09-15T23:31:35.813654+0000","last_fullsized":"2024-09-15T23:31:35.813654+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821843+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821843+0000","last_peered":"2024-09-15T23:31:35.821843+0000","last_clean":"2024-09-15T23:31:35.821843+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821843+0000","last_undegraded":"2024-09-15T23:31:35.821843+0000","last_fullsized":"2024-09-15T23:31:35.821843+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817442+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817442+0000","last_peered":"2024-09-15T23:31:35.817442+0000","last_clean":"2024-09-15T23:31:35.817442+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817442+0000","last_undegraded":"2024-09-15T23:31:35.817442+0000","last_fullsized":"2024-09-15T23:31:35.817442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810319+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810319+0000","last_peered":"2024-09-15T23:31:35.810319+0000","last_clean":"2024-09-15T23:31:35.810319+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810319+0000","last_undegraded":"2024-09-15T23:31:35.810319+0000","last_fullsized":"2024-09-15T23:31:35.810319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818601+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818601+0000","last_peered":"2024-09-15T23:31:35.818601+0000","last_clean":"2024-09-15T23:31:35.818601+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818601+0000","last_undegraded":"2024-09-15T23:31:35.818601+0000","last_fullsized":"2024-09-15T23:31:35.818601+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.803949+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.803949+0000","last_peered":"2024-09-15T23:31:35.803949+0000","last_clean":"2024-09-15T23:31:35.803949+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.803949+0000","last_undegraded":"2024-09-15T23:31:35.803949+0000","last_fullsized":"2024-09-15T23:31:35.803949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817512+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817512+0000","last_peered":"2024-09-15T23:31:35.817512+0000","last_clean":"2024-09-15T23:31:35.817512+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817512+0000","last_undegraded":"2024-09-15T23:31:35.817512+0000","last_fullsized":"2024-09-15T23:31:35.817512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817475+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817475+0000","last_peered":"2024-09-15T23:31:35.817475+0000","last_clean":"2024-09-15T23:31:35.817475+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817475+0000","last_undegraded":"2024-09-15T23:31:35.817475+0000","last_fullsized":"2024-09-15T23:31:35.817475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814272+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814272+0000","last_peered":"2024-09-15T23:31:35.814272+0000","last_clean":"2024-09-15T23:31:35.814272+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814272+0000","last_undegraded":"2024-09-15T23:31:35.814272+0000","last_fullsized":"2024-09-15T23:31:35.814272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816156+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816156+0000","last_peered":"2024-09-15T23:31:35.816156+0000","last_clean":"2024-09-15T23:31:35.816156+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816156+0000","last_undegraded":"2024-09-15T23:31:35.816156+0000","last_fullsized":"2024-09-15T23:31:35.816156+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65111,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":190,"num_read_kb":161,"num_write":90,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":195641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481832,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710764,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28688,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716464,"statfs":{"total":95995035648,"available":95965659136,"internally_reserved":0,"allocated":1703936,"data_stored":1161463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874290,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103224,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790022,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953548,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182481,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411414,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":570935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28096,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717056,"statfs":{"total":95995035648,"available":95966265344,"internally_reserved":0,"allocated":1097728,"data_stored":571209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":64347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":64507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:44.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:44.786 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:44 smithi159 ceph-mon[35472]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:44 smithi159 ceph-mon[35472]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:45.229 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:44 smithi077 ceph-mon[30968]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:45.229 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:44 smithi077 ceph-mon[30968]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:45.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 -- 172.21.15.77:0/4054592651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c106ba0 msgr2=0x7f649c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:45.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/4054592651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c106ba0 0x7f649c106f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f6490009900 tx=0x7f649002a410 comp rx=0 tx=0).stop 2024-09-15T23:31:45.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 -- 172.21.15.77:0/4054592651 shutdown_connections 2024-09-15T23:31:45.314 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/4054592651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f649c100a70 0x7f649c10ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/4054592651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c1000d0 0x7f649c100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/4054592651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c106ba0 0x7f649c106f80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 -- 172.21.15.77:0/4054592651 >> 172.21.15.77:0/4054592651 conn(0x7f649c077210 msgr2=0x7f649c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 -- 172.21.15.77:0/4054592651 shutdown_connections 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.307+0000 7f64a2bd1640 1 -- 172.21.15.77:0/4054592651 wait complete. 2024-09-15T23:31:45.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.308+0000 7f64a2bd1640 1 Processor -- start 2024-09-15T23:31:45.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.308+0000 7f64a2bd1640 1 -- start start 2024-09-15T23:31:45.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.308+0000 7f64a2bd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:45.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.308+0000 7f64a2bd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 0x7f649c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:45.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a2bd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f649c106ba0 0x7f649c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:45.316 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a2bd1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f649c112090 con 0x7f649c1000d0 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a2bd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f649c111f10 con 0x7f649c106ba0 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a2bd1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f649c112210 con 0x7f649c100a70 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46286/0 (socket says 172.21.15.77:46286) 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 -- 172.21.15.77:0/823831293 learned_addr learned my addr 172.21.15.77:0/823831293 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:45.317 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f649bfff640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 0x7f649c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 -- 172.21.15.77:0/823831293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 msgr2=0x7f649c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 0x7f649c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 -- 172.21.15.77:0/823831293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f649c106ba0 msgr2=0x7f649c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f649c106ba0 0x7f649c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 -- 172.21.15.77:0/823831293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f649c19d540 con 0x7f649c1000d0 2024-09-15T23:31:45.318 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f649bfff640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 0x7f649c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a096d640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6490006010 tx=0x7f6490003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f649003f070 con 0x7f649c1000d0 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6490031c30 con 0x7f649c1000d0 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f649c19d7d0 con 0x7f649c1000d0 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.309+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6490035030 con 0x7f649c1000d0 2024-09-15T23:31:45.319 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.310+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f649c1a5110 con 0x7f649c1000d0 2024-09-15T23:31:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.311+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f649c100530 con 0x7f649c1000d0 2024-09-15T23:31:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.312+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6490042070 con 0x7f649c1000d0 2024-09-15T23:31:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.312+0000 7f6499ffb640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.313+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f64900f05c0 con 0x7f649c1000d0 2024-09-15T23:31:45.320 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.313+0000 7f649bfff640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:45.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.313+0000 7f649bfff640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 0x7f648c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f649c0ff810 tx=0x7f6488005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:45.321 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.317+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6490031de0 con 0x7f649c1000d0 2024-09-15T23:31:45.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:44 smithi155 ceph-mon[35631]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:45.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:44 smithi155 ceph-mon[35631]: pgmap v355: 129 pgs: 129 active+clean; 640 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:31:45.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.517+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f649c1998f0 con 0x7f649c1000d0 2024-09-15T23:31:45.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.518+0000 7f6499ffb640 1 -- 172.21.15.77:0/823831293 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f64900bcf50 con 0x7f649c1000d0 2024-09-15T23:31:45.519 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:45.519 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:45.520 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 msgr2=0x7f648c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 0x7f648c0a5700 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f649c0ff810 tx=0x7f6488005e50 comp rx=0 tx=0).stop 2024-09-15T23:31:45.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 msgr2=0x7f649c198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f6490006010 tx=0x7f6490003c10 comp rx=0 tx=0).stop 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 shutdown_connections 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f648c0a3240 0x7f648c0a5700 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f649c106ba0 0x7f649c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f649c100a70 0x7f649c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 --2- 172.21.15.77:0/823831293 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f649c1000d0 0x7f649c198590 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 >> 172.21.15.77:0/823831293 conn(0x7f649c077210 msgr2=0x7f649c104cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 shutdown_connections 2024-09-15T23:31:45.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:45.520+0000 7f64a2bd1640 1 -- 172.21.15.77:0/823831293 wait complete. 2024-09-15T23:31:46.093 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:45 smithi077 ceph-mon[30968]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.093 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:45 smithi077 ceph-mon[30968]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.093 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:45 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/823831293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:46.122 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:31:46.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:45 smithi159 ceph-mon[35472]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:45 smithi159 ceph-mon[35472]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:45 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/823831293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:46.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:45 smithi155 ceph-mon[35631]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:45 smithi155 ceph-mon[35631]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:46.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:45 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/823831293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:46.368 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 -- 172.21.15.77:0/1733716909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 msgr2=0x7f3ae01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/1733716909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae01031c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009900 tx=0x7f3ad002a480 comp rx=0 tx=0).stop 2024-09-15T23:31:46.898 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 -- 172.21.15.77:0/1733716909 shutdown_connections 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/1733716909 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 0x7f3ae010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/1733716909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/1733716909 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae01031c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 -- 172.21.15.77:0/1733716909 >> 172.21.15.77:0/1733716909 conn(0x7f3ae00fc7a0 msgr2=0x7f3ae00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 -- 172.21.15.77:0/1733716909 shutdown_connections 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.874+0000 7f3ae5db4640 1 -- 172.21.15.77:0/1733716909 wait complete. 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 Processor -- start 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 -- start start 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae0198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 0x7f3ae019cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0111fb0 con 0x7f3ae0102de0 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0111e30 con 0x7f3ae0103700 2024-09-15T23:31:46.899 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3ae5db4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0112130 con 0x7f3ae010c180 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3adf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:46304/0 (socket says 172.21.15.77:46304) 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.875+0000 7f3adf7fe640 1 -- 172.21.15.77:0/2284641025 learned_addr learned my addr 172.21.15.77:0/2284641025 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adeffd640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae0198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adffff640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 0x7f3ae019cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 -- 172.21.15.77:0/2284641025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 msgr2=0x7f3ae019cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 0x7f3ae019cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 -- 172.21.15.77:0/2284641025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 msgr2=0x7f3ae0198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae0198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 -- 172.21.15.77:0/2284641025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae019d3c0 con 0x7f3ae0102de0 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adeffd640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adf7fe640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0005ab0 tx=0x7f3ad00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:46.900 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad003f030 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae019d650 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ad0003ce0 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0035070 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.876+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01a4f90 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.877+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae006afd0 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.878+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ad0042030 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.879+0000 7f3adcff9640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 0x7f3acc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.880+0000 7f3adeffd640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 0x7f3acc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.880+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3ad00f0640 con 0x7f3ae0102de0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.880+0000 7f3adeffd640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 0x7f3acc0a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00fed30 tx=0x7f3ac800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:46.901 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:46.884+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ad00bcfd0 con 0x7f3ae0102de0 2024-09-15T23:31:47.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.054+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ae0107240 con 0x7f3ae0102de0 2024-09-15T23:31:47.055 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:46 smithi077 ceph-mon[30968]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:47.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.055+0000 7f3adcff9640 1 -- 172.21.15.77:0/2284641025 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7f3ad00bc8d0 con 0x7f3ae0102de0 2024-09-15T23:31:47.057 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:47.057 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.057+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 msgr2=0x7f3acc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.057+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 0x7f3acc0a5700 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00fed30 tx=0x7f3ac800a5c0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.057+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 msgr2=0x7f3ae0198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0005ab0 tx=0x7f3ad00042f0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 shutdown_connections 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3acc0a3240 0x7f3acc0a5700 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ae010c180 0x7f3ae019cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ae0103700 0x7f3ae0198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 --2- 172.21.15.77:0/2284641025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ae0102de0 0x7f3ae0198410 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:47.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 >> 172.21.15.77:0/2284641025 conn(0x7f3ae00fc7a0 msgr2=0x7f3ae00fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:47.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 shutdown_connections 2024-09-15T23:31:47.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:47.058+0000 7f3ae5db4640 1 -- 172.21.15.77:0/2284641025 wait complete. 2024-09-15T23:31:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:46 smithi159 ceph-mon[35472]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:47.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:46 smithi155 ceph-mon[35631]: pgmap v356: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:47.725 DEBUG:tasks.fwd_scrub:Yielding 2024-09-15T23:31:47.726 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-15T23:31:47.736 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:31:47.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-15T23:31:47.737 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-15T23:31:47.737 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:31:47.737 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:31:47.740 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-15T23:31:47.788 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-15T23:31:47.789 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:31:48.002 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:48.125 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:47 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2284641025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:48.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:47 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2284641025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:47 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2284641025' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 -- 172.21.15.77:0/196312658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0105590 msgr2=0x7f86c010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 --2- 172.21.15.77:0/196312658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0105590 0x7f86c010d110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ca0 tx=0x7f86b802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 -- 172.21.15.77:0/196312658 shutdown_connections 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 --2- 172.21.15.77:0/196312658 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0105590 0x7f86c010d110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 --2- 172.21.15.77:0/196312658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 0x7f86c0104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 --2- 172.21.15.77:0/196312658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0100460 0x7f86c0100840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 -- 172.21.15.77:0/196312658 >> 172.21.15.77:0/196312658 conn(0x7f86c00fbee0 msgr2=0x7f86c00fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 -- 172.21.15.77:0/196312658 shutdown_connections 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.474+0000 7f86c8755640 1 -- 172.21.15.77:0/196312658 wait complete. 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 Processor -- start 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 -- start start 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 0x7f86c0198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 0x7f86c019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010fd70 con 0x7f86c0100460 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010fbf0 con 0x7f86c0100e10 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c8755640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010fef0 con 0x7f86c0105590 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34298/0 (socket says 172.21.15.77:34298) 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 -- 172.21.15.77:0/1477131014 learned_addr learned my addr 172.21.15.77:0/1477131014 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:48.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 0x7f86c0198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 0x7f86c019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 -- 172.21.15.77:0/1477131014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 msgr2=0x7f86c019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 0x7f86c019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 -- 172.21.15.77:0/1477131014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 msgr2=0x7f86c0198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 0x7f86c0198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c64f1640 1 -- 172.21.15.77:0/1477131014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c019d390 con 0x7f86c0100460 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.475+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 0x7f86c019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00d770 tx=0x7f86bc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86b37fe640 1 -- 172.21.15.77:0/1477131014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc017070 con 0x7f86c0100460 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86b37fe640 1 -- 172.21.15.77:0/1477131014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86bc005500 con 0x7f86c0100460 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c019d680 con 0x7f86c0100460 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86b37fe640 1 -- 172.21.15.77:0/1477131014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc004e00 con 0x7f86c0100460 2024-09-15T23:31:48.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.476+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01a4f60 con 0x7f86c0100460 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.478+0000 7f86b37fe640 1 -- 172.21.15.77:0/1477131014 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f86bc004fa0 con 0x7f86c0100460 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.478+0000 7f86cab2e740 1 Processor -- start 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.478+0000 7f86cab2e740 1 -- start start 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf41f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf4cd40 0x55a16bf4f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86b37fe640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 0x7f86ac0a5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a16bea7280 con 0x55a16bf42480 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a16be4eb10 con 0x55a16bf41b60 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86cab2e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a16bea3240 con 0x55a16bf4cd40 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 0x7f86ac0a5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34314/0 (socket says 172.21.15.77:34314) 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 -- 172.21.15.77:0/1306690343 learned_addr learned my addr 172.21.15.77:0/1306690343 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf41f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86b37fe640 1 -- 172.21.15.77:0/1477131014 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f86bc0cf760 con 0x7f86c0100460 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf4cd40 0x55a16bf4f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 -- 172.21.15.77:0/1306690343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf4cd40 msgr2=0x55a16bf4f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf4cd40 0x55a16bf4f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 -- 172.21.15.77:0/1306690343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 msgr2=0x55a16bf41f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf41f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 -- 172.21.15.77:0/1306690343 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16be5b1f0 con 0x55a16bf42480 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 0x7f86ac0a5770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006010 tx=0x7f86b802f3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.479+0000 7f86c64f1640 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009610 tx=0x7f86bc06e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acfa51e01844095f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86b0ff9640 1 -- 172.21.15.77:0/1306690343 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc020040 con 0x55a16bf42480 2024-09-15T23:31:48.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86b0ff9640 1 -- 172.21.15.77:0/1306690343 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86bc0046c0 con 0x55a16bf42480 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86b0ff9640 1 -- 172.21.15.77:0/1306690343 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0a4660 con 0x55a16bf42480 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 -- 172.21.15.77:0/1306690343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 msgr2=0x55a16bf4c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86bc009610 tx=0x7f86bc06e870 comp rx=0 tx=0).stop 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 -- 172.21.15.77:0/1306690343 shutdown_connections 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf4cd40 0x55a16bf4f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf4c800 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 --2- 172.21.15.77:0/1306690343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf41f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.480+0000 7f86cab2e740 1 -- 172.21.15.77:0/1306690343 >> 172.21.15.77:0/1306690343 conn(0x55a16bf3e0f0 msgr2=0x55a16bf3e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- 172.21.15.77:0/1306690343 shutdown_connections 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- 172.21.15.77:0/1306690343 wait complete. 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- start start 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 Processor -- start 2024-09-15T23:31:48.489 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf49c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 0x55a16bf4a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a16bf4f910 con 0x55a16bf4cd40 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a16be61f10 con 0x55a16bf42480 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a16bf4fa90 con 0x55a16bf41b60 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86cab2e740 10 client.0 _ll_register_callbacks cb 0x55a16be2aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86c6cf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86c6cf2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34320/0 (socket says 172.21.15.77:34320) 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86c6cf2640 1 -- 172.21.15.77:0/2309833976 learned_addr learned my addr 172.21.15.77:0/2309833976 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.481+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf49c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 -- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 msgr2=0x55a16bf49c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf49c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 0x55a16bf4a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 -- 172.21.15.77:0/2309833976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 msgr2=0x55a16bf4a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 0x55a16bf4a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 -- 172.21.15.77:0/2309833976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16bc186a0 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 0x55a16bf4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f86b8031730 tx=0x7f86b8046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c600705f782487 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8050030 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f86b80045b0 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a16beb47f0 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86b805d050 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86cab2e740 10 client.15216 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a16bf5b550 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.482+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a16beb47f0 con 0x55a16bf4cd40 2024-09-15T23:31:48.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86b80305c0 con 0x55a16bf4cd40 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 10 client.15216 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 10 client.15216 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 20 client.15216 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bf5eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 4 client.15216 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:31:48.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a16beaed00 con 0x55a16bf5cab0 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.483+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bf5eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.484+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bf5eef0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e842769d261005f server_cookie=5ab1b83ca8a7dc43 in_seq=0 out_seq=0 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.484+0000 7f86a9ffb640 10 client.15216 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.484+0000 7f86a9ffb640 1 -- 172.21.15.77:0/2309833976 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a16beaed00 con 0x55a16bf5cab0 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.484+0000 7f86a9ffb640 10 client.15216 handle_command_reply: tid=0 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.484+0000 7f86cab2e740 1 client.15216 shutdown 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 msgr2=0x55a16bf4a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f86b8031730 tx=0x7f86b8046000 comp rx=0 tx=0).stop 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 shutdown_connections 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bf5eef0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf4a6f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf42480 0x55a16bf4a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2309833976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf49c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86a9ffb640 0 client.15216 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 >> 172.21.15.77:0/2309833976 conn(0x55a16bf3e0f0 msgr2=0x55a16bf43e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 shutdown_connections 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 1 -- 172.21.15.77:0/2309833976 wait complete. 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.485+0000 7f86cab2e740 20 client.15216 trim_cache size 0 max 16384 2024-09-15T23:31:48.495 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 Processor -- start 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 -- start start 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf4cd40 0x55a16bf46ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01accc0 con 0x55a16bf42480 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01af540 con 0x55a16bf4cd40 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.503+0000 7f86cab2e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01ad330 con 0x55a16bf41b60 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c5cf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c5cf0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34338/0 (socket says 172.21.15.77:34338) 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c5cf0640 1 -- 172.21.15.77:0/2354632986 learned_addr learned my addr 172.21.15.77:0/2354632986 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf4cd40 0x55a16bf46ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 -- 172.21.15.77:0/2354632986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf4cd40 msgr2=0x55a16bf46ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf4cd40 0x55a16bf46ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 -- 172.21.15.77:0/2354632986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 msgr2=0x55a16bf64d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 -- 172.21.15.77:0/2354632986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a16bf39830 con 0x55a16bf41b60 2024-09-15T23:31:48.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:31:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86c64f1640 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf647c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55a16bf3ef50 tx=0x7f86bc0c67c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb35462a6051db99 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86abfff640 1 -- 172.21.15.77:0/2354632986 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc014070 con 0x55a16bf41b60 2024-09-15T23:31:48.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86abfff640 1 -- 172.21.15.77:0/2354632986 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86bc09c0f0 con 0x55a16bf41b60 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.504+0000 7f86abfff640 1 -- 172.21.15.77:0/2354632986 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc020040 con 0x55a16bf41b60 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 -- 172.21.15.77:0/2354632986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 msgr2=0x55a16bf647c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf647c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x55a16bf3ef50 tx=0x7f86bc0c67c0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 -- 172.21.15.77:0/2354632986 shutdown_connections 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf4cd40 0x55a16bf46ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf42480 0x55a16bf64d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 --2- 172.21.15.77:0/2354632986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf41b60 0x55a16bf647c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 -- 172.21.15.77:0/2354632986 >> 172.21.15.77:0/2354632986 conn(0x55a16bf3e0f0 msgr2=0x55a16bf4bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 -- 172.21.15.77:0/2354632986 shutdown_connections 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.505+0000 7f86cab2e740 1 -- 172.21.15.77:0/2354632986 wait complete. 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 -- start start 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 Processor -- start 2024-09-15T23:31:48.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf42480 0x55a16bf471f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf47730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01ada00 con 0x55a16bf4cd40 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01aee70 con 0x55a16bf41b60 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86c01ae0d0 con 0x55a16bf42480 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86c64f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:54206/0 (socket says 172.21.15.77:54206) 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86c64f1640 1 -- 172.21.15.77:0/733185846 learned_addr learned my addr 172.21.15.77:0/733185846 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86cab2e740 10 client.0 _ll_register_callbacks cb 0x7f86b8003d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86c6cf2640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf47730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.506+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf42480 0x55a16bf471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 -- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf42480 msgr2=0x55a16bf471f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf42480 0x55a16bf471f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 -- 172.21.15.77:0/733185846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 msgr2=0x55a16bf47730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf47730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 -- 172.21.15.77:0/733185846 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a16bfc67e0 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86c64f1640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00d740 tx=0x7f86bc0048a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb84d0b3ab333d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86a9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86bc0b3020 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f86bc09c0f0 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f86bc099cf0 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f86bc014070 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86cab2e740 10 client.24782 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a16bfc7ae0 con 0x55a16bf41b60 2024-09-15T23:31:48.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.507+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86bc09c0f0 con 0x55a16bf41b60 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f86bc0a41d0 con 0x55a16bf41b60 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 10 client.24782 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 10 client.24782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 20 client.24782 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bfc9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 4 client.24782 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a16be2b110 con 0x55a16bf5cab0 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bfc9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86a9ffb640 10 client.24782 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:48.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.508+0000 7f86c5cf0640 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bfc9d20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5571c7a16c0cb76d server_cookie=a1fff01fcbde3af7 in_seq=0 out_seq=0 2024-09-15T23:31:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.509+0000 7f86a9ffb640 1 -- 172.21.15.77:0/733185846 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a16be2b110 con 0x55a16bf5cab0 2024-09-15T23:31:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.509+0000 7f86a9ffb640 10 client.24782 handle_command_reply: tid=0 2024-09-15T23:31:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.509+0000 7f86cab2e740 1 client.24782 shutdown 2024-09-15T23:31:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.509+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 msgr2=0x55a16bf46cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.514 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.509+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00d740 tx=0x7f86bc0048a0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 shutdown_connections 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a16bf5cab0 0x55a16bfc9d20 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a16bf4cd40 0x55a16bf47730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a16bf42480 0x55a16bf471f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 --2- 172.21.15.77:0/733185846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a16bf41b60 0x55a16bf46cb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86a9ffb640 0 client.24782 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 >> 172.21.15.77:0/733185846 conn(0x55a16bf3e0f0 msgr2=0x55a16bf435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 shutdown_connections 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 1 -- 172.21.15.77:0/733185846 wait complete. 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86cab2e740 20 client.24782 trim_cache size 0 max 16384 2024-09-15T23:31:48.515 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:31:48.516 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:31:48.516 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "2c955d8d-0f2e-4336-9a64-0911792cffca", 2024-09-15T23:31:48.516 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:31:48.516 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:31:48.516 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 msgr2=0x7f86ac0a5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.510+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 0x7f86ac0a5770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f86b8006010 tx=0x7f86b802f3e0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 msgr2=0x7f86c01983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86bc00d770 tx=0x7f86bc00dc30 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 shutdown_connections 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f86ac0a32b0 0x7f86ac0a5770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86c0105590 0x7f86c019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f86c0100e10 0x7f86c0198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 --2- 172.21.15.77:0/1477131014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f86c0100460 0x7f86c01983e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 >> 172.21.15.77:0/1477131014 conn(0x7f86c00fbee0 msgr2=0x7f86c00fd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 shutdown_connections 2024-09-15T23:31:48.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:48.511+0000 7f86c8755640 1 -- 172.21.15.77:0/1477131014 wait complete. 2024-09-15T23:31:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:48 smithi077 ceph-mon[30968]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:31:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:48 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:31:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:48 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:48 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:31:49.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:48 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:48 smithi155 ceph-mon[35631]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:31:49.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:48 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:31:49.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:48 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:48 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:31:49.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:48 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- 172.21.15.77:0/122949370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14102790 msgr2=0x7fce141067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 --2- 172.21.15.77:0/122949370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14102790 0x7fce141067e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fce08009900 tx=0x7fce0802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- 172.21.15.77:0/122949370 shutdown_connections 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 --2- 172.21.15.77:0/122949370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 0x7fce1410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 --2- 172.21.15.77:0/122949370 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14102790 0x7fce141067e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 --2- 172.21.15.77:0/122949370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14101de0 0x7fce141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- 172.21.15.77:0/122949370 >> 172.21.15.77:0/122949370 conn(0x7fce140fd880 msgr2=0x7fce140ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- 172.21.15.77:0/122949370 shutdown_connections 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- 172.21.15.77:0/122949370 wait complete. 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 Processor -- start 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.258+0000 7fce19e5f640 1 -- start start 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14102790 0x7fce14074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 0x7fce14074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce14111f70 con 0x7fce14101de0 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce14111df0 con 0x7fce14102790 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce19e5f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fce141120f0 con 0x7fce14106f10 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34352/0 (socket says 172.21.15.77:34352) 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 -- 172.21.15.77:0/3338262778 learned_addr learned my addr 172.21.15.77:0/3338262778 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:49.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce12ffd640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14102790 0x7fce14074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce13fff640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 0x7fce14074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 -- 172.21.15.77:0/3338262778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 msgr2=0x7fce14074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 0x7fce14074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 -- 172.21.15.77:0/3338262778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14102790 msgr2=0x7fce14074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14102790 0x7fce14074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 -- 172.21.15.77:0/3338262778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce141a68f0 con 0x7fce14101de0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce137fe640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d950 tx=0x7fce0400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce04017030 con 0x7fce14101de0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.259+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce04004020 con 0x7fce14101de0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.260+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce141a6be0 con 0x7fce14101de0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.260+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce040047a0 con 0x7fce14101de0 2024-09-15T23:31:49.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.260+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce141a7140 con 0x7fce14101de0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.261+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce141021c0 con 0x7fce14101de0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.262+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fce040041d0 con 0x7fce14101de0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.263+0000 7fce10ff9640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 0x7fcdfc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.263+0000 7fce12ffd640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 0x7fcdfc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.263+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fce040cf600 con 0x7fce14101de0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.263+0000 7fce12ffd640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 0x7fcdfc0a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fce08009230 tx=0x7fce080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:49.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.267+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fce0409bf90 con 0x7fce14101de0 2024-09-15T23:31:49.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.435+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fce14062630 con 0x7fcdfc0a32c0 2024-09-15T23:31:49.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.443+0000 7fce10ff9640 1 -- 172.21.15.77:0/3338262778 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340400 (secure 0 0 0) 0x7fce14062630 con 0x7fcdfc0a32c0 2024-09-15T23:31:49.448 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:49.449 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.446+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 msgr2=0x7fcdfc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.446+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 0x7fcdfc0a5780 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fce08009230 tx=0x7fce080058d0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.446+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 msgr2=0x7fce140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:49.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.446+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fce0400d950 tx=0x7fce0400de10 comp rx=0 tx=0).stop 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.446+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 shutdown_connections 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdfc0a32c0 0x7fcdfc0a5780 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fce14106f10 0x7fce14074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce14102790 0x7fce14074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 --2- 172.21.15.77:0/3338262778 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fce14101de0 0x7fce140744f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 >> 172.21.15.77:0/3338262778 conn(0x7fce140fd880 msgr2=0x7fce140febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 shutdown_connections 2024-09-15T23:31:49.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:49.447+0000 7fce19e5f640 1 -- 172.21.15.77:0/3338262778 wait complete. 2024-09-15T23:31:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:48 smithi159 ceph-mon[35472]: pgmap v357: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 938 B/s wr, 2 op/s 2024-09-15T23:31:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:48 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:31:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:48 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:48 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:31:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:48 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:31:49.738 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:31:50.392 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2024-09-15T23:31:47.829852+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661394,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":328,"num_read_kb":282,"num_write":277,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":717,"ondisk_log_size":717,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396588,"kb_used_data":14060,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545236,"statfs":{"total":1151940427776,"available":1151534321664,"internally_reserved":0,"allocated":14397440,"data_stored":8095304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5930,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":18,"num_write":9,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003089"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989709+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:30:37.989709+0000","last_peered":"2024-09-15T23:30:37.989709+0000","last_clean":"2024-09-15T23:30:37.989709+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:30:37.989709+0000","last_undegraded":"2024-09-15T23:30:37.989709+0000","last_fullsized":"2024-09-15T23:30:37.989709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817995+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.817995+0000","last_peered":"2024-09-15T23:31:35.817995+0000","last_clean":"2024-09-15T23:31:35.817995+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.817995+0000","last_undegraded":"2024-09-15T23:31:35.817995+0000","last_fullsized":"2024-09-15T23:31:35.817995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815051+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.815051+0000","last_peered":"2024-09-15T23:31:35.815051+0000","last_clean":"2024-09-15T23:31:35.815051+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.815051+0000","last_undegraded":"2024-09-15T23:31:35.815051+0000","last_fullsized":"2024-09-15T23:31:35.815051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814437+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.814437+0000","last_peered":"2024-09-15T23:31:35.814437+0000","last_clean":"2024-09-15T23:31:35.814437+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.814437+0000","last_undegraded":"2024-09-15T23:31:35.814437+0000","last_fullsized":"2024-09-15T23:31:35.814437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996266+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996266+0000","last_peered":"2024-09-15T23:30:37.996266+0000","last_clean":"2024-09-15T23:30:37.996266+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996266+0000","last_undegraded":"2024-09-15T23:30:37.996266+0000","last_fullsized":"2024-09-15T23:30:37.996266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.932069+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:38.932069+0000","last_peered":"2024-09-15T23:31:38.932069+0000","last_clean":"2024-09-15T23:31:38.932069+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:38.932069+0000","last_undegraded":"2024-09-15T23:31:38.932069+0000","last_fullsized":"2024-09-15T23:31:38.932069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994442+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994442+0000","last_peered":"2024-09-15T23:30:37.994442+0000","last_clean":"2024-09-15T23:30:37.994442+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994442+0000","last_undegraded":"2024-09-15T23:30:37.994442+0000","last_fullsized":"2024-09-15T23:30:37.994442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.179058+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.179058+0000","last_peered":"2024-09-15T23:30:38.179058+0000","last_clean":"2024-09-15T23:30:38.179058+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.179058+0000","last_undegraded":"2024-09-15T23:30:38.179058+0000","last_fullsized":"2024-09-15T23:30:38.179058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991734+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991734+0000","last_peered":"2024-09-15T23:30:37.991734+0000","last_clean":"2024-09-15T23:30:37.991734+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991734+0000","last_undegraded":"2024-09-15T23:30:37.991734+0000","last_fullsized":"2024-09-15T23:30:37.991734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992053+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992053+0000","last_peered":"2024-09-15T23:30:37.992053+0000","last_clean":"2024-09-15T23:30:37.992053+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992053+0000","last_undegraded":"2024-09-15T23:30:37.992053+0000","last_fullsized":"2024-09-15T23:30:37.992053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176384+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176384+0000","last_peered":"2024-09-15T23:30:38.176384+0000","last_clean":"2024-09-15T23:30:38.176384+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176384+0000","last_undegraded":"2024-09-15T23:30:38.176384+0000","last_fullsized":"2024-09-15T23:30:38.176384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822180+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822180+0000","last_peered":"2024-09-15T23:31:35.822180+0000","last_clean":"2024-09-15T23:31:35.822180+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822180+0000","last_undegraded":"2024-09-15T23:31:35.822180+0000","last_fullsized":"2024-09-15T23:31:35.822180+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996899+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996899+0000","last_peered":"2024-09-15T23:30:37.996899+0000","last_clean":"2024-09-15T23:30:37.996899+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996899+0000","last_undegraded":"2024-09-15T23:30:37.996899+0000","last_fullsized":"2024-09-15T23:30:37.996899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176675+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176675+0000","last_peered":"2024-09-15T23:30:38.176675+0000","last_clean":"2024-09-15T23:30:38.176675+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176675+0000","last_undegraded":"2024-09-15T23:30:38.176675+0000","last_fullsized":"2024-09-15T23:30:38.176675+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816078+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816078+0000","last_peered":"2024-09-15T23:31:35.816078+0000","last_clean":"2024-09-15T23:31:35.816078+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816078+0000","last_undegraded":"2024-09-15T23:31:35.816078+0000","last_fullsized":"2024-09-15T23:31:35.816078+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175925+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175925+0000","last_peered":"2024-09-15T23:30:38.175925+0000","last_clean":"2024-09-15T23:30:38.175925+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175925+0000","last_undegraded":"2024-09-15T23:30:38.175925+0000","last_fullsized":"2024-09-15T23:30:38.175925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822752+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822752+0000","last_peered":"2024-09-15T23:31:35.822752+0000","last_clean":"2024-09-15T23:31:35.822752+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822752+0000","last_undegraded":"2024-09-15T23:31:35.822752+0000","last_fullsized":"2024-09-15T23:31:35.822752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991686+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991686+0000","last_peered":"2024-09-15T23:30:37.991686+0000","last_clean":"2024-09-15T23:30:37.991686+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991686+0000","last_undegraded":"2024-09-15T23:30:37.991686+0000","last_fullsized":"2024-09-15T23:30:37.991686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174916+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174916+0000","last_peered":"2024-09-15T23:30:38.174916+0000","last_clean":"2024-09-15T23:30:38.174916+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174916+0000","last_undegraded":"2024-09-15T23:30:38.174916+0000","last_fullsized":"2024-09-15T23:30:38.174916+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817164+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.817164+0000","last_peered":"2024-09-15T23:31:35.817164+0000","last_clean":"2024-09-15T23:31:35.817164+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.817164+0000","last_undegraded":"2024-09-15T23:31:35.817164+0000","last_fullsized":"2024-09-15T23:31:35.817164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997109+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997109+0000","last_peered":"2024-09-15T23:30:37.997109+0000","last_clean":"2024-09-15T23:30:37.997109+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997109+0000","last_undegraded":"2024-09-15T23:30:37.997109+0000","last_fullsized":"2024-09-15T23:30:37.997109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174964+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.174964+0000","last_peered":"2024-09-15T23:30:38.174964+0000","last_clean":"2024-09-15T23:30:38.174964+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.174964+0000","last_undegraded":"2024-09-15T23:30:38.174964+0000","last_fullsized":"2024-09-15T23:30:38.174964+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813715+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.813715+0000","last_peered":"2024-09-15T23:31:35.813715+0000","last_clean":"2024-09-15T23:31:35.813715+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.813715+0000","last_undegraded":"2024-09-15T23:31:35.813715+0000","last_fullsized":"2024-09-15T23:31:35.813715+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994705+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994705+0000","last_peered":"2024-09-15T23:30:37.994705+0000","last_clean":"2024-09-15T23:30:37.994705+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994705+0000","last_undegraded":"2024-09-15T23:30:37.994705+0000","last_fullsized":"2024-09-15T23:30:37.994705+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815907+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815907+0000","last_peered":"2024-09-15T23:31:35.815907+0000","last_clean":"2024-09-15T23:31:35.815907+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815907+0000","last_undegraded":"2024-09-15T23:31:35.815907+0000","last_fullsized":"2024-09-15T23:31:35.815907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989893+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989893+0000","last_peered":"2024-09-15T23:30:37.989893+0000","last_clean":"2024-09-15T23:30:37.989893+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989893+0000","last_undegraded":"2024-09-15T23:30:37.989893+0000","last_fullsized":"2024-09-15T23:30:37.989893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814161+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814161+0000","last_peered":"2024-09-15T23:31:35.814161+0000","last_clean":"2024-09-15T23:31:35.814161+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814161+0000","last_undegraded":"2024-09-15T23:31:35.814161+0000","last_fullsized":"2024-09-15T23:31:35.814161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810996+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.810996+0000","last_peered":"2024-09-15T23:31:35.810996+0000","last_clean":"2024-09-15T23:31:35.810996+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.810996+0000","last_undegraded":"2024-09-15T23:31:35.810996+0000","last_fullsized":"2024-09-15T23:31:35.810996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996783+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996783+0000","last_peered":"2024-09-15T23:30:37.996783+0000","last_clean":"2024-09-15T23:30:37.996783+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996783+0000","last_undegraded":"2024-09-15T23:30:37.996783+0000","last_fullsized":"2024-09-15T23:30:37.996783+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":266,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:43.049016+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:43.049016+0000","last_peered":"2024-09-15T23:31:43.049016+0000","last_clean":"2024-09-15T23:31:43.049016+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:43.049016+0000","last_undegraded":"2024-09-15T23:31:43.049016+0000","last_fullsized":"2024-09-15T23:31:43.049016+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69994,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":167,"num_write":36,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816098+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816098+0000","last_peered":"2024-09-15T23:31:35.816098+0000","last_clean":"2024-09-15T23:31:35.816098+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816098+0000","last_undegraded":"2024-09-15T23:31:35.816098+0000","last_fullsized":"2024-09-15T23:31:35.816098+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177004+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.177004+0000","last_peered":"2024-09-15T23:30:38.177004+0000","last_clean":"2024-09-15T23:30:38.177004+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.177004+0000","last_undegraded":"2024-09-15T23:30:38.177004+0000","last_fullsized":"2024-09-15T23:30:38.177004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814725+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814725+0000","last_peered":"2024-09-15T23:31:35.814725+0000","last_clean":"2024-09-15T23:31:35.814725+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814725+0000","last_undegraded":"2024-09-15T23:31:35.814725+0000","last_fullsized":"2024-09-15T23:31:35.814725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813766+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813766+0000","last_peered":"2024-09-15T23:31:35.813766+0000","last_clean":"2024-09-15T23:31:35.813766+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813766+0000","last_undegraded":"2024-09-15T23:31:35.813766+0000","last_fullsized":"2024-09-15T23:31:35.813766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821943+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821943+0000","last_peered":"2024-09-15T23:31:35.821943+0000","last_clean":"2024-09-15T23:31:35.821943+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821943+0000","last_undegraded":"2024-09-15T23:31:35.821943+0000","last_fullsized":"2024-09-15T23:31:35.821943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817598+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817598+0000","last_peered":"2024-09-15T23:31:35.817598+0000","last_clean":"2024-09-15T23:31:35.817598+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817598+0000","last_undegraded":"2024-09-15T23:31:35.817598+0000","last_fullsized":"2024-09-15T23:31:35.817598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810734+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810734+0000","last_peered":"2024-09-15T23:31:35.810734+0000","last_clean":"2024-09-15T23:31:35.810734+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810734+0000","last_undegraded":"2024-09-15T23:31:35.810734+0000","last_fullsized":"2024-09-15T23:31:35.810734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.803949+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.803949+0000","last_peered":"2024-09-15T23:31:35.803949+0000","last_clean":"2024-09-15T23:31:35.803949+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.803949+0000","last_undegraded":"2024-09-15T23:31:35.803949+0000","last_fullsized":"2024-09-15T23:31:35.803949+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817512+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817512+0000","last_peered":"2024-09-15T23:31:35.817512+0000","last_clean":"2024-09-15T23:31:35.817512+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817512+0000","last_undegraded":"2024-09-15T23:31:35.817512+0000","last_fullsized":"2024-09-15T23:31:35.817512+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817475+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817475+0000","last_peered":"2024-09-15T23:31:35.817475+0000","last_clean":"2024-09-15T23:31:35.817475+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817475+0000","last_undegraded":"2024-09-15T23:31:35.817475+0000","last_fullsized":"2024-09-15T23:31:35.817475+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814272+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814272+0000","last_peered":"2024-09-15T23:31:35.814272+0000","last_clean":"2024-09-15T23:31:35.814272+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814272+0000","last_undegraded":"2024-09-15T23:31:35.814272+0000","last_fullsized":"2024-09-15T23:31:35.814272+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816156+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816156+0000","last_peered":"2024-09-15T23:31:35.816156+0000","last_clean":"2024-09-15T23:31:35.816156+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816156+0000","last_undegraded":"2024-09-15T23:31:35.816156+0000","last_fullsized":"2024-09-15T23:31:35.816156+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":202,"num_read_kb":173,"num_write":94,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":212376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481833,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710765,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1167144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874291,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103224,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364861,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790023,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953549,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182482,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411415,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":576616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":576582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:50.398 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:31:50.472 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.942+0000 7fb65dcab640 1 -- 172.21.15.77:0/1526579459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658102ef0 msgr2=0x7fb65810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.942+0000 7fb65dcab640 1 --2- 172.21.15.77:0/1526579459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658102ef0 0x7fb65810da40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb650009ca0 tx=0x7fb65002a950 comp rx=0 tx=0).stop 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 -- 172.21.15.77:0/1526579459 shutdown_connections 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 --2- 172.21.15.77:0/1526579459 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658102ef0 0x7fb65810da40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 --2- 172.21.15.77:0/1526579459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102570 0x7fb6581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 --2- 172.21.15.77:0/1526579459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658100e20 0x7fb658101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 -- 172.21.15.77:0/1526579459 >> 172.21.15.77:0/1526579459 conn(0x7fb6580fc7d0 msgr2=0x7fb6580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 -- 172.21.15.77:0/1526579459 shutdown_connections 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 -- 172.21.15.77:0/1526579459 wait complete. 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 Processor -- start 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.943+0000 7fb65dcab640 1 -- start start 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 0x7fb6581979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102ef0 0x7fb65819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb658110f80 con 0x7fb658100e20 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb658110e00 con 0x7fb658102ef0 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb65dcab640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb658111100 con 0x7fb658102570 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34378/0 (socket says 172.21.15.77:34378) 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 -- 172.21.15.77:0/3569882281 learned_addr learned my addr 172.21.15.77:0/3569882281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb657fff640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102ef0 0x7fb65819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb64effd640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 0x7fb6581979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 -- 172.21.15.77:0/3569882281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 msgr2=0x7fb6581979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 0x7fb6581979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 -- 172.21.15.77:0/3569882281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102ef0 msgr2=0x7fb65819bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102ef0 0x7fb65819bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 -- 172.21.15.77:0/3569882281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb65819c410 con 0x7fb658100e20 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb64effd640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 0x7fb6581979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb648009860 tx=0x7fb648009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.944+0000 7fb6557fa640 1 -- 172.21.15.77:0/3569882281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648005020 con 0x7fb658100e20 2024-09-15T23:31:50.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.945+0000 7fb6557fa640 1 -- 172.21.15.77:0/3569882281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6480047a0 con 0x7fb658100e20 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.945+0000 7fb6557fa640 1 -- 172.21.15.77:0/3569882281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648007ba0 con 0x7fb658100e20 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.945+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb65819c700 con 0x7fb658100e20 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.945+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb658069f70 con 0x7fb658100e20 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb6557fa640 1 -- 172.21.15.77:0/3569882281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fb648004950 con 0x7fb658100e20 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 Processor -- start 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 -- start start 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d59760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d68a90 0x556ae5d6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ae5cbf2e0 con 0x556ae5d59ca0 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556ae5c66ce0 con 0x556ae5d59380 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb660084740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556ae5cbb2a0 con 0x556ae5d68a90 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.973 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb6557fa640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.947+0000 7fb6577fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34380/0 (socket says 172.21.15.77:34380) 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 -- 172.21.15.77:0/3982848739 learned_addr learned my addr 172.21.15.77:0/3982848739 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb657fff640 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d59760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb64effd640 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d68a90 0x556ae5d6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb657fff640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6557fa640 1 -- 172.21.15.77:0/3569882281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb6480d11e0 con 0x7fb658100e20 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 -- 172.21.15.77:0/3982848739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d68a90 msgr2=0x556ae5d6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d68a90 0x556ae5d6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 -- 172.21.15.77:0/3982848739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 msgr2=0x556ae5d59760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d59760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 -- 172.21.15.77:0/3982848739 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae5c4b440 con 0x556ae5d59ca0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb6577fe640 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb64809d170 tx=0x7fb648009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c86d8643fb7600f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb64dffb640 1 -- 172.21.15.77:0/3982848739 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb648004ce0 con 0x556ae5d59ca0 2024-09-15T23:31:50.974 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb64dffb640 1 -- 172.21.15.77:0/3982848739 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb64809db70 con 0x556ae5d59ca0 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb657fff640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 0x7fb6440a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb650004ad0 tx=0x7fb65002a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.948+0000 7fb64dffb640 1 -- 172.21.15.77:0/3982848739 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb64809c8c0 con 0x556ae5d59ca0 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- 172.21.15.77:0/3982848739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 msgr2=0x556ae5d68550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb64809d170 tx=0x7fb648009f70 comp rx=0 tx=0).stop 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- 172.21.15.77:0/3982848739 shutdown_connections 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d68a90 0x556ae5d6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d59ca0 0x556ae5d68550 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 --2- 172.21.15.77:0/3982848739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d59760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- 172.21.15.77:0/3982848739 >> 172.21.15.77:0/3982848739 conn(0x556ae5d55a30 msgr2=0x556ae5d55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- 172.21.15.77:0/3982848739 shutdown_connections 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- 172.21.15.77:0/3982848739 wait complete. 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.949+0000 7fb660084740 1 -- start start 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 Processor -- start 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d68420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.975 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x556ae5d6b600 con 0x556ae5d68a90 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556ae5c7a050 con 0x556ae5d59380 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x556ae5d6b780 con 0x556ae5d59ca0 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb660084740 10 client.0 _ll_register_callbacks cb 0x556ae5cba160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34386/0 (socket says 172.21.15.77:34386) 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 -- 172.21.15.77:0/1377254760 learned_addr learned my addr 172.21.15.77:0/1377254760 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d68420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 -- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 msgr2=0x556ae5d656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb64effd640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.976 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 -- 172.21.15.77:0/1377254760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 msgr2=0x556ae5d68420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d68420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 -- 172.21.15.77:0/1377254760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae5a303c0 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb657fff640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb650035000 tx=0x7fb6500095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3232f94f98507645 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.950+0000 7fb636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650043050 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb650004510 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb64809db70 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb65005c050 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 10 client.15240 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556ae5d77030 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb64809db70 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb650030440 con 0x556ae5d68a90 2024-09-15T23:31:50.977 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 10 client.15240 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 10 client.15240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 20 client.15240 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5d784f0 0x556ae5d7a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 4 client.15240 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ae5ccc850 con 0x556ae5d784f0 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.951+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5d784f0 0x556ae5d7a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.952+0000 7fb636ffd640 10 client.15240 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.952+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5d784f0 0x556ae5d7a990 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ee1b4ea0cd2bd07 server_cookie=3b1352dd76fe0c6c in_seq=0 out_seq=0 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb636ffd640 1 -- 172.21.15.77:0/1377254760 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ae5ccc850 con 0x556ae5d784f0 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb636ffd640 10 client.15240 handle_command_reply: tid=0 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 client.15240 shutdown 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 msgr2=0x556ae5d65c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.978 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb650035000 tx=0x7fb6500095c0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 shutdown_connections 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5d784f0 0x556ae5d7a990 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d65c50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 --2- 172.21.15.77:0/1377254760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d68420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb636ffd640 0 client.15240 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 >> 172.21.15.77:0/1377254760 conn(0x556ae5d55a30 msgr2=0x556ae5d5b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 shutdown_connections 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 1 -- 172.21.15.77:0/1377254760 wait complete. 2024-09-15T23:31:50.979 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.953+0000 7fb660084740 20 client.15240 trim_cache size 0 max 16384 2024-09-15T23:31:50.983 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 Processor -- start 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 -- start start 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d748a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d67640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581aaae0 con 0x556ae5d68a90 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581ad360 con 0x556ae5d59380 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb660084740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581ab150 con 0x556ae5d59ca0 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34394/0 (socket says 172.21.15.77:34394) 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.970+0000 7fb657fff640 1 -- 172.21.15.77:0/875372747 learned_addr learned my addr 172.21.15.77:0/875372747 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb6577fe640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d748a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb64effd640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d67640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 -- 172.21.15.77:0/875372747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 msgr2=0x556ae5d67640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.984 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d67640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 -- 172.21.15.77:0/875372747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 msgr2=0x556ae5d748a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d748a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 -- 172.21.15.77:0/875372747 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ae5d68790 con 0x556ae5d68a90 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb6577fe640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb657fff640 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb650009bf0 tx=0x7fb650009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91022a9a066f7ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb64d7fa640 1 -- 172.21.15.77:0/875372747 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650043070 con 0x556ae5d68a90 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb64d7fa640 1 -- 172.21.15.77:0/875372747 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb650030e50 con 0x556ae5d68a90 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.971+0000 7fb64d7fa640 1 -- 172.21.15.77:0/875372747 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650034040 con 0x556ae5d68a90 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- 172.21.15.77:0/875372747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 msgr2=0x556ae5d80260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb650009bf0 tx=0x7fb650009800 comp rx=0 tx=0).stop 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- 172.21.15.77:0/875372747 shutdown_connections 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5d80260 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d67640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.985 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 --2- 172.21.15.77:0/875372747 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d748a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- 172.21.15.77:0/875372747 >> 172.21.15.77:0/875372747 conn(0x556ae5d55a30 msgr2=0x556ae5d66f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- 172.21.15.77:0/875372747 shutdown_connections 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- 172.21.15.77:0/875372747 wait complete. 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.972+0000 7fb660084740 1 -- start start 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 Processor -- start 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d6cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d6d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581ab820 con 0x556ae5d68a90 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581acc90 con 0x556ae5d59380 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6581abef0 con 0x556ae5d59ca0 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb660084740 10 client.0 _ll_register_callbacks cb 0x7fb6500098c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.986 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb657fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34410/0 (socket says 172.21.15.77:34410) 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb657fff640 1 -- 172.21.15.77:0/1430976636 learned_addr learned my addr 172.21.15.77:0/1430976636 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d6cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb64effd640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d6d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.973+0000 7fb657fff640 1 -- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 msgr2=0x556ae5d6d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb657fff640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d6d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb657fff640 1 -- 172.21.15.77:0/1430976636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 msgr2=0x556ae5d6cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb657fff640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d6cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb657fff640 1 -- 172.21.15.77:0/1430976636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ae5d6d900 con 0x556ae5d68a90 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d6cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb64effd640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d6d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb657fff640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb650009870 tx=0x7fb650030a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfa3f94b8e20da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb636ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb650043050 con 0x556ae5d68a90 2024-09-15T23:31:50.987 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fb650004720 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb650030e50 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fb650070050 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb660084740 10 client.15246 fetch_fsmap learned FSMap version 21 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x556ae5de3890 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.974+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb650030e50 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fb65005f070 con 0x556ae5d68a90 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 10 client.15246 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 10 client.15246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 20 client.15246 populate_metadata read hostname 'smithi077' 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5de3e40 0x556ae5de6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 4 client.15246 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556ae5cc6d60 con 0x556ae5de3e40 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5de3e40 0x556ae5de6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:50.988 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb6577fe640 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5de3e40 0x556ae5de6230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce6fa0fecbac783 server_cookie=e8654f4584dd3b1b in_seq=0 out_seq=0 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.975+0000 7fb636ffd640 10 client.15246 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb636ffd640 1 -- 172.21.15.77:0/1430976636 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556ae5cc6d60 con 0x556ae5de3e40 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb636ffd640 10 client.15246 handle_command_reply: tid=0 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 client.15246 shutdown 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 msgr2=0x556ae5de2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb650009870 tx=0x7fb650030a00 comp rx=0 tx=0).stop 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 shutdown_connections 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x556ae5de3e40 0x556ae5de6230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x556ae5d68a90 0x556ae5de2230 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x556ae5d59ca0 0x556ae5d6d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb636ffd640 0 client.15246 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 --2- 172.21.15.77:0/1430976636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556ae5d59380 0x556ae5d6cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.989 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 >> 172.21.15.77:0/1430976636 conn(0x556ae5d55a30 msgr2=0x556ae5d66f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 shutdown_connections 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 1 -- 172.21.15.77:0/1430976636 wait complete. 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.976+0000 7fb660084740 20 client.15246 trim_cache size 0 max 16384 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": { 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "2c955d8d-0f2e-4336-9a64-0911792cffca": { 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "path": "/", 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "tag": "2c955d8d-0f2e-4336-9a64-0911792cffca", 2024-09-15T23:31:50.990 INFO:teuthology.orchestra.run.smithi077.stdout: "options": "recursive,force" 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 msgr2=0x7fb6440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 0x7fb6440a5700 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb650004ad0 tx=0x7fb65002a950 comp rx=0 tx=0).stop 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 msgr2=0x7fb658197460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb648009860 tx=0x7fb648009d20 comp rx=0 tx=0).stop 2024-09-15T23:31:50.991 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 shutdown_connections 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fb6440a3240 0x7fb6440a5700 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb658102ef0 0x7fb65819bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb658102570 0x7fb6581979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 --2- 172.21.15.77:0/3569882281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fb658100e20 0x7fb658197460 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 >> 172.21.15.77:0/3569882281 conn(0x7fb6580fc7d0 msgr2=0x7fb6581068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 shutdown_connections 2024-09-15T23:31:50.992 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:50.977+0000 7fb65dcab640 1 -- 172.21.15.77:0/3569882281 wait complete. 2024-09-15T23:31:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:50 smithi077 ceph-mon[30968]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:50 smithi077 ceph-mon[30968]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:51.237 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:51.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:50 smithi155 ceph-mon[35631]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:51.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:50 smithi155 ceph-mon[35631]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:50 smithi159 ceph-mon[35472]: from='client.15228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:50 smithi159 ceph-mon[35472]: pgmap v358: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:31:51.646 INFO:tasks.cephfs.filesystem:scrub status for tag:2c955d8d-0f2e-4336-9a64-0911792cffca - {'path': '/', 'tag': '2c955d8d-0f2e-4336-9a64-0911792cffca', 'options': 'recursive,force'} 2024-09-15T23:31:52.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 -- 172.21.15.77:0/1184577729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 msgr2=0x7f144010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:52.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 --2- 172.21.15.77:0/1184577729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f144010d950 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1438009cd0 tx=0x7f143802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 -- 172.21.15.77:0/1184577729 shutdown_connections 2024-09-15T23:31:52.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 --2- 172.21.15.77:0/1184577729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f144010d950 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 --2- 172.21.15.77:0/1184577729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440100a80 0x7f1440100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 --2- 172.21.15.77:0/1184577729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440106a80 0x7f1440106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 -- 172.21.15.77:0/1184577729 >> 172.21.15.77:0/1184577729 conn(0x7f14400fc7a0 msgr2=0x7f14400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 -- 172.21.15.77:0/1184577729 shutdown_connections 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.200+0000 7f1447c01640 1 -- 172.21.15.77:0/1184577729 wait complete. 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 Processor -- start 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 -- start start 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440100a80 0x7f1440198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 0x7f144019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1440110e80 con 0x7f1440101420 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1440110d00 con 0x7f1440100a80 2024-09-15T23:31:52.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f1447c01640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1440111000 con 0x7f1440106a80 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34430/0 (socket says 172.21.15.77:34430) 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 -- 172.21.15.77:0/2260170337 learned_addr learned my addr 172.21.15.77:0/2260170337 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144619e640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 0x7f144019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144599d640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440100a80 0x7f1440198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 -- 172.21.15.77:0/2260170337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 msgr2=0x7f144019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 0x7f144019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 -- 172.21.15.77:0/2260170337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440100a80 msgr2=0x7f1440198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440100a80 0x7f1440198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144519c640 1 -- 172.21.15.77:0/2260170337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144019d3f0 con 0x7f1440101420 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.201+0000 7f144619e640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 0x7f144019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:52.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f144519c640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f143c00d770 tx=0x7f143c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c017070 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f143c005500 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f144019d6e0 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f143c004e00 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.202+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14401a4fc0 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.203+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1440100ee0 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.204+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f143c004fa0 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.204+0000 7f1436ffd640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 0x7f142c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.205+0000 7f144599d640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 0x7f142c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.205+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f143c0cfc00 con 0x7f1440101420 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.205+0000 7f144599d640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 0x7f142c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1430005d70 tx=0x7f1430005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:52.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.208+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f143c09c590 con 0x7f1440101420 2024-09-15T23:31:52.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:51 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:31:52.372 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.371+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f144006a790 con 0x7f142c0a3240 2024-09-15T23:31:52.372 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:51 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:31:52.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.379+0000 7f1436ffd640 1 -- 172.21.15.77:0/2260170337 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340399 (secure 0 0 0) 0x7f144006a790 con 0x7f142c0a3240 2024-09-15T23:31:52.383 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:52.385 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 msgr2=0x7f142c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 0x7f142c0a5700 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1430005d70 tx=0x7f1430005d00 comp rx=0 tx=0).stop 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 msgr2=0x7f1440198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f143c00d770 tx=0x7f143c00dc30 comp rx=0 tx=0).stop 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 shutdown_connections 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f142c0a3240 0x7f142c0a5700 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1440106a80 0x7f144019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1440101420 0x7f1440198980 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.387 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 --2- 172.21.15.77:0/2260170337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1440100a80 0x7f1440198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:52.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 >> 172.21.15.77:0/2260170337 conn(0x7f14400fc7a0 msgr2=0x7f1440104830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:52.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 shutdown_connections 2024-09-15T23:31:52.388 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:52.382+0000 7f1447c01640 1 -- 172.21.15.77:0/2260170337 wait complete. 2024-09-15T23:31:52.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:51 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:31:53.037 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":359,"stamp":"2024-09-15T23:31:51.831006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661394,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":340,"num_read_kb":289,"num_write":277,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":717,"ondisk_log_size":717,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396588,"kb_used_data":14060,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545236,"statfs":{"total":1151940427776,"available":1151534321664,"internally_reserved":0,"allocated":14397440,"data_stored":8095304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003123"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:33.931625+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:31:33.931625+0000","last_peered":"2024-09-15T23:31:33.931625+0000","last_clean":"2024-09-15T23:31:33.931625+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:31:33.931625+0000","last_undegraded":"2024-09-15T23:31:33.931625+0000","last_fullsized":"2024-09-15T23:31:33.931625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817995+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.817995+0000","last_peered":"2024-09-15T23:31:35.817995+0000","last_clean":"2024-09-15T23:31:35.817995+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.817995+0000","last_undegraded":"2024-09-15T23:31:35.817995+0000","last_fullsized":"2024-09-15T23:31:35.817995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815051+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.815051+0000","last_peered":"2024-09-15T23:31:35.815051+0000","last_clean":"2024-09-15T23:31:35.815051+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.815051+0000","last_undegraded":"2024-09-15T23:31:35.815051+0000","last_fullsized":"2024-09-15T23:31:35.815051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814437+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.814437+0000","last_peered":"2024-09-15T23:31:35.814437+0000","last_clean":"2024-09-15T23:31:35.814437+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.814437+0000","last_undegraded":"2024-09-15T23:31:35.814437+0000","last_fullsized":"2024-09-15T23:31:35.814437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996266+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996266+0000","last_peered":"2024-09-15T23:30:37.996266+0000","last_clean":"2024-09-15T23:30:37.996266+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996266+0000","last_undegraded":"2024-09-15T23:30:37.996266+0000","last_fullsized":"2024-09-15T23:30:37.996266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.932069+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:38.932069+0000","last_peered":"2024-09-15T23:31:38.932069+0000","last_clean":"2024-09-15T23:31:38.932069+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:38.932069+0000","last_undegraded":"2024-09-15T23:31:38.932069+0000","last_fullsized":"2024-09-15T23:31:38.932069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994442+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994442+0000","last_peered":"2024-09-15T23:30:37.994442+0000","last_clean":"2024-09-15T23:30:37.994442+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994442+0000","last_undegraded":"2024-09-15T23:30:37.994442+0000","last_fullsized":"2024-09-15T23:30:37.994442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.179058+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.179058+0000","last_peered":"2024-09-15T23:30:38.179058+0000","last_clean":"2024-09-15T23:30:38.179058+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.179058+0000","last_undegraded":"2024-09-15T23:30:38.179058+0000","last_fullsized":"2024-09-15T23:30:38.179058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991734+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991734+0000","last_peered":"2024-09-15T23:30:37.991734+0000","last_clean":"2024-09-15T23:30:37.991734+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991734+0000","last_undegraded":"2024-09-15T23:30:37.991734+0000","last_fullsized":"2024-09-15T23:30:37.991734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992053+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992053+0000","last_peered":"2024-09-15T23:30:37.992053+0000","last_clean":"2024-09-15T23:30:37.992053+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992053+0000","last_undegraded":"2024-09-15T23:30:37.992053+0000","last_fullsized":"2024-09-15T23:30:37.992053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176384+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176384+0000","last_peered":"2024-09-15T23:30:38.176384+0000","last_clean":"2024-09-15T23:30:38.176384+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176384+0000","last_undegraded":"2024-09-15T23:30:38.176384+0000","last_fullsized":"2024-09-15T23:30:38.176384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822293+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822293+0000","last_peered":"2024-09-15T23:31:35.822293+0000","last_clean":"2024-09-15T23:31:35.822293+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822293+0000","last_undegraded":"2024-09-15T23:31:35.822293+0000","last_fullsized":"2024-09-15T23:31:35.822293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996899+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996899+0000","last_peered":"2024-09-15T23:30:37.996899+0000","last_clean":"2024-09-15T23:30:37.996899+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996899+0000","last_undegraded":"2024-09-15T23:30:37.996899+0000","last_fullsized":"2024-09-15T23:30:37.996899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176723+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176723+0000","last_peered":"2024-09-15T23:30:38.176723+0000","last_clean":"2024-09-15T23:30:38.176723+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176723+0000","last_undegraded":"2024-09-15T23:30:38.176723+0000","last_fullsized":"2024-09-15T23:30:38.176723+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816205+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816205+0000","last_peered":"2024-09-15T23:31:35.816205+0000","last_clean":"2024-09-15T23:31:35.816205+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816205+0000","last_undegraded":"2024-09-15T23:31:35.816205+0000","last_fullsized":"2024-09-15T23:31:35.816205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175925+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175925+0000","last_peered":"2024-09-15T23:30:38.175925+0000","last_clean":"2024-09-15T23:30:38.175925+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175925+0000","last_undegraded":"2024-09-15T23:30:38.175925+0000","last_fullsized":"2024-09-15T23:30:38.175925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822840+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822840+0000","last_peered":"2024-09-15T23:31:35.822840+0000","last_clean":"2024-09-15T23:31:35.822840+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822840+0000","last_undegraded":"2024-09-15T23:31:35.822840+0000","last_fullsized":"2024-09-15T23:31:35.822840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991686+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991686+0000","last_peered":"2024-09-15T23:30:37.991686+0000","last_clean":"2024-09-15T23:30:37.991686+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991686+0000","last_undegraded":"2024-09-15T23:30:37.991686+0000","last_fullsized":"2024-09-15T23:30:37.991686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174973+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174973+0000","last_peered":"2024-09-15T23:30:38.174973+0000","last_clean":"2024-09-15T23:30:38.174973+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174973+0000","last_undegraded":"2024-09-15T23:30:38.174973+0000","last_fullsized":"2024-09-15T23:30:38.174973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817164+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.817164+0000","last_peered":"2024-09-15T23:31:35.817164+0000","last_clean":"2024-09-15T23:31:35.817164+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.817164+0000","last_undegraded":"2024-09-15T23:31:35.817164+0000","last_fullsized":"2024-09-15T23:31:35.817164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997109+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997109+0000","last_peered":"2024-09-15T23:30:37.997109+0000","last_clean":"2024-09-15T23:30:37.997109+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997109+0000","last_undegraded":"2024-09-15T23:30:37.997109+0000","last_fullsized":"2024-09-15T23:30:37.997109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175011+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.175011+0000","last_peered":"2024-09-15T23:30:38.175011+0000","last_clean":"2024-09-15T23:30:38.175011+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.175011+0000","last_undegraded":"2024-09-15T23:30:38.175011+0000","last_fullsized":"2024-09-15T23:30:38.175011+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818460+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.818460+0000","last_peered":"2024-09-15T23:31:35.818460+0000","last_clean":"2024-09-15T23:31:35.818460+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.818460+0000","last_undegraded":"2024-09-15T23:31:35.818460+0000","last_fullsized":"2024-09-15T23:31:35.818460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994757+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994757+0000","last_peered":"2024-09-15T23:30:37.994757+0000","last_clean":"2024-09-15T23:30:37.994757+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994757+0000","last_undegraded":"2024-09-15T23:30:37.994757+0000","last_fullsized":"2024-09-15T23:30:37.994757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815907+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815907+0000","last_peered":"2024-09-15T23:31:35.815907+0000","last_clean":"2024-09-15T23:31:35.815907+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815907+0000","last_undegraded":"2024-09-15T23:31:35.815907+0000","last_fullsized":"2024-09-15T23:31:35.815907+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989985+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989985+0000","last_peered":"2024-09-15T23:30:37.989985+0000","last_clean":"2024-09-15T23:30:37.989985+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989985+0000","last_undegraded":"2024-09-15T23:30:37.989985+0000","last_fullsized":"2024-09-15T23:30:37.989985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814161+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814161+0000","last_peered":"2024-09-15T23:31:35.814161+0000","last_clean":"2024-09-15T23:31:35.814161+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814161+0000","last_undegraded":"2024-09-15T23:31:35.814161+0000","last_fullsized":"2024-09-15T23:31:35.814161+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175838+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175838+0000","last_peered":"2024-09-15T23:30:38.175838+0000","last_clean":"2024-09-15T23:30:38.175838+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175838+0000","last_undegraded":"2024-09-15T23:30:38.175838+0000","last_fullsized":"2024-09-15T23:30:38.175838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810996+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.810996+0000","last_peered":"2024-09-15T23:31:35.810996+0000","last_clean":"2024-09-15T23:31:35.810996+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.810996+0000","last_undegraded":"2024-09-15T23:31:35.810996+0000","last_fullsized":"2024-09-15T23:31:35.810996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996852+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996852+0000","last_peered":"2024-09-15T23:30:37.996852+0000","last_clean":"2024-09-15T23:30:37.996852+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996852+0000","last_undegraded":"2024-09-15T23:30:37.996852+0000","last_fullsized":"2024-09-15T23:30:37.996852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":278,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:48.511134+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:48.511134+0000","last_peered":"2024-09-15T23:31:48.511134+0000","last_clean":"2024-09-15T23:31:48.511134+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:48.511134+0000","last_undegraded":"2024-09-15T23:31:48.511134+0000","last_fullsized":"2024-09-15T23:31:48.511134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69994,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":173,"num_write":36,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816222+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816222+0000","last_peered":"2024-09-15T23:31:35.816222+0000","last_clean":"2024-09-15T23:31:35.816222+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816222+0000","last_undegraded":"2024-09-15T23:31:35.816222+0000","last_fullsized":"2024-09-15T23:31:35.816222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175890+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175890+0000","last_peered":"2024-09-15T23:30:38.175890+0000","last_clean":"2024-09-15T23:30:38.175890+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175890+0000","last_undegraded":"2024-09-15T23:30:38.175890+0000","last_fullsized":"2024-09-15T23:30:38.175890+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177004+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.177004+0000","last_peered":"2024-09-15T23:30:38.177004+0000","last_clean":"2024-09-15T23:30:38.177004+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.177004+0000","last_undegraded":"2024-09-15T23:30:38.177004+0000","last_fullsized":"2024-09-15T23:30:38.177004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814725+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814725+0000","last_peered":"2024-09-15T23:31:35.814725+0000","last_clean":"2024-09-15T23:31:35.814725+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814725+0000","last_undegraded":"2024-09-15T23:31:35.814725+0000","last_fullsized":"2024-09-15T23:31:35.814725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813766+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813766+0000","last_peered":"2024-09-15T23:31:35.813766+0000","last_clean":"2024-09-15T23:31:35.813766+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813766+0000","last_undegraded":"2024-09-15T23:31:35.813766+0000","last_fullsized":"2024-09-15T23:31:35.813766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821943+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821943+0000","last_peered":"2024-09-15T23:31:35.821943+0000","last_clean":"2024-09-15T23:31:35.821943+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821943+0000","last_undegraded":"2024-09-15T23:31:35.821943+0000","last_fullsized":"2024-09-15T23:31:35.821943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817598+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817598+0000","last_peered":"2024-09-15T23:31:35.817598+0000","last_clean":"2024-09-15T23:31:35.817598+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817598+0000","last_undegraded":"2024-09-15T23:31:35.817598+0000","last_fullsized":"2024-09-15T23:31:35.817598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810734+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810734+0000","last_peered":"2024-09-15T23:31:35.810734+0000","last_clean":"2024-09-15T23:31:35.810734+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810734+0000","last_undegraded":"2024-09-15T23:31:35.810734+0000","last_fullsized":"2024-09-15T23:31:35.810734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813172+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.813172+0000","last_peered":"2024-09-15T23:31:35.813172+0000","last_clean":"2024-09-15T23:31:35.813172+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.813172+0000","last_undegraded":"2024-09-15T23:31:35.813172+0000","last_fullsized":"2024-09-15T23:31:35.813172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817619+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817619+0000","last_peered":"2024-09-15T23:31:35.817619+0000","last_clean":"2024-09-15T23:31:35.817619+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817619+0000","last_undegraded":"2024-09-15T23:31:35.817619+0000","last_fullsized":"2024-09-15T23:31:35.817619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817599+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817599+0000","last_peered":"2024-09-15T23:31:35.817599+0000","last_clean":"2024-09-15T23:31:35.817599+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817599+0000","last_undegraded":"2024-09-15T23:31:35.817599+0000","last_fullsized":"2024-09-15T23:31:35.817599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814362+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814362+0000","last_peered":"2024-09-15T23:31:35.814362+0000","last_clean":"2024-09-15T23:31:35.814362+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814362+0000","last_undegraded":"2024-09-15T23:31:35.814362+0000","last_fullsized":"2024-09-15T23:31:35.814362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816329+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816329+0000","last_peered":"2024-09-15T23:31:35.816329+0000","last_clean":"2024-09-15T23:31:35.816329+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816329+0000","last_undegraded":"2024-09-15T23:31:35.816329+0000","last_fullsized":"2024-09-15T23:31:35.816329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":214,"num_read_kb":180,"num_write":94,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":212376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481834,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710766,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1167144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874292,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103225,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364862,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790024,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953550,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":576616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":576582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:53.042 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-15T23:31:53.043 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-15T23:31:53.293 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:53.318 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:52 smithi077 ceph-mon[30968]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:53.319 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:52 smithi077 ceph-mon[30968]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:52 smithi155 ceph-mon[35631]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:52 smithi155 ceph-mon[35631]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:53.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:52 smithi159 ceph-mon[35472]: pgmap v359: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:53.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:52 smithi159 ceph-mon[35472]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:53.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 -- 172.21.15.77:0/2987827495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1058100e30 msgr2=0x7f1058104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:53.789 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 --2- 172.21.15.77:0/2987827495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1058100e30 0x7f1058104e80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f104c00aa10 tx=0x7f104c02b720 comp rx=0 tx=0).stop 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 -- 172.21.15.77:0/2987827495 shutdown_connections 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 --2- 172.21.15.77:0/2987827495 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10581055b0 0x7f105810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 --2- 172.21.15.77:0/2987827495 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1058100e30 0x7f1058104e80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 --2- 172.21.15.77:0/2987827495 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100480 0x7f1058100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 -- 172.21.15.77:0/2987827495 >> 172.21.15.77:0/2987827495 conn(0x7f1058077210 msgr2=0x7f10580fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 -- 172.21.15.77:0/2987827495 shutdown_connections 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 -- 172.21.15.77:0/2987827495 wait complete. 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.777+0000 7f105df77640 1 Processor -- start 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 -- start start 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 0x7f1058198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100e30 0x7f10581988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f105810fd90 con 0x7f10581055b0 2024-09-15T23:31:53.790 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f105810fc10 con 0x7f1058100e30 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f105df77640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f105810ff10 con 0x7f1058100480 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34456/0 (socket says 172.21.15.77:34456) 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 -- 172.21.15.77:0/2099834103 learned_addr learned my addr 172.21.15.77:0/2099834103 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f10577fe640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 0x7f1058198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1056ffd640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100e30 0x7f10581988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 -- 172.21.15.77:0/2099834103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 msgr2=0x7f1058198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 0x7f1058198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 -- 172.21.15.77:0/2099834103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100e30 msgr2=0x7f10581988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100e30 0x7f10581988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 -- 172.21.15.77:0/2099834103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f105819d340 con 0x7f10581055b0 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f10577fe640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 0x7f1058198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:53.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.778+0000 7f1057fff640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f105000eaa0 tx=0x7f105000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.779+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f105000cdb0 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.779+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f105819d630 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.779+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1050005020 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.779+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10500116d0 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.779+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10581a4f10 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.780+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1058100860 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.781+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f10500054d0 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.781+0000 7f1054ff9640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.782+0000 7f10577fe640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.782+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f10500cff30 con 0x7f10581055b0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.782+0000 7f10577fe640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 0x7f10400a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f104800baa0 tx=0x7f1048005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:53.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.786+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1050016030 con 0x7f10581055b0 2024-09-15T23:31:53.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.954+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 --> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1058062630 con 0x7f10400a3240 2024-09-15T23:31:53.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.962+0000 7f1054ff9640 1 -- 172.21.15.77:0/2099834103 <== mgr.14150 v2:172.21.15.77:6800/2029887224 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340399 (secure 0 0 0) 0x7f1058062630 con 0x7f10400a3240 2024-09-15T23:31:53.968 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:53.970 INFO:teuthology.orchestra.run.smithi077.stderr:dumped all 2024-09-15T23:31:53.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 msgr2=0x7f10400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 0x7f10400a5700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f104800baa0 tx=0x7f1048005d90 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 msgr2=0x7f105819cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f105000eaa0 tx=0x7f105000ef60 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 shutdown_connections 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f10400a3240 0x7f10400a5700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.965+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f10581055b0 0x7f105819cc60 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.966+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1058100e30 0x7f10581988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.966+0000 7f105df77640 1 --2- 172.21.15.77:0/2099834103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1058100480 0x7f1058198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.966+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 >> 172.21.15.77:0/2099834103 conn(0x7f1058077210 msgr2=0x7f1058103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.966+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 shutdown_connections 2024-09-15T23:31:53.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:53.966+0000 7f105df77640 1 -- 172.21.15.77:0/2099834103 wait complete. 2024-09-15T23:31:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:53 smithi155 ceph-mon[35631]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:54.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:53 smithi155 ceph-mon[35631]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:54.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:53 smithi077 ceph-mon[30968]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:54.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:53 smithi077 ceph-mon[30968]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:53 smithi159 ceph-mon[35472]: pgmap v360: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 KiB/s rd, 682 B/s wr, 2 op/s 2024-09-15T23:31:54.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:53 smithi159 ceph-mon[35472]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-15T23:31:54.627 INFO:teuthology.orchestra.run.smithi077.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2024-09-15T23:31:53.831557+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661394,"num_objects":26,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":340,"num_read_kb":289,"num_write":277,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":717,"ondisk_log_size":717,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":396588,"kb_used_data":14060,"kb_used_omap":18,"kb_used_meta":382317,"kb_avail":1124545236,"statfs":{"total":1151940427776,"available":1151534321664,"internally_reserved":0,"allocated":14397440,"data_stored":8095304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19141,"internal_metadata":391492923},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5681,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":19,"num_write":4,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003125"},"pg_stats":[{"pgid":"2.1f","version":"83'4","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:33.931625+0000","last_change":"2024-09-15T23:29:28.687342+0000","last_active":"2024-09-15T23:31:33.931625+0000","last_peered":"2024-09-15T23:31:33.931625+0000","last_clean":"2024-09-15T23:31:33.931625+0000","last_became_active":"2024-09-15T23:29:28.687035+0000","last_became_peered":"2024-09-15T23:29:28.687035+0000","last_unstale":"2024-09-15T23:31:33.931625+0000","last_undegraded":"2024-09-15T23:31:33.931625+0000","last_fullsized":"2024-09-15T23:31:33.931625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:47:47.216208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":25,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818449+0000","last_change":"2024-09-15T23:29:37.760954+0000","last_active":"2024-09-15T23:31:35.818449+0000","last_peered":"2024-09-15T23:31:35.818449+0000","last_clean":"2024-09-15T23:31:35.818449+0000","last_became_active":"2024-09-15T23:29:37.760566+0000","last_became_peered":"2024-09-15T23:29:37.760566+0000","last_unstale":"2024-09-15T23:31:35.818449+0000","last_undegraded":"2024-09-15T23:31:35.818449+0000","last_fullsized":"2024-09-15T23:31:35.818449+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:46:24.875379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996112+0000","last_change":"2024-09-15T23:29:37.757129+0000","last_active":"2024-09-15T23:30:37.996112+0000","last_peered":"2024-09-15T23:30:37.996112+0000","last_clean":"2024-09-15T23:30:37.996112+0000","last_became_active":"2024-09-15T23:29:37.756656+0000","last_became_peered":"2024-09-15T23:29:37.756656+0000","last_unstale":"2024-09-15T23:30:37.996112+0000","last_undegraded":"2024-09-15T23:30:37.996112+0000","last_fullsized":"2024-09-15T23:30:37.996112+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:02.087374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'1","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175766+0000","last_change":"2024-09-15T23:29:28.867154+0000","last_active":"2024-09-15T23:30:38.175766+0000","last_peered":"2024-09-15T23:30:38.175766+0000","last_clean":"2024-09-15T23:30:38.175766+0000","last_became_active":"2024-09-15T23:29:28.866838+0000","last_became_peered":"2024-09-15T23:29:28.866838+0000","last_unstale":"2024-09-15T23:30:38.175766+0000","last_undegraded":"2024-09-15T23:30:38.175766+0000","last_fullsized":"2024-09-15T23:30:38.175766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:43:02.118479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817570+0000","last_change":"2024-09-15T23:29:30.716247+0000","last_active":"2024-09-15T23:31:35.817570+0000","last_peered":"2024-09-15T23:31:35.817570+0000","last_clean":"2024-09-15T23:31:35.817570+0000","last_became_active":"2024-09-15T23:29:30.715974+0000","last_became_peered":"2024-09-15T23:29:30.715974+0000","last_unstale":"2024-09-15T23:31:35.817570+0000","last_undegraded":"2024-09-15T23:31:35.817570+0000","last_fullsized":"2024-09-15T23:31:35.817570+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:38.672266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989642+0000","last_change":"2024-09-15T23:29:37.762766+0000","last_active":"2024-09-15T23:30:37.989642+0000","last_peered":"2024-09-15T23:30:37.989642+0000","last_clean":"2024-09-15T23:30:37.989642+0000","last_became_active":"2024-09-15T23:29:37.762339+0000","last_became_peered":"2024-09-15T23:29:37.762339+0000","last_unstale":"2024-09-15T23:30:37.989642+0000","last_undegraded":"2024-09-15T23:30:37.989642+0000","last_fullsized":"2024-09-15T23:30:37.989642+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:36:32.365832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995397+0000","last_change":"2024-09-15T23:29:28.689953+0000","last_active":"2024-09-15T23:30:37.995397+0000","last_peered":"2024-09-15T23:30:37.995397+0000","last_clean":"2024-09-15T23:30:37.995397+0000","last_became_active":"2024-09-15T23:29:28.689625+0000","last_became_peered":"2024-09-15T23:29:28.689625+0000","last_unstale":"2024-09-15T23:30:37.995397+0000","last_undegraded":"2024-09-15T23:30:37.995397+0000","last_fullsized":"2024-09-15T23:30:37.995397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:11:22.673959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811164+0000","last_change":"2024-09-15T23:29:30.720465+0000","last_active":"2024-09-15T23:31:35.811164+0000","last_peered":"2024-09-15T23:31:35.811164+0000","last_clean":"2024-09-15T23:31:35.811164+0000","last_became_active":"2024-09-15T23:29:30.719904+0000","last_became_peered":"2024-09-15T23:29:30.719904+0000","last_unstale":"2024-09-15T23:31:35.811164+0000","last_undegraded":"2024-09-15T23:31:35.811164+0000","last_fullsized":"2024-09-15T23:31:35.811164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:34:45.144075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990031+0000","last_change":"2024-09-15T23:29:37.762195+0000","last_active":"2024-09-15T23:30:37.990031+0000","last_peered":"2024-09-15T23:30:37.990031+0000","last_clean":"2024-09-15T23:30:37.990031+0000","last_became_active":"2024-09-15T23:29:37.761804+0000","last_became_peered":"2024-09-15T23:29:37.761804+0000","last_unstale":"2024-09-15T23:30:37.990031+0000","last_undegraded":"2024-09-15T23:30:37.990031+0000","last_fullsized":"2024-09-15T23:30:37.990031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:36.580380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995639+0000","last_change":"2024-09-15T23:29:28.689159+0000","last_active":"2024-09-15T23:30:37.995639+0000","last_peered":"2024-09-15T23:30:37.995639+0000","last_clean":"2024-09-15T23:30:37.995639+0000","last_became_active":"2024-09-15T23:29:28.688704+0000","last_became_peered":"2024-09-15T23:29:28.688704+0000","last_unstale":"2024-09-15T23:30:37.995639+0000","last_undegraded":"2024-09-15T23:30:37.995639+0000","last_fullsized":"2024-09-15T23:30:37.995639+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:51.139122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818611+0000","last_change":"2024-09-15T23:29:30.717801+0000","last_active":"2024-09-15T23:31:35.818611+0000","last_peered":"2024-09-15T23:31:35.818611+0000","last_clean":"2024-09-15T23:31:35.818611+0000","last_became_active":"2024-09-15T23:29:30.717437+0000","last_became_peered":"2024-09-15T23:29:30.717437+0000","last_unstale":"2024-09-15T23:31:35.818611+0000","last_undegraded":"2024-09-15T23:31:35.818611+0000","last_fullsized":"2024-09-15T23:31:35.818611+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.238816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989797+0000","last_change":"2024-09-15T23:29:37.761427+0000","last_active":"2024-09-15T23:30:37.989797+0000","last_peered":"2024-09-15T23:30:37.989797+0000","last_clean":"2024-09-15T23:30:37.989797+0000","last_became_active":"2024-09-15T23:29:37.761015+0000","last_became_peered":"2024-09-15T23:29:37.761015+0000","last_unstale":"2024-09-15T23:30:37.989797+0000","last_undegraded":"2024-09-15T23:30:37.989797+0000","last_fullsized":"2024-09-15T23:30:37.989797+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:58.465143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817995+0000","last_change":"2024-09-15T23:29:30.715412+0000","last_active":"2024-09-15T23:31:35.817995+0000","last_peered":"2024-09-15T23:31:35.817995+0000","last_clean":"2024-09-15T23:31:35.817995+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.817995+0000","last_undegraded":"2024-09-15T23:31:35.817995+0000","last_fullsized":"2024-09-15T23:31:35.817995+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:49:05.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":24,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994381+0000","last_change":"2024-09-15T23:29:37.760462+0000","last_active":"2024-09-15T23:30:37.994381+0000","last_peered":"2024-09-15T23:30:37.994381+0000","last_clean":"2024-09-15T23:30:37.994381+0000","last_became_active":"2024-09-15T23:29:37.754449+0000","last_became_peered":"2024-09-15T23:29:37.754449+0000","last_unstale":"2024-09-15T23:30:37.994381+0000","last_undegraded":"2024-09-15T23:30:37.994381+0000","last_fullsized":"2024-09-15T23:30:37.994381+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:29:19.226677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990074+0000","last_change":"2024-09-15T23:29:38.299809+0000","last_active":"2024-09-15T23:30:37.990074+0000","last_peered":"2024-09-15T23:30:37.990074+0000","last_clean":"2024-09-15T23:30:37.990074+0000","last_became_active":"2024-09-15T23:29:38.299070+0000","last_became_peered":"2024-09-15T23:29:38.299070+0000","last_unstale":"2024-09-15T23:30:37.990074+0000","last_undegraded":"2024-09-15T23:30:37.990074+0000","last_fullsized":"2024-09-15T23:30:37.990074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:09:59.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815051+0000","last_change":"2024-09-15T23:29:30.711880+0000","last_active":"2024-09-15T23:31:35.815051+0000","last_peered":"2024-09-15T23:31:35.815051+0000","last_clean":"2024-09-15T23:31:35.815051+0000","last_became_active":"2024-09-15T23:29:30.711568+0000","last_became_peered":"2024-09-15T23:29:30.711568+0000","last_unstale":"2024-09-15T23:31:35.815051+0000","last_undegraded":"2024-09-15T23:31:35.815051+0000","last_fullsized":"2024-09-15T23:31:35.815051+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:19:12.906169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996501+0000","last_change":"2024-09-15T23:29:28.691382+0000","last_active":"2024-09-15T23:30:37.996501+0000","last_peered":"2024-09-15T23:30:37.996501+0000","last_clean":"2024-09-15T23:30:37.996501+0000","last_became_active":"2024-09-15T23:29:28.690994+0000","last_became_peered":"2024-09-15T23:29:28.690994+0000","last_unstale":"2024-09-15T23:30:37.996501+0000","last_undegraded":"2024-09-15T23:30:37.996501+0000","last_fullsized":"2024-09-15T23:30:37.996501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:40:31.132601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989974+0000","last_change":"2024-09-15T23:29:37.755558+0000","last_active":"2024-09-15T23:30:37.989974+0000","last_peered":"2024-09-15T23:30:37.989974+0000","last_clean":"2024-09-15T23:30:37.989974+0000","last_became_active":"2024-09-15T23:29:37.755152+0000","last_became_peered":"2024-09-15T23:29:37.755152+0000","last_unstale":"2024-09-15T23:30:37.989974+0000","last_undegraded":"2024-09-15T23:30:37.989974+0000","last_fullsized":"2024-09-15T23:30:37.989974+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:00:24.031532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820539+0000","last_change":"2024-09-15T23:29:30.710453+0000","last_active":"2024-09-15T23:31:35.820539+0000","last_peered":"2024-09-15T23:31:35.820539+0000","last_clean":"2024-09-15T23:31:35.820539+0000","last_became_active":"2024-09-15T23:29:30.710096+0000","last_became_peered":"2024-09-15T23:29:30.710096+0000","last_unstale":"2024-09-15T23:31:35.820539+0000","last_undegraded":"2024-09-15T23:31:35.820539+0000","last_fullsized":"2024-09-15T23:31:35.820539+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:00:11.236309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175334+0000","last_change":"2024-09-15T23:29:28.683164+0000","last_active":"2024-09-15T23:30:38.175334+0000","last_peered":"2024-09-15T23:30:38.175334+0000","last_clean":"2024-09-15T23:30:38.175334+0000","last_became_active":"2024-09-15T23:29:28.682720+0000","last_became_peered":"2024-09-15T23:29:28.682720+0000","last_unstale":"2024-09-15T23:30:38.175334+0000","last_undegraded":"2024-09-15T23:30:38.175334+0000","last_fullsized":"2024-09-15T23:30:38.175334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:13.747790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989499+0000","last_change":"2024-09-15T23:29:37.766094+0000","last_active":"2024-09-15T23:30:37.989499+0000","last_peered":"2024-09-15T23:30:37.989499+0000","last_clean":"2024-09-15T23:30:37.989499+0000","last_became_active":"2024-09-15T23:29:37.764980+0000","last_became_peered":"2024-09-15T23:29:37.764980+0000","last_unstale":"2024-09-15T23:30:37.989499+0000","last_undegraded":"2024-09-15T23:30:37.989499+0000","last_fullsized":"2024-09-15T23:30:37.989499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:13:27.669461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814437+0000","last_change":"2024-09-15T23:29:30.710529+0000","last_active":"2024-09-15T23:31:35.814437+0000","last_peered":"2024-09-15T23:31:35.814437+0000","last_clean":"2024-09-15T23:31:35.814437+0000","last_became_active":"2024-09-15T23:29:30.710017+0000","last_became_peered":"2024-09-15T23:29:30.710017+0000","last_unstale":"2024-09-15T23:31:35.814437+0000","last_undegraded":"2024-09-15T23:31:35.814437+0000","last_fullsized":"2024-09-15T23:31:35.814437+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:41:04.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177176+0000","last_change":"2024-09-15T23:29:28.867378+0000","last_active":"2024-09-15T23:30:38.177176+0000","last_peered":"2024-09-15T23:30:38.177176+0000","last_clean":"2024-09-15T23:30:38.177176+0000","last_became_active":"2024-09-15T23:29:28.867109+0000","last_became_peered":"2024-09-15T23:29:28.867109+0000","last_unstale":"2024-09-15T23:30:38.177176+0000","last_undegraded":"2024-09-15T23:30:38.177176+0000","last_fullsized":"2024-09-15T23:30:38.177176+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:37:39.605905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990079+0000","last_change":"2024-09-15T23:29:38.300302+0000","last_active":"2024-09-15T23:30:37.990079+0000","last_peered":"2024-09-15T23:30:37.990079+0000","last_clean":"2024-09-15T23:30:37.990079+0000","last_became_active":"2024-09-15T23:29:38.299414+0000","last_became_peered":"2024-09-15T23:29:38.299414+0000","last_unstale":"2024-09-15T23:30:37.990079+0000","last_undegraded":"2024-09-15T23:30:37.990079+0000","last_fullsized":"2024-09-15T23:30:37.990079+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:53.258343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814364+0000","last_change":"2024-09-15T23:29:30.717898+0000","last_active":"2024-09-15T23:31:35.814364+0000","last_peered":"2024-09-15T23:31:35.814364+0000","last_clean":"2024-09-15T23:31:35.814364+0000","last_became_active":"2024-09-15T23:29:30.717623+0000","last_became_peered":"2024-09-15T23:29:30.717623+0000","last_unstale":"2024-09-15T23:31:35.814364+0000","last_undegraded":"2024-09-15T23:31:35.814364+0000","last_fullsized":"2024-09-15T23:31:35.814364+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:12.980066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990480+0000","last_change":"2024-09-15T23:29:29.593363+0000","last_active":"2024-09-15T23:30:37.990480+0000","last_peered":"2024-09-15T23:30:37.990480+0000","last_clean":"2024-09-15T23:30:37.990480+0000","last_became_active":"2024-09-15T23:29:29.593002+0000","last_became_peered":"2024-09-15T23:29:29.593002+0000","last_unstale":"2024-09-15T23:30:37.990480+0000","last_undegraded":"2024-09-15T23:30:37.990480+0000","last_fullsized":"2024-09-15T23:30:37.990480+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:53:03.689728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996266+0000","last_change":"2024-09-15T23:29:37.754514+0000","last_active":"2024-09-15T23:30:37.996266+0000","last_peered":"2024-09-15T23:30:37.996266+0000","last_clean":"2024-09-15T23:30:37.996266+0000","last_became_active":"2024-09-15T23:29:37.754122+0000","last_became_peered":"2024-09-15T23:29:37.754122+0000","last_unstale":"2024-09-15T23:30:37.996266+0000","last_undegraded":"2024-09-15T23:30:37.996266+0000","last_fullsized":"2024-09-15T23:30:37.996266+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:19:09.819234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821926+0000","last_change":"2024-09-15T23:29:30.708352+0000","last_active":"2024-09-15T23:31:35.821926+0000","last_peered":"2024-09-15T23:31:35.821926+0000","last_clean":"2024-09-15T23:31:35.821926+0000","last_became_active":"2024-09-15T23:29:30.707968+0000","last_became_peered":"2024-09-15T23:29:30.707968+0000","last_unstale":"2024-09-15T23:31:35.821926+0000","last_undegraded":"2024-09-15T23:31:35.821926+0000","last_fullsized":"2024-09-15T23:31:35.821926+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:31:05.044952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'10","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:38.932069+0000","last_change":"2024-09-15T23:29:28.685935+0000","last_active":"2024-09-15T23:31:38.932069+0000","last_peered":"2024-09-15T23:31:38.932069+0000","last_clean":"2024-09-15T23:31:38.932069+0000","last_became_active":"2024-09-15T23:29:28.685607+0000","last_became_peered":"2024-09-15T23:29:28.685607+0000","last_unstale":"2024-09-15T23:31:38.932069+0000","last_undegraded":"2024-09-15T23:31:38.932069+0000","last_fullsized":"2024-09-15T23:31:38.932069+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:08:54.165105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174564+0000","last_change":"2024-09-15T23:29:38.299353+0000","last_active":"2024-09-15T23:30:38.174564+0000","last_peered":"2024-09-15T23:30:38.174564+0000","last_clean":"2024-09-15T23:30:38.174564+0000","last_became_active":"2024-09-15T23:29:38.298844+0000","last_became_peered":"2024-09-15T23:29:38.298844+0000","last_unstale":"2024-09-15T23:30:38.174564+0000","last_undegraded":"2024-09-15T23:30:38.174564+0000","last_fullsized":"2024-09-15T23:30:38.174564+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:19:18.948813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813439+0000","last_change":"2024-09-15T23:29:30.708689+0000","last_active":"2024-09-15T23:31:35.813439+0000","last_peered":"2024-09-15T23:31:35.813439+0000","last_clean":"2024-09-15T23:31:35.813439+0000","last_became_active":"2024-09-15T23:29:30.708353+0000","last_became_peered":"2024-09-15T23:29:30.708353+0000","last_unstale":"2024-09-15T23:31:35.813439+0000","last_undegraded":"2024-09-15T23:31:35.813439+0000","last_fullsized":"2024-09-15T23:31:35.813439+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:51:03.560134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.995569+0000","last_change":"2024-09-15T23:29:28.866874+0000","last_active":"2024-09-15T23:30:37.995569+0000","last_peered":"2024-09-15T23:30:37.995569+0000","last_clean":"2024-09-15T23:30:37.995569+0000","last_became_active":"2024-09-15T23:29:28.866581+0000","last_became_peered":"2024-09-15T23:29:28.866581+0000","last_unstale":"2024-09-15T23:30:37.995569+0000","last_undegraded":"2024-09-15T23:30:37.995569+0000","last_fullsized":"2024-09-15T23:30:37.995569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:42:59.456296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994442+0000","last_change":"2024-09-15T23:29:37.762823+0000","last_active":"2024-09-15T23:30:37.994442+0000","last_peered":"2024-09-15T23:30:37.994442+0000","last_clean":"2024-09-15T23:30:37.994442+0000","last_became_active":"2024-09-15T23:29:37.762441+0000","last_became_peered":"2024-09-15T23:29:37.762441+0000","last_unstale":"2024-09-15T23:30:37.994442+0000","last_undegraded":"2024-09-15T23:30:37.994442+0000","last_fullsized":"2024-09-15T23:30:37.994442+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:18.402004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813026+0000","last_change":"2024-09-15T23:29:30.711502+0000","last_active":"2024-09-15T23:31:35.813026+0000","last_peered":"2024-09-15T23:31:35.813026+0000","last_clean":"2024-09-15T23:31:35.813026+0000","last_became_active":"2024-09-15T23:29:30.711175+0000","last_became_peered":"2024-09-15T23:29:30.711175+0000","last_unstale":"2024-09-15T23:31:35.813026+0000","last_undegraded":"2024-09-15T23:31:35.813026+0000","last_fullsized":"2024-09-15T23:31:35.813026+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:04:10.753275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989489+0000","last_change":"2024-09-15T23:29:37.748059+0000","last_active":"2024-09-15T23:30:37.989489+0000","last_peered":"2024-09-15T23:30:37.989489+0000","last_clean":"2024-09-15T23:30:37.989489+0000","last_became_active":"2024-09-15T23:29:37.747686+0000","last_became_peered":"2024-09-15T23:29:37.747686+0000","last_unstale":"2024-09-15T23:30:37.989489+0000","last_undegraded":"2024-09-15T23:30:37.989489+0000","last_fullsized":"2024-09-15T23:30:37.989489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:23:32.274590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.179058+0000","last_change":"2024-09-15T23:30:38.178555+0000","last_active":"2024-09-15T23:30:38.179058+0000","last_peered":"2024-09-15T23:30:38.179058+0000","last_clean":"2024-09-15T23:30:38.179058+0000","last_became_active":"2024-09-15T23:30:38.178005+0000","last_became_peered":"2024-09-15T23:30:38.178005+0000","last_unstale":"2024-09-15T23:30:38.179058+0000","last_undegraded":"2024-09-15T23:30:38.179058+0000","last_fullsized":"2024-09-15T23:30:38.179058+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:49:08.869996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,1],"acting":[8,10,11,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.806348+0000","last_change":"2024-09-15T23:29:30.720360+0000","last_active":"2024-09-15T23:31:35.806348+0000","last_peered":"2024-09-15T23:31:35.806348+0000","last_clean":"2024-09-15T23:31:35.806348+0000","last_became_active":"2024-09-15T23:29:30.719978+0000","last_became_peered":"2024-09-15T23:29:30.719978+0000","last_unstale":"2024-09-15T23:31:35.806348+0000","last_undegraded":"2024-09-15T23:31:35.806348+0000","last_fullsized":"2024-09-15T23:31:35.806348+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:59:45.510277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176679+0000","last_change":"2024-09-15T23:29:28.688218+0000","last_active":"2024-09-15T23:30:38.176679+0000","last_peered":"2024-09-15T23:30:38.176679+0000","last_clean":"2024-09-15T23:30:38.176679+0000","last_became_active":"2024-09-15T23:29:28.687837+0000","last_became_peered":"2024-09-15T23:29:28.687837+0000","last_unstale":"2024-09-15T23:30:38.176679+0000","last_undegraded":"2024-09-15T23:30:38.176679+0000","last_fullsized":"2024-09-15T23:30:38.176679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:47:33.758714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991734+0000","last_change":"2024-09-15T23:29:37.756015+0000","last_active":"2024-09-15T23:30:37.991734+0000","last_peered":"2024-09-15T23:30:37.991734+0000","last_clean":"2024-09-15T23:30:37.991734+0000","last_became_active":"2024-09-15T23:29:37.755601+0000","last_became_peered":"2024-09-15T23:29:37.755601+0000","last_unstale":"2024-09-15T23:30:37.991734+0000","last_undegraded":"2024-09-15T23:30:37.991734+0000","last_fullsized":"2024-09-15T23:30:37.991734+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:54:01.319345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807745+0000","last_change":"2024-09-15T23:29:37.761679+0000","last_active":"2024-09-15T23:31:35.807745+0000","last_peered":"2024-09-15T23:31:35.807745+0000","last_clean":"2024-09-15T23:31:35.807745+0000","last_became_active":"2024-09-15T23:29:37.759738+0000","last_became_peered":"2024-09-15T23:29:37.759738+0000","last_unstale":"2024-09-15T23:31:35.807745+0000","last_undegraded":"2024-09-15T23:31:35.807745+0000","last_fullsized":"2024-09-15T23:31:35.807745+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:27:26.426408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991208+0000","last_change":"2024-09-15T23:29:28.868182+0000","last_active":"2024-09-15T23:30:37.991208+0000","last_peered":"2024-09-15T23:30:37.991208+0000","last_clean":"2024-09-15T23:30:37.991208+0000","last_became_active":"2024-09-15T23:29:28.867790+0000","last_became_peered":"2024-09-15T23:29:28.867790+0000","last_unstale":"2024-09-15T23:30:37.991208+0000","last_undegraded":"2024-09-15T23:30:37.991208+0000","last_fullsized":"2024-09-15T23:30:37.991208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:47:01.592274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.992053+0000","last_change":"2024-09-15T23:29:38.299360+0000","last_active":"2024-09-15T23:30:37.992053+0000","last_peered":"2024-09-15T23:30:37.992053+0000","last_clean":"2024-09-15T23:30:37.992053+0000","last_became_active":"2024-09-15T23:29:38.298837+0000","last_became_peered":"2024-09-15T23:29:38.298837+0000","last_unstale":"2024-09-15T23:30:37.992053+0000","last_undegraded":"2024-09-15T23:30:37.992053+0000","last_fullsized":"2024-09-15T23:30:37.992053+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:48.530460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814786+0000","last_change":"2024-09-15T23:29:30.708074+0000","last_active":"2024-09-15T23:31:35.814786+0000","last_peered":"2024-09-15T23:31:35.814786+0000","last_clean":"2024-09-15T23:31:35.814786+0000","last_became_active":"2024-09-15T23:29:30.707784+0000","last_became_peered":"2024-09-15T23:29:30.707784+0000","last_unstale":"2024-09-15T23:31:35.814786+0000","last_undegraded":"2024-09-15T23:31:35.814786+0000","last_fullsized":"2024-09-15T23:31:35.814786+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:23:47.762879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177361+0000","last_change":"2024-09-15T23:29:28.689677+0000","last_active":"2024-09-15T23:30:38.177361+0000","last_peered":"2024-09-15T23:30:38.177361+0000","last_clean":"2024-09-15T23:30:38.177361+0000","last_became_active":"2024-09-15T23:29:28.689348+0000","last_became_peered":"2024-09-15T23:29:28.689348+0000","last_unstale":"2024-09-15T23:30:38.177361+0000","last_undegraded":"2024-09-15T23:30:38.177361+0000","last_fullsized":"2024-09-15T23:30:38.177361+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:13:57.131666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177723+0000","last_change":"2024-09-15T23:30:38.177723+0000","last_active":"2024-09-15T23:30:38.177723+0000","last_peered":"2024-09-15T23:30:38.177723+0000","last_clean":"2024-09-15T23:30:38.177723+0000","last_became_active":"2024-09-15T23:30:38.177370+0000","last_became_peered":"2024-09-15T23:30:38.177370+0000","last_unstale":"2024-09-15T23:30:38.177723+0000","last_undegraded":"2024-09-15T23:30:38.177723+0000","last_fullsized":"2024-09-15T23:30:38.177723+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:06.363817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,6,10],"acting":[8,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:37.760918+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:37.760559+0000","last_became_peered":"2024-09-15T23:29:37.760559+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:12:06.190512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,5,1],"acting":[9,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.990315+0000","last_change":"2024-09-15T23:29:28.687312+0000","last_active":"2024-09-15T23:30:37.990315+0000","last_peered":"2024-09-15T23:30:37.990315+0000","last_clean":"2024-09-15T23:30:37.990315+0000","last_became_active":"2024-09-15T23:29:28.686871+0000","last_became_peered":"2024-09-15T23:29:28.686871+0000","last_unstale":"2024-09-15T23:30:37.990315+0000","last_undegraded":"2024-09-15T23:30:37.990315+0000","last_fullsized":"2024-09-15T23:30:37.990315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:16.507125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177535+0000","last_change":"2024-09-15T23:28:17.482423+0000","last_active":"2024-09-15T23:30:38.177535+0000","last_peered":"2024-09-15T23:30:38.177535+0000","last_clean":"2024-09-15T23:30:38.177535+0000","last_became_active":"2024-09-15T23:28:17.482065+0000","last_became_peered":"2024-09-15T23:28:17.482065+0000","last_unstale":"2024-09-15T23:30:38.177535+0000","last_undegraded":"2024-09-15T23:30:38.177535+0000","last_fullsized":"2024-09-15T23:30:38.177535+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:24:50.442496+0000","last_clean_scrub_stamp":"2024-09-15T23:24:50.442496+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:35:38.194129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":23,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176384+0000","last_change":"2024-09-15T23:29:37.765475+0000","last_active":"2024-09-15T23:30:38.176384+0000","last_peered":"2024-09-15T23:30:38.176384+0000","last_clean":"2024-09-15T23:30:38.176384+0000","last_became_active":"2024-09-15T23:29:37.765090+0000","last_became_peered":"2024-09-15T23:29:37.765090+0000","last_unstale":"2024-09-15T23:30:38.176384+0000","last_undegraded":"2024-09-15T23:30:38.176384+0000","last_fullsized":"2024-09-15T23:30:38.176384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:22:05.527848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822293+0000","last_change":"2024-09-15T23:29:30.713407+0000","last_active":"2024-09-15T23:31:35.822293+0000","last_peered":"2024-09-15T23:31:35.822293+0000","last_clean":"2024-09-15T23:31:35.822293+0000","last_became_active":"2024-09-15T23:29:30.712952+0000","last_became_peered":"2024-09-15T23:29:30.712952+0000","last_unstale":"2024-09-15T23:31:35.822293+0000","last_undegraded":"2024-09-15T23:31:35.822293+0000","last_fullsized":"2024-09-15T23:31:35.822293+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:05.761514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996899+0000","last_change":"2024-09-15T23:29:29.593160+0000","last_active":"2024-09-15T23:30:37.996899+0000","last_peered":"2024-09-15T23:30:37.996899+0000","last_clean":"2024-09-15T23:30:37.996899+0000","last_became_active":"2024-09-15T23:29:29.592728+0000","last_became_peered":"2024-09-15T23:29:29.592728+0000","last_unstale":"2024-09-15T23:30:37.996899+0000","last_undegraded":"2024-09-15T23:30:37.996899+0000","last_fullsized":"2024-09-15T23:30:37.996899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:47:18.166388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176723+0000","last_change":"2024-09-15T23:29:37.761409+0000","last_active":"2024-09-15T23:30:38.176723+0000","last_peered":"2024-09-15T23:30:38.176723+0000","last_clean":"2024-09-15T23:30:38.176723+0000","last_became_active":"2024-09-15T23:29:37.760989+0000","last_became_peered":"2024-09-15T23:29:37.760989+0000","last_unstale":"2024-09-15T23:30:38.176723+0000","last_undegraded":"2024-09-15T23:30:38.176723+0000","last_fullsized":"2024-09-15T23:30:38.176723+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:53:58.962535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816205+0000","last_change":"2024-09-15T23:29:30.710736+0000","last_active":"2024-09-15T23:31:35.816205+0000","last_peered":"2024-09-15T23:31:35.816205+0000","last_clean":"2024-09-15T23:31:35.816205+0000","last_became_active":"2024-09-15T23:29:30.710314+0000","last_became_peered":"2024-09-15T23:29:30.710314+0000","last_unstale":"2024-09-15T23:31:35.816205+0000","last_undegraded":"2024-09-15T23:31:35.816205+0000","last_fullsized":"2024-09-15T23:31:35.816205+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:30:29.535240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175925+0000","last_change":"2024-09-15T23:29:28.681646+0000","last_active":"2024-09-15T23:30:38.175925+0000","last_peered":"2024-09-15T23:30:38.175925+0000","last_clean":"2024-09-15T23:30:38.175925+0000","last_became_active":"2024-09-15T23:29:28.681282+0000","last_became_peered":"2024-09-15T23:29:28.681282+0000","last_unstale":"2024-09-15T23:30:38.175925+0000","last_undegraded":"2024-09-15T23:30:38.175925+0000","last_fullsized":"2024-09-15T23:30:38.175925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:46:12.356706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174813+0000","last_change":"2024-09-15T23:29:37.756308+0000","last_active":"2024-09-15T23:30:38.174813+0000","last_peered":"2024-09-15T23:30:38.174813+0000","last_clean":"2024-09-15T23:30:38.174813+0000","last_became_active":"2024-09-15T23:29:37.755891+0000","last_became_peered":"2024-09-15T23:29:37.755891+0000","last_unstale":"2024-09-15T23:30:38.174813+0000","last_undegraded":"2024-09-15T23:30:38.174813+0000","last_fullsized":"2024-09-15T23:30:38.174813+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:52:14.527800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.822840+0000","last_change":"2024-09-15T23:29:30.711434+0000","last_active":"2024-09-15T23:31:35.822840+0000","last_peered":"2024-09-15T23:31:35.822840+0000","last_clean":"2024-09-15T23:31:35.822840+0000","last_became_active":"2024-09-15T23:29:30.711038+0000","last_became_peered":"2024-09-15T23:29:30.711038+0000","last_unstale":"2024-09-15T23:31:35.822840+0000","last_undegraded":"2024-09-15T23:31:35.822840+0000","last_fullsized":"2024-09-15T23:31:35.822840+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:32:29.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'2","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991686+0000","last_change":"2024-09-15T23:29:28.687553+0000","last_active":"2024-09-15T23:30:37.991686+0000","last_peered":"2024-09-15T23:30:37.991686+0000","last_clean":"2024-09-15T23:30:37.991686+0000","last_became_active":"2024-09-15T23:29:28.687190+0000","last_became_peered":"2024-09-15T23:29:28.687190+0000","last_unstale":"2024-09-15T23:30:37.991686+0000","last_undegraded":"2024-09-15T23:30:37.991686+0000","last_fullsized":"2024-09-15T23:30:37.991686+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:02:05.267588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.174973+0000","last_change":"2024-09-15T23:29:37.761943+0000","last_active":"2024-09-15T23:30:38.174973+0000","last_peered":"2024-09-15T23:30:38.174973+0000","last_clean":"2024-09-15T23:30:38.174973+0000","last_became_active":"2024-09-15T23:29:37.760133+0000","last_became_peered":"2024-09-15T23:29:37.760133+0000","last_unstale":"2024-09-15T23:30:38.174973+0000","last_undegraded":"2024-09-15T23:30:38.174973+0000","last_fullsized":"2024-09-15T23:30:38.174973+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:00:46.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817164+0000","last_change":"2024-09-15T23:29:30.708672+0000","last_active":"2024-09-15T23:31:35.817164+0000","last_peered":"2024-09-15T23:31:35.817164+0000","last_clean":"2024-09-15T23:31:35.817164+0000","last_became_active":"2024-09-15T23:29:30.708276+0000","last_became_peered":"2024-09-15T23:29:30.708276+0000","last_unstale":"2024-09-15T23:31:35.817164+0000","last_undegraded":"2024-09-15T23:31:35.817164+0000","last_fullsized":"2024-09-15T23:31:35.817164+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:43:58.274625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.997109+0000","last_change":"2024-09-15T23:29:28.689602+0000","last_active":"2024-09-15T23:30:37.997109+0000","last_peered":"2024-09-15T23:30:37.997109+0000","last_clean":"2024-09-15T23:30:37.997109+0000","last_became_active":"2024-09-15T23:29:28.688751+0000","last_became_peered":"2024-09-15T23:29:28.688751+0000","last_unstale":"2024-09-15T23:30:37.997109+0000","last_undegraded":"2024-09-15T23:30:37.997109+0000","last_fullsized":"2024-09-15T23:30:37.997109+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:32:13.038978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175011+0000","last_change":"2024-09-15T23:29:37.760209+0000","last_active":"2024-09-15T23:30:38.175011+0000","last_peered":"2024-09-15T23:30:38.175011+0000","last_clean":"2024-09-15T23:30:38.175011+0000","last_became_active":"2024-09-15T23:29:37.759773+0000","last_became_peered":"2024-09-15T23:29:37.759773+0000","last_unstale":"2024-09-15T23:30:38.175011+0000","last_undegraded":"2024-09-15T23:30:38.175011+0000","last_fullsized":"2024-09-15T23:30:38.175011+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:31:09.314317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818460+0000","last_change":"2024-09-15T23:29:30.720318+0000","last_active":"2024-09-15T23:31:35.818460+0000","last_peered":"2024-09-15T23:31:35.818460+0000","last_clean":"2024-09-15T23:31:35.818460+0000","last_became_active":"2024-09-15T23:29:30.719993+0000","last_became_peered":"2024-09-15T23:29:30.719993+0000","last_unstale":"2024-09-15T23:31:35.818460+0000","last_undegraded":"2024-09-15T23:31:35.818460+0000","last_fullsized":"2024-09-15T23:31:35.818460+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:12:39.663054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994757+0000","last_change":"2024-09-15T23:29:28.867538+0000","last_active":"2024-09-15T23:30:37.994757+0000","last_peered":"2024-09-15T23:30:37.994757+0000","last_clean":"2024-09-15T23:30:37.994757+0000","last_became_active":"2024-09-15T23:29:28.867150+0000","last_became_peered":"2024-09-15T23:29:28.867150+0000","last_unstale":"2024-09-15T23:30:37.994757+0000","last_undegraded":"2024-09-15T23:30:37.994757+0000","last_fullsized":"2024-09-15T23:30:37.994757+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:00.563161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.176770+0000","last_change":"2024-09-15T23:30:38.176770+0000","last_active":"2024-09-15T23:30:38.176770+0000","last_peered":"2024-09-15T23:30:38.176770+0000","last_clean":"2024-09-15T23:30:38.176770+0000","last_became_active":"2024-09-15T23:30:38.176288+0000","last_became_peered":"2024-09-15T23:30:38.176288+0000","last_unstale":"2024-09-15T23:30:38.176770+0000","last_undegraded":"2024-09-15T23:30:38.176770+0000","last_fullsized":"2024-09-15T23:30:38.176770+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:07:08.965068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,8,11],"acting":[6,3,8,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815998+0000","last_change":"2024-09-15T23:29:30.709171+0000","last_active":"2024-09-15T23:31:35.815998+0000","last_peered":"2024-09-15T23:31:35.815998+0000","last_clean":"2024-09-15T23:31:35.815998+0000","last_became_active":"2024-09-15T23:29:30.708789+0000","last_became_peered":"2024-09-15T23:29:30.708789+0000","last_unstale":"2024-09-15T23:31:35.815998+0000","last_undegraded":"2024-09-15T23:31:35.815998+0000","last_fullsized":"2024-09-15T23:31:35.815998+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:44:28.889523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989985+0000","last_change":"2024-09-15T23:29:28.689434+0000","last_active":"2024-09-15T23:30:37.989985+0000","last_peered":"2024-09-15T23:30:37.989985+0000","last_clean":"2024-09-15T23:30:37.989985+0000","last_became_active":"2024-09-15T23:29:28.687884+0000","last_became_peered":"2024-09-15T23:29:28.687884+0000","last_unstale":"2024-09-15T23:30:37.989985+0000","last_undegraded":"2024-09-15T23:30:37.989985+0000","last_fullsized":"2024-09-15T23:30:37.989985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:55:38.596184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989557+0000","last_change":"2024-09-15T23:29:37.758758+0000","last_active":"2024-09-15T23:30:37.989557+0000","last_peered":"2024-09-15T23:30:37.989557+0000","last_clean":"2024-09-15T23:30:37.989557+0000","last_became_active":"2024-09-15T23:29:37.758395+0000","last_became_peered":"2024-09-15T23:29:37.758395+0000","last_unstale":"2024-09-15T23:30:37.989557+0000","last_undegraded":"2024-09-15T23:30:37.989557+0000","last_fullsized":"2024-09-15T23:30:37.989557+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:31:38.852291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814511+0000","last_change":"2024-09-15T23:29:30.718131+0000","last_active":"2024-09-15T23:31:35.814511+0000","last_peered":"2024-09-15T23:31:35.814511+0000","last_clean":"2024-09-15T23:31:35.814511+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814511+0000","last_undegraded":"2024-09-15T23:31:35.814511+0000","last_fullsized":"2024-09-15T23:31:35.814511+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:07:22.325811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175838+0000","last_change":"2024-09-15T23:29:28.689281+0000","last_active":"2024-09-15T23:30:38.175838+0000","last_peered":"2024-09-15T23:30:38.175838+0000","last_clean":"2024-09-15T23:30:38.175838+0000","last_became_active":"2024-09-15T23:29:28.688655+0000","last_became_peered":"2024-09-15T23:29:28.688655+0000","last_unstale":"2024-09-15T23:30:38.175838+0000","last_undegraded":"2024-09-15T23:30:38.175838+0000","last_fullsized":"2024-09-15T23:30:38.175838+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:54:30.661008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.994547+0000","last_change":"2024-09-15T23:29:37.756192+0000","last_active":"2024-09-15T23:30:37.994547+0000","last_peered":"2024-09-15T23:30:37.994547+0000","last_clean":"2024-09-15T23:30:37.994547+0000","last_became_active":"2024-09-15T23:29:37.755793+0000","last_became_peered":"2024-09-15T23:29:37.755793+0000","last_unstale":"2024-09-15T23:30:37.994547+0000","last_undegraded":"2024-09-15T23:30:37.994547+0000","last_fullsized":"2024-09-15T23:30:37.994547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:25:17.985593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811099+0000","last_change":"2024-09-15T23:29:30.706482+0000","last_active":"2024-09-15T23:31:35.811099+0000","last_peered":"2024-09-15T23:31:35.811099+0000","last_clean":"2024-09-15T23:31:35.811099+0000","last_became_active":"2024-09-15T23:29:30.706144+0000","last_became_peered":"2024-09-15T23:29:30.706144+0000","last_unstale":"2024-09-15T23:31:35.811099+0000","last_undegraded":"2024-09-15T23:31:35.811099+0000","last_fullsized":"2024-09-15T23:31:35.811099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:57.526608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'2","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996852+0000","last_change":"2024-09-15T23:29:28.690960+0000","last_active":"2024-09-15T23:30:37.996852+0000","last_peered":"2024-09-15T23:30:37.996852+0000","last_clean":"2024-09-15T23:30:37.996852+0000","last_became_active":"2024-09-15T23:29:28.690617+0000","last_became_peered":"2024-09-15T23:29:28.690617+0000","last_unstale":"2024-09-15T23:30:37.996852+0000","last_undegraded":"2024-09-15T23:30:37.996852+0000","last_fullsized":"2024-09-15T23:30:37.996852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:00:29.025087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175579+0000","last_change":"2024-09-15T23:29:37.765352+0000","last_active":"2024-09-15T23:30:38.175579+0000","last_peered":"2024-09-15T23:30:38.175579+0000","last_clean":"2024-09-15T23:30:38.175579+0000","last_became_active":"2024-09-15T23:29:37.764002+0000","last_became_peered":"2024-09-15T23:29:37.764002+0000","last_unstale":"2024-09-15T23:30:38.175579+0000","last_undegraded":"2024-09-15T23:30:38.175579+0000","last_fullsized":"2024-09-15T23:30:38.175579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:15:11.046617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819315+0000","last_change":"2024-09-15T23:29:30.710212+0000","last_active":"2024-09-15T23:31:35.819315+0000","last_peered":"2024-09-15T23:31:35.819315+0000","last_clean":"2024-09-15T23:31:35.819315+0000","last_became_active":"2024-09-15T23:29:30.709907+0000","last_became_peered":"2024-09-15T23:29:30.709907+0000","last_unstale":"2024-09-15T23:31:35.819315+0000","last_undegraded":"2024-09-15T23:31:35.819315+0000","last_fullsized":"2024-09-15T23:31:35.819315+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:32.120644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":278,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:48.511134+0000","last_change":"2024-09-15T23:29:28.692050+0000","last_active":"2024-09-15T23:31:48.511134+0000","last_peered":"2024-09-15T23:31:48.511134+0000","last_clean":"2024-09-15T23:31:48.511134+0000","last_became_active":"2024-09-15T23:29:28.691512+0000","last_became_peered":"2024-09-15T23:29:28.691512+0000","last_unstale":"2024-09-15T23:31:48.511134+0000","last_undegraded":"2024-09-15T23:31:48.511134+0000","last_fullsized":"2024-09-15T23:31:48.511134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:56:59.117175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69994,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":207,"num_read_kb":173,"num_write":36,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989239+0000","last_change":"2024-09-15T23:29:37.766164+0000","last_active":"2024-09-15T23:30:37.989239+0000","last_peered":"2024-09-15T23:30:37.989239+0000","last_clean":"2024-09-15T23:30:37.989239+0000","last_became_active":"2024-09-15T23:29:37.765458+0000","last_became_peered":"2024-09-15T23:29:37.765458+0000","last_unstale":"2024-09-15T23:30:37.989239+0000","last_undegraded":"2024-09-15T23:30:37.989239+0000","last_fullsized":"2024-09-15T23:30:37.989239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:15.160284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816222+0000","last_change":"2024-09-15T23:29:30.724650+0000","last_active":"2024-09-15T23:31:35.816222+0000","last_peered":"2024-09-15T23:31:35.816222+0000","last_clean":"2024-09-15T23:31:35.816222+0000","last_became_active":"2024-09-15T23:29:30.724302+0000","last_became_peered":"2024-09-15T23:29:30.724302+0000","last_unstale":"2024-09-15T23:31:35.816222+0000","last_undegraded":"2024-09-15T23:31:35.816222+0000","last_fullsized":"2024-09-15T23:31:35.816222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:19:32.883880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'3","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175743+0000","last_change":"2024-09-15T23:29:28.868899+0000","last_active":"2024-09-15T23:30:38.175743+0000","last_peered":"2024-09-15T23:30:38.175743+0000","last_clean":"2024-09-15T23:30:38.175743+0000","last_became_active":"2024-09-15T23:29:28.868401+0000","last_became_peered":"2024-09-15T23:29:28.868401+0000","last_unstale":"2024-09-15T23:30:38.175743+0000","last_undegraded":"2024-09-15T23:30:38.175743+0000","last_fullsized":"2024-09-15T23:30:38.175743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:53.164208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.989892+0000","last_change":"2024-09-15T23:29:37.755594+0000","last_active":"2024-09-15T23:30:37.989892+0000","last_peered":"2024-09-15T23:30:37.989892+0000","last_clean":"2024-09-15T23:30:37.989892+0000","last_became_active":"2024-09-15T23:29:37.755119+0000","last_became_peered":"2024-09-15T23:29:37.755119+0000","last_unstale":"2024-09-15T23:30:37.989892+0000","last_undegraded":"2024-09-15T23:30:37.989892+0000","last_fullsized":"2024-09-15T23:30:37.989892+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:56:34.470377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816458+0000","last_change":"2024-09-15T23:29:37.765267+0000","last_active":"2024-09-15T23:31:35.816458+0000","last_peered":"2024-09-15T23:31:35.816458+0000","last_clean":"2024-09-15T23:31:35.816458+0000","last_became_active":"2024-09-15T23:29:37.764912+0000","last_became_peered":"2024-09-15T23:29:37.764912+0000","last_unstale":"2024-09-15T23:31:35.816458+0000","last_undegraded":"2024-09-15T23:31:35.816458+0000","last_fullsized":"2024-09-15T23:31:35.816458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:40:46.865449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175943+0000","last_change":"2024-09-15T23:29:28.688644+0000","last_active":"2024-09-15T23:30:38.175943+0000","last_peered":"2024-09-15T23:30:38.175943+0000","last_clean":"2024-09-15T23:30:38.175943+0000","last_became_active":"2024-09-15T23:29:28.688319+0000","last_became_peered":"2024-09-15T23:29:28.688319+0000","last_unstale":"2024-09-15T23:30:38.175943+0000","last_undegraded":"2024-09-15T23:30:38.175943+0000","last_fullsized":"2024-09-15T23:30:38.175943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:26:37.238472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.988945+0000","last_change":"2024-09-15T23:29:37.757140+0000","last_active":"2024-09-15T23:30:37.988945+0000","last_peered":"2024-09-15T23:30:37.988945+0000","last_clean":"2024-09-15T23:30:37.988945+0000","last_became_active":"2024-09-15T23:29:37.756618+0000","last_became_peered":"2024-09-15T23:29:37.756618+0000","last_unstale":"2024-09-15T23:30:37.988945+0000","last_undegraded":"2024-09-15T23:30:37.988945+0000","last_fullsized":"2024-09-15T23:30:37.988945+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:18:37.042544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809332+0000","last_change":"2024-09-15T23:29:30.719415+0000","last_active":"2024-09-15T23:31:35.809332+0000","last_peered":"2024-09-15T23:31:35.809332+0000","last_clean":"2024-09-15T23:31:35.809332+0000","last_became_active":"2024-09-15T23:29:30.719065+0000","last_became_peered":"2024-09-15T23:29:30.719065+0000","last_unstale":"2024-09-15T23:31:35.809332+0000","last_undegraded":"2024-09-15T23:31:35.809332+0000","last_fullsized":"2024-09-15T23:31:35.809332+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:14:06.529764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175803+0000","last_change":"2024-09-15T23:29:28.682948+0000","last_active":"2024-09-15T23:30:38.175803+0000","last_peered":"2024-09-15T23:30:38.175803+0000","last_clean":"2024-09-15T23:30:38.175803+0000","last_became_active":"2024-09-15T23:29:28.682587+0000","last_became_peered":"2024-09-15T23:29:28.682587+0000","last_unstale":"2024-09-15T23:30:38.175803+0000","last_undegraded":"2024-09-15T23:30:38.175803+0000","last_fullsized":"2024-09-15T23:30:38.175803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:37.900486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175110+0000","last_change":"2024-09-15T23:29:37.762903+0000","last_active":"2024-09-15T23:30:38.175110+0000","last_peered":"2024-09-15T23:30:38.175110+0000","last_clean":"2024-09-15T23:30:38.175110+0000","last_became_active":"2024-09-15T23:29:37.762529+0000","last_became_peered":"2024-09-15T23:29:37.762529+0000","last_unstale":"2024-09-15T23:30:38.175110+0000","last_undegraded":"2024-09-15T23:30:38.175110+0000","last_fullsized":"2024-09-15T23:30:38.175110+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:23:44.146090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175037+0000","last_change":"2024-09-15T23:29:37.756344+0000","last_active":"2024-09-15T23:30:38.175037+0000","last_peered":"2024-09-15T23:30:38.175037+0000","last_clean":"2024-09-15T23:30:38.175037+0000","last_became_active":"2024-09-15T23:29:37.755979+0000","last_became_peered":"2024-09-15T23:29:37.755979+0000","last_unstale":"2024-09-15T23:30:38.175037+0000","last_undegraded":"2024-09-15T23:30:38.175037+0000","last_fullsized":"2024-09-15T23:30:38.175037+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:01:12.267581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814137+0000","last_change":"2024-09-15T23:29:30.712788+0000","last_active":"2024-09-15T23:31:35.814137+0000","last_peered":"2024-09-15T23:31:35.814137+0000","last_clean":"2024-09-15T23:31:35.814137+0000","last_became_active":"2024-09-15T23:29:30.712467+0000","last_became_peered":"2024-09-15T23:29:30.712467+0000","last_unstale":"2024-09-15T23:31:35.814137+0000","last_undegraded":"2024-09-15T23:31:35.814137+0000","last_fullsized":"2024-09-15T23:31:35.814137+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:10.592320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175332+0000","last_change":"2024-09-15T23:29:28.687873+0000","last_active":"2024-09-15T23:30:38.175332+0000","last_peered":"2024-09-15T23:30:38.175332+0000","last_clean":"2024-09-15T23:30:38.175332+0000","last_became_active":"2024-09-15T23:29:28.687547+0000","last_became_peered":"2024-09-15T23:29:28.687547+0000","last_unstale":"2024-09-15T23:30:38.175332+0000","last_undegraded":"2024-09-15T23:30:38.175332+0000","last_fullsized":"2024-09-15T23:30:38.175332+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:03.730363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.177004+0000","last_change":"2024-09-15T23:30:38.176371+0000","last_active":"2024-09-15T23:30:38.177004+0000","last_peered":"2024-09-15T23:30:38.177004+0000","last_clean":"2024-09-15T23:30:38.177004+0000","last_became_active":"2024-09-15T23:30:38.175801+0000","last_became_peered":"2024-09-15T23:30:38.175801+0000","last_unstale":"2024-09-15T23:30:38.177004+0000","last_undegraded":"2024-09-15T23:30:38.177004+0000","last_fullsized":"2024-09-15T23:30:38.177004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:57:20.067100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821826+0000","last_change":"2024-09-15T23:29:30.712319+0000","last_active":"2024-09-15T23:31:35.821826+0000","last_peered":"2024-09-15T23:31:35.821826+0000","last_clean":"2024-09-15T23:31:35.821826+0000","last_became_active":"2024-09-15T23:29:30.711866+0000","last_became_peered":"2024-09-15T23:29:30.711866+0000","last_unstale":"2024-09-15T23:31:35.821826+0000","last_undegraded":"2024-09-15T23:31:35.821826+0000","last_fullsized":"2024-09-15T23:31:35.821826+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:12:30.766636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.991136+0000","last_change":"2024-09-15T23:29:28.685116+0000","last_active":"2024-09-15T23:30:37.991136+0000","last_peered":"2024-09-15T23:30:37.991136+0000","last_clean":"2024-09-15T23:30:37.991136+0000","last_became_active":"2024-09-15T23:29:28.684704+0000","last_became_peered":"2024-09-15T23:29:28.684704+0000","last_unstale":"2024-09-15T23:30:37.991136+0000","last_undegraded":"2024-09-15T23:30:37.991136+0000","last_fullsized":"2024-09-15T23:30:37.991136+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:47.018424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175333+0000","last_change":"2024-09-15T23:29:28.688419+0000","last_active":"2024-09-15T23:30:38.175333+0000","last_peered":"2024-09-15T23:30:38.175333+0000","last_clean":"2024-09-15T23:30:38.175333+0000","last_became_active":"2024-09-15T23:29:28.688050+0000","last_became_peered":"2024-09-15T23:29:28.688050+0000","last_unstale":"2024-09-15T23:30:38.175333+0000","last_undegraded":"2024-09-15T23:30:38.175333+0000","last_fullsized":"2024-09-15T23:30:38.175333+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:54:09.834018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814237+0000","last_change":"2024-09-15T23:29:30.721462+0000","last_active":"2024-09-15T23:31:35.814237+0000","last_peered":"2024-09-15T23:31:35.814237+0000","last_clean":"2024-09-15T23:31:35.814237+0000","last_became_active":"2024-09-15T23:29:30.721119+0000","last_became_peered":"2024-09-15T23:29:30.721119+0000","last_unstale":"2024-09-15T23:31:35.814237+0000","last_undegraded":"2024-09-15T23:31:35.814237+0000","last_fullsized":"2024-09-15T23:31:35.814237+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:36.441545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996604+0000","last_change":"2024-09-15T23:29:37.762783+0000","last_active":"2024-09-15T23:30:37.996604+0000","last_peered":"2024-09-15T23:30:37.996604+0000","last_clean":"2024-09-15T23:30:37.996604+0000","last_became_active":"2024-09-15T23:29:37.762368+0000","last_became_peered":"2024-09-15T23:29:37.762368+0000","last_unstale":"2024-09-15T23:30:37.996604+0000","last_undegraded":"2024-09-15T23:30:37.996604+0000","last_fullsized":"2024-09-15T23:30:37.996604+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:44:59.379982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'1","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:38.175569+0000","last_change":"2024-09-15T23:29:28.689684+0000","last_active":"2024-09-15T23:30:38.175569+0000","last_peered":"2024-09-15T23:30:38.175569+0000","last_clean":"2024-09-15T23:30:38.175569+0000","last_became_active":"2024-09-15T23:29:28.689296+0000","last_became_peered":"2024-09-15T23:29:28.689296+0000","last_unstale":"2024-09-15T23:30:38.175569+0000","last_undegraded":"2024-09-15T23:30:38.175569+0000","last_fullsized":"2024-09-15T23:30:38.175569+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:27.664511+0000","last_clean_scrub_stamp":"2024-09-15T23:29:27.664511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:46:20.564774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818130+0000","last_change":"2024-09-15T23:29:30.711550+0000","last_active":"2024-09-15T23:31:35.818130+0000","last_peered":"2024-09-15T23:31:35.818130+0000","last_clean":"2024-09-15T23:31:35.818130+0000","last_became_active":"2024-09-15T23:29:30.710900+0000","last_became_peered":"2024-09-15T23:29:30.710900+0000","last_unstale":"2024-09-15T23:31:35.818130+0000","last_undegraded":"2024-09-15T23:31:35.818130+0000","last_fullsized":"2024-09-15T23:31:35.818130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:16:43.185020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:30:37.996722+0000","last_change":"2024-09-15T23:29:37.765642+0000","last_active":"2024-09-15T23:30:37.996722+0000","last_peered":"2024-09-15T23:30:37.996722+0000","last_clean":"2024-09-15T23:30:37.996722+0000","last_became_active":"2024-09-15T23:29:37.765142+0000","last_became_peered":"2024-09-15T23:29:37.765142+0000","last_unstale":"2024-09-15T23:30:37.996722+0000","last_undegraded":"2024-09-15T23:30:37.996722+0000","last_fullsized":"2024-09-15T23:30:37.996722+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:36.732564+0000","last_clean_scrub_stamp":"2024-09-15T23:29:36.732564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:04:29.058435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.820319+0000","last_change":"2024-09-15T23:29:30.709585+0000","last_active":"2024-09-15T23:31:35.820319+0000","last_peered":"2024-09-15T23:31:35.820319+0000","last_clean":"2024-09-15T23:31:35.820319+0000","last_became_active":"2024-09-15T23:29:30.709175+0000","last_became_peered":"2024-09-15T23:29:30.709175+0000","last_unstale":"2024-09-15T23:31:35.820319+0000","last_undegraded":"2024-09-15T23:31:35.820319+0000","last_fullsized":"2024-09-15T23:31:35.820319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:49.481136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":42,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812865+0000","last_change":"2024-09-15T23:29:30.719305+0000","last_active":"2024-09-15T23:31:35.812865+0000","last_peered":"2024-09-15T23:31:35.812865+0000","last_clean":"2024-09-15T23:31:35.812865+0000","last_became_active":"2024-09-15T23:29:30.718605+0000","last_became_peered":"2024-09-15T23:29:30.718605+0000","last_unstale":"2024-09-15T23:31:35.812865+0000","last_undegraded":"2024-09-15T23:31:35.812865+0000","last_fullsized":"2024-09-15T23:31:35.812865+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:49:58.238283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811663+0000","last_change":"2024-09-15T23:29:30.715633+0000","last_active":"2024-09-15T23:31:35.811663+0000","last_peered":"2024-09-15T23:31:35.811663+0000","last_clean":"2024-09-15T23:31:35.811663+0000","last_became_active":"2024-09-15T23:29:30.715242+0000","last_became_peered":"2024-09-15T23:29:30.715242+0000","last_unstale":"2024-09-15T23:31:35.811663+0000","last_undegraded":"2024-09-15T23:31:35.811663+0000","last_fullsized":"2024-09-15T23:31:35.811663+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:27:16.883476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813552+0000","last_change":"2024-09-15T23:29:30.717824+0000","last_active":"2024-09-15T23:31:35.813552+0000","last_peered":"2024-09-15T23:31:35.813552+0000","last_clean":"2024-09-15T23:31:35.813552+0000","last_became_active":"2024-09-15T23:29:30.717509+0000","last_became_peered":"2024-09-15T23:29:30.717509+0000","last_unstale":"2024-09-15T23:31:35.813552+0000","last_undegraded":"2024-09-15T23:31:35.813552+0000","last_fullsized":"2024-09-15T23:31:35.813552+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:42.793490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814725+0000","last_change":"2024-09-15T23:29:30.709970+0000","last_active":"2024-09-15T23:31:35.814725+0000","last_peered":"2024-09-15T23:31:35.814725+0000","last_clean":"2024-09-15T23:31:35.814725+0000","last_became_active":"2024-09-15T23:29:30.709672+0000","last_became_peered":"2024-09-15T23:29:30.709672+0000","last_unstale":"2024-09-15T23:31:35.814725+0000","last_undegraded":"2024-09-15T23:31:35.814725+0000","last_fullsized":"2024-09-15T23:31:35.814725+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:15.294329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.819174+0000","last_change":"2024-09-15T23:29:30.712724+0000","last_active":"2024-09-15T23:31:35.819174+0000","last_peered":"2024-09-15T23:31:35.819174+0000","last_clean":"2024-09-15T23:31:35.819174+0000","last_became_active":"2024-09-15T23:29:30.712374+0000","last_became_peered":"2024-09-15T23:29:30.712374+0000","last_unstale":"2024-09-15T23:31:35.819174+0000","last_undegraded":"2024-09-15T23:31:35.819174+0000","last_fullsized":"2024-09-15T23:31:35.819174+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:51:49.506539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813766+0000","last_change":"2024-09-15T23:29:30.715965+0000","last_active":"2024-09-15T23:31:35.813766+0000","last_peered":"2024-09-15T23:31:35.813766+0000","last_clean":"2024-09-15T23:31:35.813766+0000","last_became_active":"2024-09-15T23:29:30.715626+0000","last_became_peered":"2024-09-15T23:29:30.715626+0000","last_unstale":"2024-09-15T23:31:35.813766+0000","last_undegraded":"2024-09-15T23:31:35.813766+0000","last_fullsized":"2024-09-15T23:31:35.813766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:51:54.725994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":32,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811984+0000","last_change":"2024-09-15T23:29:30.718998+0000","last_active":"2024-09-15T23:31:35.811984+0000","last_peered":"2024-09-15T23:31:35.811984+0000","last_clean":"2024-09-15T23:31:35.811984+0000","last_became_active":"2024-09-15T23:29:30.718717+0000","last_became_peered":"2024-09-15T23:29:30.718717+0000","last_unstale":"2024-09-15T23:31:35.811984+0000","last_undegraded":"2024-09-15T23:31:35.811984+0000","last_fullsized":"2024-09-15T23:31:35.811984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:42:27.895726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818138+0000","last_change":"2024-09-15T23:29:30.712955+0000","last_active":"2024-09-15T23:31:35.818138+0000","last_peered":"2024-09-15T23:31:35.818138+0000","last_clean":"2024-09-15T23:31:35.818138+0000","last_became_active":"2024-09-15T23:29:30.711203+0000","last_became_peered":"2024-09-15T23:29:30.711203+0000","last_unstale":"2024-09-15T23:31:35.818138+0000","last_undegraded":"2024-09-15T23:31:35.818138+0000","last_fullsized":"2024-09-15T23:31:35.818138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:03:27.292061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821943+0000","last_change":"2024-09-15T23:29:30.715373+0000","last_active":"2024-09-15T23:31:35.821943+0000","last_peered":"2024-09-15T23:31:35.821943+0000","last_clean":"2024-09-15T23:31:35.821943+0000","last_became_active":"2024-09-15T23:29:30.715099+0000","last_became_peered":"2024-09-15T23:29:30.715099+0000","last_unstale":"2024-09-15T23:31:35.821943+0000","last_undegraded":"2024-09-15T23:31:35.821943+0000","last_fullsized":"2024-09-15T23:31:35.821943+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:37.948993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":40,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817598+0000","last_change":"2024-09-15T23:29:30.714392+0000","last_active":"2024-09-15T23:31:35.817598+0000","last_peered":"2024-09-15T23:31:35.817598+0000","last_clean":"2024-09-15T23:31:35.817598+0000","last_became_active":"2024-09-15T23:29:30.714061+0000","last_became_peered":"2024-09-15T23:29:30.714061+0000","last_unstale":"2024-09-15T23:31:35.817598+0000","last_undegraded":"2024-09-15T23:31:35.817598+0000","last_fullsized":"2024-09-15T23:31:35.817598+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:19.397495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.810734+0000","last_change":"2024-09-15T23:29:30.709982+0000","last_active":"2024-09-15T23:31:35.810734+0000","last_peered":"2024-09-15T23:31:35.810734+0000","last_clean":"2024-09-15T23:31:35.810734+0000","last_became_active":"2024-09-15T23:29:30.709662+0000","last_became_peered":"2024-09-15T23:29:30.709662+0000","last_unstale":"2024-09-15T23:31:35.810734+0000","last_undegraded":"2024-09-15T23:31:35.810734+0000","last_fullsized":"2024-09-15T23:31:35.810734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:18:00.383160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.818860+0000","last_change":"2024-09-15T23:29:30.711661+0000","last_active":"2024-09-15T23:31:35.818860+0000","last_peered":"2024-09-15T23:31:35.818860+0000","last_clean":"2024-09-15T23:31:35.818860+0000","last_became_active":"2024-09-15T23:29:30.711318+0000","last_became_peered":"2024-09-15T23:29:30.711318+0000","last_unstale":"2024-09-15T23:31:35.818860+0000","last_undegraded":"2024-09-15T23:31:35.818860+0000","last_fullsized":"2024-09-15T23:31:35.818860+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:25.402628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813172+0000","last_change":"2024-09-15T23:29:30.713838+0000","last_active":"2024-09-15T23:31:35.813172+0000","last_peered":"2024-09-15T23:31:35.813172+0000","last_clean":"2024-09-15T23:31:35.813172+0000","last_became_active":"2024-09-15T23:29:30.713499+0000","last_became_peered":"2024-09-15T23:29:30.713499+0000","last_unstale":"2024-09-15T23:31:35.813172+0000","last_undegraded":"2024-09-15T23:31:35.813172+0000","last_fullsized":"2024-09-15T23:31:35.813172+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:54:27.191285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811607+0000","last_change":"2024-09-15T23:29:30.714501+0000","last_active":"2024-09-15T23:31:35.811607+0000","last_peered":"2024-09-15T23:31:35.811607+0000","last_clean":"2024-09-15T23:31:35.811607+0000","last_became_active":"2024-09-15T23:29:30.714204+0000","last_became_peered":"2024-09-15T23:29:30.714204+0000","last_unstale":"2024-09-15T23:31:35.811607+0000","last_undegraded":"2024-09-15T23:31:35.811607+0000","last_fullsized":"2024-09-15T23:31:35.811607+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:02:21.794956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817619+0000","last_change":"2024-09-15T23:29:30.717301+0000","last_active":"2024-09-15T23:31:35.817619+0000","last_peered":"2024-09-15T23:31:35.817619+0000","last_clean":"2024-09-15T23:31:35.817619+0000","last_became_active":"2024-09-15T23:29:30.716997+0000","last_became_peered":"2024-09-15T23:29:30.716997+0000","last_unstale":"2024-09-15T23:31:35.817619+0000","last_undegraded":"2024-09-15T23:31:35.817619+0000","last_fullsized":"2024-09-15T23:31:35.817619+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:03:33.047298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817599+0000","last_change":"2024-09-15T23:29:30.714226+0000","last_active":"2024-09-15T23:31:35.817599+0000","last_peered":"2024-09-15T23:31:35.817599+0000","last_clean":"2024-09-15T23:31:35.817599+0000","last_became_active":"2024-09-15T23:29:30.713901+0000","last_became_peered":"2024-09-15T23:29:30.713901+0000","last_unstale":"2024-09-15T23:31:35.817599+0000","last_undegraded":"2024-09-15T23:31:35.817599+0000","last_fullsized":"2024-09-15T23:31:35.817599+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:26:12.573749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.814362+0000","last_change":"2024-09-15T23:29:30.718343+0000","last_active":"2024-09-15T23:31:35.814362+0000","last_peered":"2024-09-15T23:31:35.814362+0000","last_clean":"2024-09-15T23:31:35.814362+0000","last_became_active":"2024-09-15T23:29:30.717791+0000","last_became_peered":"2024-09-15T23:29:30.717791+0000","last_unstale":"2024-09-15T23:31:35.814362+0000","last_undegraded":"2024-09-15T23:31:35.814362+0000","last_fullsized":"2024-09-15T23:31:35.814362+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:39.786301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816329+0000","last_change":"2024-09-15T23:29:30.713212+0000","last_active":"2024-09-15T23:31:35.816329+0000","last_peered":"2024-09-15T23:31:35.816329+0000","last_clean":"2024-09-15T23:31:35.816329+0000","last_became_active":"2024-09-15T23:29:30.712887+0000","last_became_peered":"2024-09-15T23:29:30.712887+0000","last_unstale":"2024-09-15T23:31:35.816329+0000","last_undegraded":"2024-09-15T23:31:35.816329+0000","last_fullsized":"2024-09-15T23:31:35.816329+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:29:28.867863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811100+0000","last_change":"2024-09-15T23:29:30.707574+0000","last_active":"2024-09-15T23:31:35.811100+0000","last_peered":"2024-09-15T23:31:35.811100+0000","last_clean":"2024-09-15T23:31:35.811100+0000","last_became_active":"2024-09-15T23:29:30.707242+0000","last_became_peered":"2024-09-15T23:29:30.707242+0000","last_unstale":"2024-09-15T23:31:35.811100+0000","last_undegraded":"2024-09-15T23:31:35.811100+0000","last_fullsized":"2024-09-15T23:31:35.811100+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:18.983238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":26,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.812600+0000","last_change":"2024-09-15T23:29:38.298295+0000","last_active":"2024-09-15T23:31:35.812600+0000","last_peered":"2024-09-15T23:31:35.812600+0000","last_clean":"2024-09-15T23:31:35.812600+0000","last_became_active":"2024-09-15T23:29:38.297861+0000","last_became_peered":"2024-09-15T23:29:38.297861+0000","last_unstale":"2024-09-15T23:31:35.812600+0000","last_undegraded":"2024-09-15T23:31:35.812600+0000","last_fullsized":"2024-09-15T23:31:35.812600+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:30:32.525722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.813920+0000","last_change":"2024-09-15T23:29:30.719367+0000","last_active":"2024-09-15T23:31:35.813920+0000","last_peered":"2024-09-15T23:31:35.813920+0000","last_clean":"2024-09-15T23:31:35.813920+0000","last_became_active":"2024-09-15T23:29:30.719026+0000","last_became_peered":"2024-09-15T23:29:30.719026+0000","last_unstale":"2024-09-15T23:31:35.813920+0000","last_undegraded":"2024-09-15T23:31:35.813920+0000","last_fullsized":"2024-09-15T23:31:35.813920+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:34:55.736737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.807698+0000","last_change":"2024-09-15T23:29:30.721590+0000","last_active":"2024-09-15T23:31:35.807698+0000","last_peered":"2024-09-15T23:31:35.807698+0000","last_clean":"2024-09-15T23:31:35.807698+0000","last_became_active":"2024-09-15T23:29:30.721080+0000","last_became_peered":"2024-09-15T23:29:30.721080+0000","last_unstale":"2024-09-15T23:31:35.807698+0000","last_undegraded":"2024-09-15T23:31:35.807698+0000","last_fullsized":"2024-09-15T23:31:35.807698+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:21.624781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.821986+0000","last_change":"2024-09-15T23:29:37.757821+0000","last_active":"2024-09-15T23:31:35.821986+0000","last_peered":"2024-09-15T23:31:35.821986+0000","last_clean":"2024-09-15T23:31:35.821986+0000","last_became_active":"2024-09-15T23:29:37.757414+0000","last_became_peered":"2024-09-15T23:29:37.757414+0000","last_unstale":"2024-09-15T23:31:35.821986+0000","last_undegraded":"2024-09-15T23:31:35.821986+0000","last_fullsized":"2024-09-15T23:31:35.821986+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:11:31.252604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,11],"acting":[1,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.815004+0000","last_change":"2024-09-15T23:29:30.718283+0000","last_active":"2024-09-15T23:31:35.815004+0000","last_peered":"2024-09-15T23:31:35.815004+0000","last_clean":"2024-09-15T23:31:35.815004+0000","last_became_active":"2024-09-15T23:29:30.717899+0000","last_became_peered":"2024-09-15T23:29:30.717899+0000","last_unstale":"2024-09-15T23:31:35.815004+0000","last_undegraded":"2024-09-15T23:31:35.815004+0000","last_fullsized":"2024-09-15T23:31:35.815004+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:37:36.656325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816003+0000","last_change":"2024-09-15T23:29:30.709234+0000","last_active":"2024-09-15T23:31:35.816003+0000","last_peered":"2024-09-15T23:31:35.816003+0000","last_clean":"2024-09-15T23:31:35.816003+0000","last_became_active":"2024-09-15T23:29:30.708842+0000","last_became_peered":"2024-09-15T23:29:30.708842+0000","last_unstale":"2024-09-15T23:31:35.816003+0000","last_undegraded":"2024-09-15T23:31:35.816003+0000","last_fullsized":"2024-09-15T23:31:35.816003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:12:55.837569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.809435+0000","last_change":"2024-09-15T23:29:30.719274+0000","last_active":"2024-09-15T23:31:35.809435+0000","last_peered":"2024-09-15T23:31:35.809435+0000","last_clean":"2024-09-15T23:31:35.809435+0000","last_became_active":"2024-09-15T23:29:30.718751+0000","last_became_peered":"2024-09-15T23:29:30.718751+0000","last_unstale":"2024-09-15T23:31:35.809435+0000","last_undegraded":"2024-09-15T23:31:35.809435+0000","last_fullsized":"2024-09-15T23:31:35.809435+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:11:10.864971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":33,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811335+0000","last_change":"2024-09-15T23:29:30.713715+0000","last_active":"2024-09-15T23:31:35.811335+0000","last_peered":"2024-09-15T23:31:35.811335+0000","last_clean":"2024-09-15T23:31:35.811335+0000","last_became_active":"2024-09-15T23:29:30.713388+0000","last_became_peered":"2024-09-15T23:29:30.713388+0000","last_unstale":"2024-09-15T23:31:35.811335+0000","last_undegraded":"2024-09-15T23:31:35.811335+0000","last_fullsized":"2024-09-15T23:31:35.811335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:35:05.521612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.811983+0000","last_change":"2024-09-15T23:29:30.718148+0000","last_active":"2024-09-15T23:31:35.811983+0000","last_peered":"2024-09-15T23:31:35.811983+0000","last_clean":"2024-09-15T23:31:35.811983+0000","last_became_active":"2024-09-15T23:29:30.716482+0000","last_became_peered":"2024-09-15T23:29:30.716482+0000","last_unstale":"2024-09-15T23:31:35.811983+0000","last_undegraded":"2024-09-15T23:31:35.811983+0000","last_fullsized":"2024-09-15T23:31:35.811983+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:06:03.167035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":37,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817612+0000","last_change":"2024-09-15T23:29:30.716245+0000","last_active":"2024-09-15T23:31:35.817612+0000","last_peered":"2024-09-15T23:31:35.817612+0000","last_clean":"2024-09-15T23:31:35.817612+0000","last_became_active":"2024-09-15T23:29:30.715916+0000","last_became_peered":"2024-09-15T23:29:30.715916+0000","last_unstale":"2024-09-15T23:31:35.817612+0000","last_undegraded":"2024-09-15T23:31:35.817612+0000","last_fullsized":"2024-09-15T23:31:35.817612+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T11:04:02.595165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":34,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.816822+0000","last_change":"2024-09-15T23:29:30.711121+0000","last_active":"2024-09-15T23:31:35.816822+0000","last_peered":"2024-09-15T23:31:35.816822+0000","last_clean":"2024-09-15T23:31:35.816822+0000","last_became_active":"2024-09-15T23:29:30.710795+0000","last_became_peered":"2024-09-15T23:29:30.710795+0000","last_unstale":"2024-09-15T23:31:35.816822+0000","last_undegraded":"2024-09-15T23:31:35.816822+0000","last_fullsized":"2024-09-15T23:31:35.816822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:14:50.341851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"91'8","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-15T23:31:35.817393+0000","last_change":"2024-09-15T23:29:30.718370+0000","last_active":"2024-09-15T23:31:35.817393+0000","last_peered":"2024-09-15T23:31:35.817393+0000","last_clean":"2024-09-15T23:31:35.817393+0000","last_became_active":"2024-09-15T23:29:30.718028+0000","last_became_peered":"2024-09-15T23:29:30.718028+0000","last_unstale":"2024-09-15T23:31:35.817393+0000","last_undegraded":"2024-09-15T23:31:35.817393+0000","last_fullsized":"2024-09-15T23:31:35.817393+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T23:29:29.675758+0000","last_clean_scrub_stamp":"2024-09-15T23:29:29.675758+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:26:22.242541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70792,"num_objects":22,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":214,"num_read_kb":180,"num_write":94,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294912,"data_stored":212376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":77,"seq":330712481834,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":510684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":70,"seq":300647710766,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28692,"kb_used_data":1668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716460,"statfs":{"total":95995035648,"available":95965655040,"internally_reserved":0,"allocated":1708032,"data_stored":1167144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":65,"seq":279172874292,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28036,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717116,"statfs":{"total":95995035648,"available":95966326784,"internally_reserved":0,"allocated":1036288,"data_stored":515362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":58,"seq":249108103226,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":511288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":50,"seq":214748364863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1630208,"data_stored":1105730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561091,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32184,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712968,"statfs":{"total":95995035648,"available":95962079232,"internally_reserved":0,"allocated":1024000,"data_stored":506588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790024,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1596,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1634304,"data_stored":1101234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953550,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32192,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712960,"statfs":{"total":95995035648,"available":95962071040,"internally_reserved":0,"allocated":1032192,"data_stored":510706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182483,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":506692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411416,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28104,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717048,"statfs":{"total":95995035648,"available":95966257152,"internally_reserved":0,"allocated":1105920,"data_stored":576616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574940,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":576582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":506678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":70028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T23:31:54.633 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:54.891 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 -- 172.21.15.77:0/2389318930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710101420 msgr2=0x7f071010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 --2- 172.21.15.77:0/2389318930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710101420 0x7f071010d950 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f0708009cd0 tx=0x7f070802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 -- 172.21.15.77:0/2389318930 shutdown_connections 2024-09-15T23:31:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 --2- 172.21.15.77:0/2389318930 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710101420 0x7f071010d950 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.350 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 --2- 172.21.15.77:0/2389318930 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710100a80 0x7f0710100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 --2- 172.21.15.77:0/2389318930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 0x7f0710106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 -- 172.21.15.77:0/2389318930 >> 172.21.15.77:0/2389318930 conn(0x7f07100fc7a0 msgr2=0x7f07100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 -- 172.21.15.77:0/2389318930 shutdown_connections 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.335+0000 7f0715ced640 1 -- 172.21.15.77:0/2389318930 wait complete. 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 Processor -- start 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 -- start start 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710101420 0x7f07101975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 0x7f0710197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0710110e80 con 0x7f0710100a80 2024-09-15T23:31:55.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0710110d00 con 0x7f0710101420 2024-09-15T23:31:55.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.336+0000 7f0715ced640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0710111000 con 0x7f0710106a80 2024-09-15T23:31:55.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:55.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:34484/0 (socket says 172.21.15.77:34484) 2024-09-15T23:31:55.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 -- 172.21.15.77:0/897930339 learned_addr learned my addr 172.21.15.77:0/897930339 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:55.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070effd640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710101420 0x7f07101975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:55.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070ffff640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 0x7f0710197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:55.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 -- 172.21.15.77:0/897930339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 msgr2=0x7f0710197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:55.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 0x7f0710197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 -- 172.21.15.77:0/897930339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710101420 msgr2=0x7f07101975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:55.353 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710101420 0x7f07101975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 -- 172.21.15.77:0/897930339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07101a68f0 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070f7fe640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f070000e9f0 tx=0x7f070000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070000cd80 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0700005500 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07101a6be0 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0700010690 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.337+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07101a70d0 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.338+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710100ee0 con 0x7f0710100a80 2024-09-15T23:31:55.354 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.339+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f07000046c0 con 0x7f0710100a80 2024-09-15T23:31:55.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.340+0000 7f070cff9640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 0x7f06f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:55.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.340+0000 7f070effd640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 0x7f06f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:55.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.340+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f07000d0100 con 0x7f0710100a80 2024-09-15T23:31:55.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.341+0000 7f070effd640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 0x7f06f80a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07101991e0 tx=0x7f070400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:55.355 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.345+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f070009ca90 con 0x7f0710100a80 2024-09-15T23:31:55.546 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.545+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f071002d7c0 con 0x7f0710100a80 2024-09-15T23:31:55.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.546+0000 7f070cff9640 1 -- 172.21.15.77:0/897930339 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f070009c390 con 0x7f0710100a80 2024-09-15T23:31:55.547 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:55.548 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:55.548 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:55.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 msgr2=0x7f06f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 0x7f06f80a5700 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f07101991e0 tx=0x7f070400b390 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 msgr2=0x7f0710197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f070000e9f0 tx=0x7f070000edf0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 shutdown_connections 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06f80a3240 0x7f06f80a5700 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0710106a80 0x7f0710197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0710101420 0x7f07101975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 --2- 172.21.15.77:0/897930339 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0710100a80 0x7f0710197080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 >> 172.21.15.77:0/897930339 conn(0x7f07100fc7a0 msgr2=0x7f07100fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.548+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 shutdown_connections 2024-09-15T23:31:55.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:55.549+0000 7f0715ced640 1 -- 172.21.15.77:0/897930339 wait complete. 2024-09-15T23:31:55.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:55 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/897930339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:55.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:55 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/897930339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:55.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:55 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/897930339' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:56.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:31:56.504 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:56.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:56 smithi155 ceph-mon[35631]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T23:31:56.882 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:56 smithi077 ceph-mon[30968]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T23:31:56.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:56 smithi159 ceph-mon[35472]: pgmap v361: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 682 B/s wr, 3 op/s 2024-09-15T23:31:57.017 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 -- 172.21.15.77:0/445194919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4102790 msgr2=0x7f3cd41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/445194919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4102790 0x7f3cd41067e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009900 tx=0x7f3cc002a410 comp rx=0 tx=0).stop 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 -- 172.21.15.77:0/445194919 shutdown_connections 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/445194919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4106f10 0x7f3cd410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/445194919 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4102790 0x7f3cd41067e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/445194919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 -- 172.21.15.77:0/445194919 >> 172.21.15.77:0/445194919 conn(0x7f3cd40fd8c0 msgr2=0x7f3cd40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 -- 172.21.15.77:0/445194919 shutdown_connections 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.980+0000 7f3cdb10f640 1 -- 172.21.15.77:0/445194919 wait complete. 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 Processor -- start 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 -- start start 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:57.018 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 0x7f3cd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4111fe0 con 0x7f3cd4106f10 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4111e60 con 0x7f3cd4101de0 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cdb10f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd4112160 con 0x7f3cd4102790 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54542/0 (socket says 172.21.15.77:54542) 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 -- 172.21.15.77:0/3076399418 learned_addr learned my addr 172.21.15.77:0/3076399418 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd8eab640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd3fff640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 0x7f3cd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 -- 172.21.15.77:0/3076399418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 msgr2=0x7f3cd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 0x7f3cd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 -- 172.21.15.77:0/3076399418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 msgr2=0x7f3cd40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.019 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd96ac640 1 -- 172.21.15.77:0/3076399418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd41a68b0 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd8eab640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.981+0000 7f3cd3fff640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 0x7f3cd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cd96ac640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00b970 tx=0x7f3ccc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc019070 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd41a6ba0 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ccc00cb40 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc007610 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.982+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd41a70e0 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.983+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd41021c0 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.984+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ccc01c070 con 0x7f3cd4106f10 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.985+0000 7f3cd1ffb640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 0x7f3cc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:57.020 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.985+0000 7f3cd8eab640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 0x7f3cc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:57.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.985+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3ccc0cf7d0 con 0x7f3cd4106f10 2024-09-15T23:31:57.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.986+0000 7f3cd8eab640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 0x7f3cc40a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800abe0 tx=0x7f3cc800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:57.021 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:56.988+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f3ccc09c100 con 0x7f3cd4106f10 2024-09-15T23:31:57.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.190+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd410a0f0 con 0x7f3cd4106f10 2024-09-15T23:31:57.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.191+0000 7f3cd1ffb640 1 -- 172.21.15.77:0/3076399418 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f3ccc09ba00 con 0x7f3cd4106f10 2024-09-15T23:31:57.192 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:57.192 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:31:57.193 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 msgr2=0x7f3cc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 0x7f3cc40a5700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800abe0 tx=0x7f3cc800a5c0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 msgr2=0x7f3cd4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc00b970 tx=0x7f3ccc00be30 comp rx=0 tx=0).stop 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 shutdown_connections 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3cc40a3240 0x7f3cc40a5700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3cd4106f10 0x7f3cd4074f70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cd4102790 0x7f3cd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 --2- 172.21.15.77:0/3076399418 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3cd4101de0 0x7f3cd40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:57.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 >> 172.21.15.77:0/3076399418 conn(0x7f3cd40fd8c0 msgr2=0x7f3cd40fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:57.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 shutdown_connections 2024-09-15T23:31:57.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:57.194+0000 7f3cdb10f640 1 -- 172.21.15.77:0/3076399418 wait complete. 2024-09-15T23:31:57.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:57 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3076399418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:57.881 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:57 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3076399418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:57.911 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:31:57.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:57 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3076399418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:31:58.171 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:58.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 -- 172.21.15.77:0/1122749055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40101de0 msgr2=0x7f0b401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:58.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 --2- 172.21.15.77:0/1122749055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40101de0 0x7f0b401021c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009900 tx=0x7f0b3802a410 comp rx=0 tx=0).stop 2024-09-15T23:31:58.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 -- 172.21.15.77:0/1122749055 shutdown_connections 2024-09-15T23:31:58.669 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 --2- 172.21.15.77:0/1122749055 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40106f10 0x7f0b4010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 --2- 172.21.15.77:0/1122749055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40102790 0x7f0b401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 --2- 172.21.15.77:0/1122749055 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40101de0 0x7f0b401021c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 -- 172.21.15.77:0/1122749055 >> 172.21.15.77:0/1122749055 conn(0x7f0b400fd8c0 msgr2=0x7f0b400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 -- 172.21.15.77:0/1122749055 shutdown_connections 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.640+0000 7f0b47008640 1 -- 172.21.15.77:0/1122749055 wait complete. 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 Processor -- start 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 -- start start 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 0x7f0b40198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40102790 0x7f0b401989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40111f90 con 0x7f0b40106f10 2024-09-15T23:31:58.670 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40111e10 con 0x7f0b40101de0 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b47008640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b40112110 con 0x7f0b40102790 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b44da4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 0x7f0b40198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54556/0 (socket says 172.21.15.77:54556) 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b44da4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 0x7f0b40198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:42838/0 (socket says 172.21.15.77:42838) 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 -- 172.21.15.77:0/2535379580 learned_addr learned my addr 172.21.15.77:0/2535379580 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b3ffff640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40102790 0x7f0b401989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 -- 172.21.15.77:0/2535379580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40102790 msgr2=0x7f0b401989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40102790 0x7f0b401989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.641+0000 7f0b455a5640 1 -- 172.21.15.77:0/2535379580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 msgr2=0x7f0b40198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:58.671 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b455a5640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 0x7f0b40198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b455a5640 1 -- 172.21.15.77:0/2535379580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4019d440 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b455a5640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009fd0 tx=0x7f0b2800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b28011830 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b28016070 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4019d730 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b2800f2e0 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.642+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b401a5010 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.643+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b401021c0 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.644+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0b280119d0 con 0x7f0b40106f10 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.645+0000 7f0b3dffb640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:31:58.672 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.645+0000 7f0b44da4640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:31:58.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.645+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f0b280cf2c0 con 0x7f0b40106f10 2024-09-15T23:31:58.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.645+0000 7f0b44da4640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009230 tx=0x7f0b380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:31:58.673 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.649+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b2809bc50 con 0x7f0b40106f10 2024-09-15T23:31:58.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.817+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b4010a150 con 0x7f0b40106f10 2024-09-15T23:31:58.819 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:58 smithi077 ceph-mon[30968]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T23:31:58.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.819+0000 7f0b3dffb640 1 -- 172.21.15.77:0/2535379580 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7f0b2809b550 con 0x7f0b40106f10 2024-09-15T23:31:58.821 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:31:58.821 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 msgr2=0x7f0b2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0b38009230 tx=0x7f0b380058d0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 msgr2=0x7f0b4019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0b28009fd0 tx=0x7f0b2800b8e0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 shutdown_connections 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b2c0a3240 0x7f0b2c0a5700 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b40106f10 0x7f0b4019cd60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b40102790 0x7f0b401989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 --2- 172.21.15.77:0/2535379580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b40101de0 0x7f0b40198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:31:58.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 >> 172.21.15.77:0/2535379580 conn(0x7f0b400fd8c0 msgr2=0x7f0b400fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:31:58.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 shutdown_connections 2024-09-15T23:31:58.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:31:58.822+0000 7f0b47008640 1 -- 172.21.15.77:0/2535379580 wait complete. 2024-09-15T23:31:58.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:58 smithi155 ceph-mon[35631]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T23:31:58.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:58 smithi159 ceph-mon[35472]: pgmap v362: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 1 op/s 2024-09-15T23:31:59.453 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-15T23:31:59.701 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:31:59.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:31:59 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2535379580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:31:59.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:31:59 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2535379580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:32:00.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:31:59 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2535379580' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:32:00.877 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 -- 172.21.15.77:0/3597053510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28103710 msgr2=0x7fad28109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 --2- 172.21.15.77:0/3597053510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28103710 0x7fad28109fa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fad20009ca0 tx=0x7fad2002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 -- 172.21.15.77:0/3597053510 shutdown_connections 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 --2- 172.21.15.77:0/3597053510 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28103710 0x7fad28109fa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 --2- 172.21.15.77:0/3597053510 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28102d50 0x7fad281031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 --2- 172.21.15.77:0/3597053510 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 0x7fad28101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 -- 172.21.15.77:0/3597053510 >> 172.21.15.77:0/3597053510 conn(0x7fad280fd2e0 msgr2=0x7fad280ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 -- 172.21.15.77:0/3597053510 shutdown_connections 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.874+0000 7fad2e352640 1 -- 172.21.15.77:0/3597053510 wait complete. 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 Processor -- start 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 -- start start 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 0x7fad28197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.878 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28103710 0x7fad2819f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad2810d7e0 con 0x7fad28102d50 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad2810d660 con 0x7fad28103710 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad2e352640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad2810d960 con 0x7fad28101b60 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54572/0 (socket says 172.21.15.77:54572) 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad277fe640 1 -- 172.21.15.77:0/235169234 learned_addr learned my addr 172.21.15.77:0/235169234 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.875+0000 7fad27fff640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 0x7fad28197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28103710 0x7fad2819f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 -- 172.21.15.77:0/235169234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 msgr2=0x7fad28197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 0x7fad28197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 -- 172.21.15.77:0/235169234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28103710 msgr2=0x7fad2819f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28103710 0x7fad2819f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 -- 172.21.15.77:0/235169234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2819f9d0 con 0x7fad28102d50 2024-09-15T23:32:00.879 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad277fe640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00e9f0 tx=0x7fad1c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad257fa640 1 -- 172.21.15.77:0/235169234 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c00cd80 con 0x7fad28102d50 2024-09-15T23:32:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad257fa640 1 -- 172.21.15.77:0/235169234 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad1c010910 con 0x7fad28102d50 2024-09-15T23:32:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2819fcc0 con 0x7fad28102d50 2024-09-15T23:32:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad257fa640 1 -- 172.21.15.77:0/235169234 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c018990 con 0x7fad28102d50 2024-09-15T23:32:00.880 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.876+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad281a01c0 con 0x7fad28102d50 2024-09-15T23:32:00.880 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:00 smithi077 ceph-mon[30968]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T23:32:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.879+0000 7fad257fa640 1 -- 172.21.15.77:0/235169234 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fad1c010ac0 con 0x7fad28102d50 2024-09-15T23:32:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.879+0000 7fad311cc740 1 Processor -- start 2024-09-15T23:32:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.879+0000 7fad311cc740 1 -- start start 2024-09-15T23:32:00.883 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad257fa640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 0x7fad100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cfeb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55739cf4a2f0 con 0x55739cff0780 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55739cef2270 con 0x55739cfeb6f0 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad311cc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55739cf462b0 con 0x55739cfeadb0 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad257fa640 1 -- 172.21.15.77:0/235169234 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fad1c0d00a0 con 0x7fad28102d50 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 0x7fad100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54580/0 (socket says 172.21.15.77:54580) 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 -- 172.21.15.77:0/1699130779 learned_addr learned my addr 172.21.15.77:0/1699130779 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad27fff640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cfeb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.884 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad277fe640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 -- 172.21.15.77:0/1699130779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 msgr2=0x55739cfeb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cfeb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 -- 172.21.15.77:0/1699130779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 msgr2=0x55739cff01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 -- 172.21.15.77:0/1699130779 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739cef1340 con 0x55739cff0780 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad277fe640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.880+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 0x7fad100a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad20009ca0 tx=0x7fad20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.881+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad20005de0 tx=0x7fad20047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15520815a3d9ae3c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.881+0000 7fad0e7fc640 1 -- 172.21.15.77:0/1699130779 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2002f6d0 con 0x55739cff0780 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.881+0000 7fad0e7fc640 1 -- 172.21.15.77:0/1699130779 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20036040 con 0x55739cff0780 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.881+0000 7fad0e7fc640 1 -- 172.21.15.77:0/1699130779 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20030c30 con 0x55739cff0780 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- 172.21.15.77:0/1699130779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 msgr2=0x55739cff2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.885 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fad20005de0 tx=0x7fad20047000 comp rx=0 tx=0).stop 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- 172.21.15.77:0/1699130779 shutdown_connections 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cff2c40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 --2- 172.21.15.77:0/1699130779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cfeb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- 172.21.15.77:0/1699130779 >> 172.21.15.77:0/1699130779 conn(0x55739cfe2010 msgr2=0x55739cfe2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- 172.21.15.77:0/1699130779 shutdown_connections 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- 172.21.15.77:0/1699130779 wait complete. 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 -- start start 2024-09-15T23:32:00.886 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.882+0000 7fad311cc740 1 Processor -- start 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cff4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55739cff3570 con 0x55739cff0780 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55739ced3290 con 0x55739cfeb6f0 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55739cff36f0 con 0x55739cfeadb0 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad311cc740 10 client.0 _ll_register_callbacks cb 0x55739cf04140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:00.890 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54590/0 (socket says 172.21.15.77:54590) 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 -- 172.21.15.77:0/2446667395 learned_addr learned my addr 172.21.15.77:0/2446667395 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad27fff640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cff4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad277fe640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 -- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 msgr2=0x55739cff4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cff4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 -- 172.21.15.77:0/2446667395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 msgr2=0x55739cff53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 -- 172.21.15.77:0/2446667395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739cc5d210 con 0x55739cff0780 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad277fe640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad20009a60 tx=0x7fad20030b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e028233755a30af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.891 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.883+0000 7fad077fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2002f6d0 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fad2002f870 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad20036040 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fad20004b40 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 10 client.15288 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55739cd29620 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad20036040 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fad2004a070 con 0x55739cff0780 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 10 client.15288 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 10 client.15288 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 20 client.15288 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d000830 0x55739d002c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 4 client.15288 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:00.892 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.884+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55739cf57a20 con 0x55739d000830 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.885+0000 7fad27fff640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d000830 0x55739d002c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.885+0000 7fad27fff640 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d000830 0x55739d002c20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75667b4260b46964 server_cookie=4d5d10b37c740457 in_seq=0 out_seq=0 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.885+0000 7fad077fe640 10 client.15288 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad077fe640 1 -- 172.21.15.77:0/2446667395 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55739cf57a20 con 0x55739d000830 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad077fe640 10 client.15288 handle_command_reply: tid=0 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 client.15288 shutdown 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 msgr2=0x55739cffc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fad20009a60 tx=0x7fad20030b60 comp rx=0 tx=0).stop 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 shutdown_connections 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d000830 0x55739d002c20 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cff0780 0x55739cffc420 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.893 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad077fe640 0 client.15288 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 --2- 172.21.15.77:0/2446667395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cfeadb0 0x55739cff4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 >> 172.21.15.77:0/2446667395 conn(0x55739cfe2010 msgr2=0x55739cfe3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 shutdown_connections 2024-09-15T23:32:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 1 -- 172.21.15.77:0/2446667395 wait complete. 2024-09-15T23:32:00.894 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.886+0000 7fad311cc740 20 client.15288 trim_cache size 0 max 16384 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.900+0000 7fad311cc740 1 Processor -- start 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.900+0000 7fad311cc740 1 -- start start 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cffc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cfe3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a6520 con 0x55739cfeadb0 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a8da0 con 0x55739cfeb6f0 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad311cc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a6b90 con 0x55739cff0780 2024-09-15T23:32:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54598/0 (socket says 172.21.15.77:54598) 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 -- 172.21.15.77:0/2834686651 learned_addr learned my addr 172.21.15.77:0/2834686651 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad277fe640 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cffc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cfe3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 -- 172.21.15.77:0/2834686651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 msgr2=0x55739cfe3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cfe3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 -- 172.21.15.77:0/2834686651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 msgr2=0x55739cffc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cffc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 -- 172.21.15.77:0/2834686651 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739cfe1e30 con 0x55739cfeadb0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.901+0000 7fad27fff640 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fad28102bb0 tx=0x7fad18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bc456cbff4cad server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.902+0000 7fad0dffb640 1 -- 172.21.15.77:0/2834686651 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18004310 con 0x55739cfeadb0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.902+0000 7fad0dffb640 1 -- 172.21.15.77:0/2834686651 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad180044b0 con 0x55739cfeadb0 2024-09-15T23:32:00.904 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.902+0000 7fad0dffb640 1 -- 172.21.15.77:0/2834686651 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1801eb60 con 0x55739cfeadb0 2024-09-15T23:32:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- 172.21.15.77:0/2834686651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 msgr2=0x55739cfe2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fad28102bb0 tx=0x7fad18005f90 comp rx=0 tx=0).stop 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- 172.21.15.77:0/2834686651 shutdown_connections 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cfe3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cffc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 --2- 172.21.15.77:0/2834686651 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cfe2ec0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- 172.21.15.77:0/2834686651 >> 172.21.15.77:0/2834686651 conn(0x55739cfe2010 msgr2=0x55739cff4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- 172.21.15.77:0/2834686651 shutdown_connections 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- 172.21.15.77:0/2834686651 wait complete. 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 -- start start 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.903+0000 7fad311cc740 1 Processor -- start 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cffadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a7260 con 0x55739cfeadb0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a86d0 con 0x55739cfeb6f0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad281a7930 con 0x55739cff0780 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 10 client.0 _ll_register_callbacks cb 0x7fad1c009700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54612/0 (socket says 172.21.15.77:54612) 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 -- 172.21.15.77:0/2637954790 learned_addr learned my addr 172.21.15.77:0/2637954790 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad277fe640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad2c8ef640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cffadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 -- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 msgr2=0x55739cffadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cffadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 -- 172.21.15.77:0/2637954790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 msgr2=0x55739cff9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 -- 172.21.15.77:0/2637954790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739cffb3d0 con 0x55739cfeadb0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad277fe640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad27fff640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fad18009dd0 tx=0x7fad18009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c51e414d7636e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad077fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18004190 con 0x55739cfeadb0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fad1801e8e0 con 0x55739cfeadb0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad180044b0 con 0x55739cfeadb0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fad1801eae0 con 0x55739cfeadb0 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 10 client.15294 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.904+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55739cffc750 con 0x55739cfeadb0 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad180044b0 con 0x55739cfeadb0 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fad18004a00 con 0x55739cfeadb0 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 10 client.15294 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 10 client.15294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 20 client.15294 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d06bcd0 0x55739d06e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 4 client.15294 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55739cf51d70 con 0x55739d06bcd0 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad277fe640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d06bcd0 0x55739d06e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad077fe640 10 client.15294 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:00.913 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.905+0000 7fad277fe640 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d06bcd0 0x55739d06e0f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb4889282133577 server_cookie=17506be7647700fc in_seq=0 out_seq=0 2024-09-15T23:32:00.914 INFO:teuthology.orchestra.run.smithi077.stdout:{"run_dir":"/var/run/ceph"} 2024-09-15T23:32:00.914 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-15T23:32:00.915 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 3393 2024-09-15T23:32:00.915 DEBUG:tasks.quiescer:Yielding 2024-09-15T23:32:00.915 INFO:teuthology.run_tasks:Running task workunit... 2024-09-15T23:32:00.931 INFO:tasks.workunit:Pulling workunits from ref ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T23:32:00.932 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-15T23:32:00.932 INFO:tasks.workunit:timeout=3h 2024-09-15T23:32:00.932 INFO:tasks.workunit:cleanup=True 2024-09-15T23:32:00.932 DEBUG:teuthology.orchestra.run.smithi077:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-15T23:32:00.933 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:32:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad077fe640 1 -- 172.21.15.77:0/2637954790 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55739cf51d70 con 0x55739d06bcd0 2024-09-15T23:32:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad077fe640 10 client.15294 handle_command_reply: tid=0 2024-09-15T23:32:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 client.15294 shutdown 2024-09-15T23:32:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 msgr2=0x55739cff98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fad18009dd0 tx=0x7fad18009f30 comp rx=0 tx=0).stop 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 shutdown_connections 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55739d06bcd0 0x55739d06e0f0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55739cff0780 0x55739cffadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55739cfeb6f0 0x55739cff9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad077fe640 0 client.15294 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 --2- 172.21.15.77:0/2637954790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55739cfeadb0 0x55739cff98e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 >> 172.21.15.77:0/2637954790 conn(0x55739cfe2010 msgr2=0x55739cfe09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 shutdown_connections 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 1 -- 172.21.15.77:0/2637954790 wait complete. 2024-09-15T23:32:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.917+0000 7fad311cc740 20 client.15294 trim_cache size 0 max 16384 2024-09-15T23:32:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:32:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:32:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:32:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 msgr2=0x7fad100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 0x7fad100a57b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fad20009ca0 tx=0x7fad20005f90 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 msgr2=0x7fad281982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fad1c00e9f0 tx=0x7fad1c00eeb0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 shutdown_connections 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fad100a32f0 0x7fad100a57b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad28103710 0x7fad2819f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad28102d50 0x7fad281982f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 --2- 172.21.15.77:0/235169234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad28101b60 0x7fad28197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 >> 172.21.15.77:0/235169234 conn(0x7fad280fd2e0 msgr2=0x7fad28106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 shutdown_connections 2024-09-15T23:32:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:00.918+0000 7fad2e352640 1 -- 172.21.15.77:0/235169234 wait complete. 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-15 23:30:20.374216208 +0000 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-15 23:30:20.374216208 +0000 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-15 23:31:40.004817321 +0000 2024-09-15T23:32:00.953 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-15 23:30:20.374216208 +0000 2024-09-15T23:32:00.953 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-15T23:32:00.954 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-15T23:32:00.965 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:00 smithi159 ceph-mon[35472]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T23:32:01.022 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ad35db06e8924912f01e32b35576297c0f1352b4 2024-09-15T23:32:01.078 INFO:tasks.workunit.client.0.smithi077.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-15T23:32:01.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:00 smithi155 ceph-mon[35631]: pgmap v363: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2 op/s 2024-09-15T23:32:01.189 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 -- 172.21.15.77:0/2668656604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102570 msgr2=0x7f91e41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 --2- 172.21.15.77:0/2668656604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102570 0x7f91e41029b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009900 tx=0x7f91d402a480 comp rx=0 tx=0).stop 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 -- 172.21.15.77:0/2668656604 shutdown_connections 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 --2- 172.21.15.77:0/2668656604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102ef0 0x7f91e410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 --2- 172.21.15.77:0/2668656604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102570 0x7f91e41029b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 --2- 172.21.15.77:0/2668656604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4100e20 0x7f91e4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 -- 172.21.15.77:0/2668656604 >> 172.21.15.77:0/2668656604 conn(0x7f91e40fc7d0 msgr2=0x7f91e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 -- 172.21.15.77:0/2668656604 shutdown_connections 2024-09-15T23:32:01.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.668+0000 7f91ec74c640 1 -- 172.21.15.77:0/2668656604 wait complete. 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 Processor -- start 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 -- start start 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 0x7f91e4197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4102ef0 0x7f91e419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4110f80 con 0x7f91e4100e20 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4110e00 con 0x7f91e4102570 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ec74c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4111100 con 0x7f91e4102ef0 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54636/0 (socket says 172.21.15.77:54636) 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 -- 172.21.15.77:0/3253112786 learned_addr learned my addr 172.21.15.77:0/3253112786 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91e9ce7640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 0x7f91e4197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:01.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 -- 172.21.15.77:0/3253112786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4102ef0 msgr2=0x7f91e419bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4102ef0 0x7f91e419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 -- 172.21.15.77:0/3253112786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 msgr2=0x7f91e4197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 0x7f91e4197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91ea4e8640 1 -- 172.21.15.77:0/3253112786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e419c3d0 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.669+0000 7f91e9ce7640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 0x7f91e4197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91ea4e8640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f91e000e9f0 tx=0x7f91e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e000cd80 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e419c6c0 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91e0005500 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91e0010690 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.670+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41a3fa0 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.671+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4101200 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.672+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91e00046c0 con 0x7f91e4100e20 2024-09-15T23:32:01.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.673+0000 7f91db7fe640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 0x7f91d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:01.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.673+0000 7f91e9ce7640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 0x7f91d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:01.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.673+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f91e00d0450 con 0x7f91e4100e20 2024-09-15T23:32:01.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.674+0000 7f91e9ce7640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 0x7f91d00a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91d4000c00 tx=0x7f91d4004100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:01.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.676+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f91e00541b0 con 0x7f91e4100e20 2024-09-15T23:32:01.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.884+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91e4109090 con 0x7f91e4100e20 2024-09-15T23:32:01.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.887+0000 7f91db7fe640 1 -- 172.21.15.77:0/3253112786 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f91e001f340 con 0x7f91e4100e20 2024-09-15T23:32:01.889 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:32:01.889 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:32:01.889 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.889+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 msgr2=0x7f91d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.889+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 0x7f91d00a5700 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f91d4000c00 tx=0x7f91d4004100 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.889+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 msgr2=0x7f91e4197420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f91e000e9f0 tx=0x7f91e000edf0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 shutdown_connections 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91d00a3240 0x7f91d00a5700 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4102ef0 0x7f91e419bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102570 0x7f91e4197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 --2- 172.21.15.77:0/3253112786 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4100e20 0x7f91e4197420 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:01.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 >> 172.21.15.77:0/3253112786 conn(0x7f91e40fc7d0 msgr2=0x7f91e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:01.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 shutdown_connections 2024-09-15T23:32:01.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:01.890+0000 7f91ec74c640 1 -- 172.21.15.77:0/3253112786 wait complete. 2024-09-15T23:32:02.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-15T23:29:31.287245+0000', 'modified': '2024-09-15T23:30:13.582797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24460}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24455': {'gid': 24455, 'name': 'b', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6839/1912555419', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1912555419}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1912555419}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24460': {'gid': 24460, 'name': 'i', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.159:6839/2481115545', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6838', 'nonce': 2481115545}, {'type': 'v1', 'addr': '172.21.15.159:6839', 'nonce': 2481115545}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24460, 'qdb_cluster': [24460]} 2024-09-15T23:32:02.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T23:32:02.525 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-15T23:32:02.817 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:03.189 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:02 smithi077 ceph-mon[30968]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:32:03.190 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:02 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3253112786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:02 smithi159 ceph-mon[35472]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:32:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:02 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3253112786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:03.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.267+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1182551867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0102dd0 msgr2=0x7f1eb01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.267+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1182551867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0102dd0 0x7f1eb01031b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009cd0 tx=0x7f1ea002a8d0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.289 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1182551867 shutdown_connections 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1182551867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0108300 0x7f1eb010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1182551867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0103780 0x7f1eb0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1182551867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0102dd0 0x7f1eb01031b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1182551867 >> 172.21.15.77:0/1182551867 conn(0x7f1eb00fc7d0 msgr2=0x7f1eb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1182551867 shutdown_connections 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1182551867 wait complete. 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 Processor -- start 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- start start 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0102dd0 0x7f1eb0100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0108300 0x7f1eb01014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0112110 con 0x7f1eb0103780 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0111f90 con 0x7f1eb0102dd0 2024-09-15T23:32:03.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.268+0000 7f1eb73cd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0112290 con 0x7f1eb0108300 2024-09-15T23:32:03.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54646/0 (socket says 172.21.15.77:54646) 2024-09-15T23:32:03.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 -- 172.21.15.77:0/1452612025 learned_addr learned my addr 172.21.15.77:0/1452612025 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:03.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb5169640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0102dd0 0x7f1eb0100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb596a640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0108300 0x7f1eb01014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 -- 172.21.15.77:0/1452612025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0108300 msgr2=0x7f1eb01014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0108300 0x7f1eb01014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 -- 172.21.15.77:0/1452612025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0102dd0 msgr2=0x7f1eb0100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0102dd0 0x7f1eb0100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 -- 172.21.15.77:0/1452612025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb01a6a90 con 0x7f1eb0103780 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb4968640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c8c0 tx=0x7f1ea400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eae7fc640 1 -- 172.21.15.77:0/1452612025 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4007bb0 con 0x7f1eb0103780 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb01a6d80 con 0x7f1eb0103780 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eae7fc640 1 -- 172.21.15.77:0/1452612025 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea4007d50 con 0x7f1eb0103780 2024-09-15T23:32:03.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eae7fc640 1 -- 172.21.15.77:0/1452612025 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4018830 con 0x7f1eb0103780 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.269+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb01a7260 con 0x7f1eb0103780 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eae7fc640 1 -- 172.21.15.77:0/1452612025 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ea4018ad0 con 0x7f1eb0103780 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 Processor -- start 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 -- start start 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 0x561d2ec34db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec352f0 0x561d2ec3f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d2eb9b090 con 0x561d2ec3fbb0 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561d2eb42a70 con 0x561d2ec352f0 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561d2eb97050 con 0x561d2ec349d0 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54656/0 (socket says 172.21.15.77:54656) 2024-09-15T23:32:03.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb4968640 1 -- 172.21.15.77:0/2719866756 learned_addr learned my addr 172.21.15.77:0/2719866756 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.272+0000 7f1eb596a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 0x561d2ec34db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb5169640 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec352f0 0x561d2ec3f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eae7fc640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 0x7f1e980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 -- 172.21.15.77:0/2719866756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 msgr2=0x561d2ec34db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 0x561d2ec34db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 -- 172.21.15.77:0/2719866756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec352f0 msgr2=0x561d2ec3f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec352f0 0x561d2ec3f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 -- 172.21.15.77:0/2719866756 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2eb4f130 con 0x561d2ec3fbb0 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb596a640 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 0x561d2ec34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:03.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb596a640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 0x7f1e980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eae7fc640 1 -- 172.21.15.77:0/1452612025 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ea40cfd50 con 0x7f1eb0103780 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1eb4968640 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401c810 tx=0x7f1ea4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc986bb0832d4129 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1e977fe640 1 -- 172.21.15.77:0/2719866756 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea409b8e0 con 0x561d2ec3fbb0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1e977fe640 1 -- 172.21.15.77:0/2719866756 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea401c3c0 con 0x561d2ec3fbb0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.273+0000 7f1e977fe640 1 -- 172.21.15.77:0/2719866756 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea401c1c0 con 0x561d2ec3fbb0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- 172.21.15.77:0/2719866756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 msgr2=0x561d2ec41fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401c810 tx=0x7f1ea4020000 comp rx=0 tx=0).stop 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb596a640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 0x7f1e980a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009ca0 tx=0x7f1ea8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- 172.21.15.77:0/2719866756 shutdown_connections 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec41fa0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec352f0 0x561d2ec3f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/2719866756 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec349d0 0x561d2ec34db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- 172.21.15.77:0/2719866756 >> 172.21.15.77:0/2719866756 conn(0x561d2ec30f60 msgr2=0x561d2ec31340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- 172.21.15.77:0/2719866756 shutdown_connections 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- 172.21.15.77:0/2719866756 wait complete. 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 -- start start 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.274+0000 7f1eb97a6740 1 Processor -- start 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec3f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec3cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec42780 con 0x561d2ec352f0 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561d2eb55f20 con 0x561d2ec349d0 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec42900 con 0x561d2ec3fbb0 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb97a6740 10 client.0 _ll_register_callbacks cb 0x561d2eb1f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:03.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54666/0 (socket says 172.21.15.77:54666) 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 -- 172.21.15.77:0/4163727281 learned_addr learned my addr 172.21.15.77:0/4163727281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb5169640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec3f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb596a640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec3cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 -- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 msgr2=0x561d2ec3cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec3cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 -- 172.21.15.77:0/4163727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 msgr2=0x561d2ec3f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec3f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 -- 172.21.15.77:0/4163727281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2e90c2b0 con 0x561d2ec352f0 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb5169640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec3f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1eb4968640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401c390 tx=0x7f1ea40cffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3db501f17811e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.275+0000 7f1e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea407a070 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ea4018dc0 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea401c3c0 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ea401c1c0 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 10 client.15312 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561d2ec4df70 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea401c3c0 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ea40cd4e0 con 0x561d2ec352f0 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 10 client.15312 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:03.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 10 client.15312 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 20 client.15312 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ec50100 0x561d2ec51570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 4 client.15312 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.276+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561d2eba8600 con 0x561d2ec50100 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.277+0000 7f1eb5169640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ec50100 0x561d2ec51570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.277+0000 7f1e94ff9640 10 client.15312 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.277+0000 7f1eb5169640 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ec50100 0x561d2ec51570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4de1d19d121d71 server_cookie=80211d07fb6f89a3 in_seq=0 out_seq=0 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1e94ff9640 1 -- 172.21.15.77:0/4163727281 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561d2eba8600 con 0x561d2ec50100 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1e94ff9640 10 client.15312 handle_command_reply: tid=0 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 client.15312 shutdown 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 msgr2=0x561d2ec3c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401c390 tx=0x7f1ea40cffd0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 shutdown_connections 2024-09-15T23:32:03.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ec50100 0x561d2ec51570 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec3cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec3c690 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/4163727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec3f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1e94ff9640 0 client.15312 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 >> 172.21.15.77:0/4163727281 conn(0x561d2ec30f60 msgr2=0x561d2ec36c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 shutdown_connections 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 1 -- 172.21.15.77:0/4163727281 wait complete. 2024-09-15T23:32:03.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.278+0000 7f1eb97a6740 20 client.15312 trim_cache size 0 max 16384 2024-09-15T23:32:03.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 Processor -- start 2024-09-15T23:32:03.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 -- start start 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec51570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 0x561d2ec4fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec4f8b0 con 0x561d2ec3fbb0 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec4ff80 con 0x561d2ec349d0 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec50650 con 0x561d2ec352f0 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54682/0 (socket says 172.21.15.77:54682) 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 -- 172.21.15.77:0/951004506 learned_addr learned my addr 172.21.15.77:0/951004506 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb4968640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 0x561d2ec4fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 -- 172.21.15.77:0/951004506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 msgr2=0x561d2ec4fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 0x561d2ec4fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.306 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 -- 172.21.15.77:0/951004506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 msgr2=0x561d2ec51570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb5169640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec51570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec51570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 -- 172.21.15.77:0/951004506 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561d2ec35120 con 0x561d2ec3fbb0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb4968640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 0x561d2ec4fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.296+0000 7f1eb596a640 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80096b0 tx=0x7f1ea8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2433e6a286067ae8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1e96ffd640 1 -- 172.21.15.77:0/951004506 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8026070 con 0x561d2ec3fbb0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1e96ffd640 1 -- 172.21.15.77:0/951004506 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea8022900 con 0x561d2ec3fbb0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1e96ffd640 1 -- 172.21.15.77:0/951004506 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8021820 con 0x561d2ec3fbb0 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 -- 172.21.15.77:0/951004506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 msgr2=0x561d2ec37de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80096b0 tx=0x7f1ea8015000 comp rx=0 tx=0).stop 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 -- 172.21.15.77:0/951004506 shutdown_connections 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec3fbb0 0x561d2ec37de0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec352f0 0x561d2ec4fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.307 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/951004506 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec51570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 -- 172.21.15.77:0/951004506 >> 172.21.15.77:0/951004506 conn(0x561d2ec30f60 msgr2=0x561d2ec2bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 -- 172.21.15.77:0/951004506 shutdown_connections 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.297+0000 7f1eb97a6740 1 -- 172.21.15.77:0/951004506 wait complete. 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 -- start start 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 Processor -- start 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec59e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec39960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec513f0 con 0x561d2ec352f0 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec50d20 con 0x561d2ec349d0 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x561d2ec51ac0 con 0x561d2ec3fbb0 2024-09-15T23:32:03.308 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb97a6740 10 client.0 _ll_register_callbacks cb 0x7f1ea0005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb4968640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54684/0 (socket says 172.21.15.77:54684) 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb4968640 1 -- 172.21.15.77:0/3407162994 learned_addr learned my addr 172.21.15.77:0/3407162994 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb5169640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec59e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb596a640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec39960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.298+0000 7f1eb4968640 1 -- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 msgr2=0x561d2ec39960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb4968640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec39960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb4968640 1 -- 172.21.15.77:0/3407162994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 msgr2=0x561d2ec59e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb4968640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec59e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.309 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb4968640 1 -- 172.21.15.77:0/3407162994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561d2ec3a0a0 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb5169640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec59e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb4968640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4098900 tx=0x7f1ea400fb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c099a768cd1833c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea407a040 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ea401c3c0 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea8022900 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ea409bac0 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 10 client.15318 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x561d2ecba810 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ea8022900 con 0x561d2ec352f0 2024-09-15T23:32:03.310 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ea40a4760 con 0x561d2ec352f0 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 10 client.15318 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 10 client.15318 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 20 client.15318 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ecbf060 0x561d2ecbdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 4 client.15318 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.299+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "status"}) -- 0x561d2eba2b10 con 0x561d2ecbf060 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb5169640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ecbf060 0x561d2ecbdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1e94ff9640 10 client.15318 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb5169640 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ecbf060 0x561d2ecbdd70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b7564be2282eec server_cookie=df42b4722ba23619 in_seq=0 out_seq=0 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1e94ff9640 1 -- 172.21.15.77:0/3407162994 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x561d2eba2b10 con 0x561d2ecbf060 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1e94ff9640 10 client.15318 handle_command_reply: tid=0 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 client.15318 shutdown 2024-09-15T23:32:03.311 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 msgr2=0x561d2ec39420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1ea4098900 tx=0x7f1ea400fb50 comp rx=0 tx=0).stop 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 shutdown_connections 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x561d2ecbf060 0x561d2ecbdd70 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.300+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x561d2ec3fbb0 0x561d2ec39960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1e94ff9640 0 client.15318 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x561d2ec352f0 0x561d2ec39420 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 1 --2- 172.21.15.77:0/3407162994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561d2ec349d0 0x561d2ec59e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 >> 172.21.15.77:0/3407162994 conn(0x561d2ec30f60 msgr2=0x561d2ec36420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.312 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 shutdown_connections 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 1 -- 172.21.15.77:0/3407162994 wait complete. 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb97a6740 20 client.15318 trim_cache size 0 max 16384 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "cluster_fsid": "1be60238-73b9-11ef-bceb-c7b262605968", 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "whoami": 0, 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "id": 24460, 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "want_state": "up:active", 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "state": "up:active", 2024-09-15T23:32:03.313 INFO:teuthology.orchestra.run.smithi077.stdout: "fs_name": "cephfs", 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout: "rank_uptime": 151.60590116399999, 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout: "mdsmap_epoch": 21, 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch": 91, 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout: "osdmap_epoch_barrier": 89, 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout: "uptime": 171.36247017400001 2024-09-15T23:32:03.314 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 msgr2=0x7f1e980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 0x7f1e980a5700 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8009ca0 tx=0x7f1ea8008040 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 msgr2=0x7f1eb0100f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400c8c0 tx=0x7f1ea400cd80 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 shutdown_connections 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1e980a3240 0x7f1e980a5700 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1eb0108300 0x7f1eb01014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1eb0103780 0x7f1eb0100f70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 --2- 172.21.15.77:0/1452612025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1eb0102dd0 0x7f1eb0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 >> 172.21.15.77:0/1452612025 conn(0x7f1eb00fc7d0 msgr2=0x7f1eb01063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 shutdown_connections 2024-09-15T23:32:03.315 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:03.301+0000 7f1eb73cd640 1 -- 172.21.15.77:0/1452612025 wait complete. 2024-09-15T23:32:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:02 smithi155 ceph-mon[35631]: pgmap v364: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:32:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:02 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3253112786' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:04.040 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-15T23:32:05.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:04 smithi159 ceph-mon[35472]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:32:05.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:04 smithi155 ceph-mon[35631]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:32:05.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:04 smithi077 ceph-mon[30968]: pgmap v365: 129 pgs: 129 active+clean; 646 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:32:07.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:06 smithi159 ceph-mon[35472]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-15T23:32:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:06 smithi155 ceph-mon[35631]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-15T23:32:07.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:06 smithi077 ceph-mon[30968]: pgmap v366: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.8 KiB/s wr, 6 op/s 2024-09-15T23:32:09.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:08 smithi159 ceph-mon[35472]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:09.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:08 smithi155 ceph-mon[35631]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:09.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:08 smithi077 ceph-mon[30968]: pgmap v367: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:10 smithi159 ceph-mon[35472]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-15T23:32:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:10 smithi155 ceph-mon[35631]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-15T23:32:11.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:10 smithi077 ceph-mon[30968]: pgmap v368: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-15T23:32:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:12 smithi159 ceph-mon[35472]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:12 smithi155 ceph-mon[35631]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:13.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:12 smithi077 ceph-mon[30968]: pgmap v369: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 -- 172.21.15.77:0/2121796686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454101b60 msgr2=0x7fc454101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2121796686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454101b60 0x7fc454101f60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc444009900 tx=0x7fc44402a410 comp rx=0 tx=0).stop 2024-09-15T23:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 -- 172.21.15.77:0/2121796686 shutdown_connections 2024-09-15T23:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2121796686 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454103710 0x7fc454109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2121796686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454102d50 0x7fc4541031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2121796686 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454101b60 0x7fc454101f60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.014+0000 7fc458b4b640 1 -- 172.21.15.77:0/2121796686 >> 172.21.15.77:0/2121796686 conn(0x7fc4540fd2e0 msgr2=0x7fc4540ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.015+0000 7fc458b4b640 1 -- 172.21.15.77:0/2121796686 shutdown_connections 2024-09-15T23:32:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.015+0000 7fc458b4b640 1 -- 172.21.15.77:0/2121796686 wait complete. 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.015+0000 7fc458b4b640 1 Processor -- start 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.015+0000 7fc458b4b640 1 -- start start 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454101b60 0x7fc454197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454102d50 0x7fc454198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc45410d7e0 con 0x7fc454103710 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc45410d660 con 0x7fc454101b60 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc45410d960 con 0x7fc454102d50 2024-09-15T23:32:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53558/0 (socket says 172.21.15.77:53558) 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 -- 172.21.15.77:0/2150340931 learned_addr learned my addr 172.21.15.77:0/2150340931 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc451d9b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454102d50 0x7fc454198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc45259c640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454101b60 0x7fc454197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 -- 172.21.15.77:0/2150340931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454102d50 msgr2=0x7fc454198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454102d50 0x7fc454198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 -- 172.21.15.77:0/2150340931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454101b60 msgr2=0x7fc454197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454101b60 0x7fc454197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 -- 172.21.15.77:0/2150340931 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45419fa30 con 0x7fc454103710 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc452d9d640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00cad0 tx=0x7fc44c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc4437fe640 1 -- 172.21.15.77:0/2150340931 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00ae20 con 0x7fc454103710 2024-09-15T23:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45419fd20 con 0x7fc454103710 2024-09-15T23:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc4437fe640 1 -- 172.21.15.77:0/2150340931 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc44c005020 con 0x7fc454103710 2024-09-15T23:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.016+0000 7fc4437fe640 1 -- 172.21.15.77:0/2150340931 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00f6b0 con 0x7fc454103710 2024-09-15T23:32:14.021 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.017+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4541a0210 con 0x7fc454103710 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 Processor -- start 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc4437fe640 1 -- 172.21.15.77:0/2150340931 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc44c0051d0 con 0x7fc454103710 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 -- start start 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bd11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6bd8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6b302f0 con 0x55a5a6bd16f0 2024-09-15T23:32:14.028 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6ad8270 con 0x55a5a6bd6780 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.019+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6b2c2b0 con 0x55a5a6bd0db0 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc451d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bd11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53574/0 (socket says 172.21.15.77:53574) 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 -- 172.21.15.77:0/1460571387 learned_addr learned my addr 172.21.15.77:0/1460571387 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc4437fe640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 0x7fc43c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc451d9b640 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6bd8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 -- 172.21.15.77:0/1460571387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 msgr2=0x55a5a6bd11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bd11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 -- 172.21.15.77:0/1460571387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 msgr2=0x55a5a6bd8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6bd8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 -- 172.21.15.77:0/1460571387 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5a6ad7340 con 0x55a5a6bd16f0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc4437fe640 1 -- 172.21.15.77:0/2150340931 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fc44c0cff80 con 0x7fc454103710 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc452d9d640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 0x7fc43c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc45259c640 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc444031440 tx=0x7fc444032d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1af419d6b439f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc452d9d640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 0x7fc43c0a57b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc44c098be0 tx=0x7fc44c000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc440ff9640 1 -- 172.21.15.77:0/1460571387 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44403f070 con 0x55a5a6bd16f0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc440ff9640 1 -- 172.21.15.77:0/1460571387 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4440318b0 con 0x55a5a6bd16f0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.020+0000 7fc440ff9640 1 -- 172.21.15.77:0/1460571387 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444035070 con 0x55a5a6bd16f0 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 -- 172.21.15.77:0/1460571387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 msgr2=0x55a5a6bd61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc444031440 tx=0x7fc444032d60 comp rx=0 tx=0).stop 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 -- 172.21.15.77:0/1460571387 shutdown_connections 2024-09-15T23:32:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6bd8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bd61b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/1460571387 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bd11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 -- 172.21.15.77:0/1460571387 >> 172.21.15.77:0/1460571387 conn(0x55a5a6bc8010 msgr2=0x55a5a6bc8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 -- 172.21.15.77:0/1460571387 shutdown_connections 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.021+0000 7fc45b9c7740 1 -- 172.21.15.77:0/1460571387 wait complete. 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 -- start start 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 Processor -- start 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6bd96f0 con 0x55a5a6bd6780 2024-09-15T23:32:14.031 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6ab9290 con 0x55a5a6bd16f0 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a5a6bd9870 con 0x55a5a6bd0db0 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45b9c7740 10 client.0 _ll_register_callbacks cb 0x55a5a6aea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53576/0 (socket says 172.21.15.77:53576) 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 -- 172.21.15.77:0/4095097436 learned_addr learned my addr 172.21.15.77:0/4095097436 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc45259c640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 -- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 msgr2=0x55a5a6bdaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 -- 172.21.15.77:0/4095097436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 msgr2=0x55a5a6bdb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 -- 172.21.15.77:0/4095097436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5a6843210 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc448005fd0 tx=0x7fc448012f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edc8b66f716390c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.022+0000 7fc439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448011c30 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fc448011dd0 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4440318b0 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc448004020 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 10 client.15330 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a5a690f620 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4440318b0 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc4480047a0 con 0x55a5a6bd6780 2024-09-15T23:32:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 10 client.15330 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 10 client.15330 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 20 client.15330 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6be6bb0 0x55a5a6be9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 4 client.15330 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5a6b3da20 con 0x55a5a6be6bb0 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.023+0000 7fc45259c640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6be6bb0 0x55a5a6be9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.024+0000 7fc439ffb640 10 client.15330 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.024+0000 7fc45259c640 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6be6bb0 0x55a5a6be9020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff85e54c610e45da server_cookie=4eb2b8aa3429b676 in_seq=0 out_seq=0 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc439ffb640 1 -- 172.21.15.77:0/4095097436 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a5a6b3da20 con 0x55a5a6be6bb0 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc439ffb640 10 client.15330 handle_command_reply: tid=0 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 client.15330 shutdown 2024-09-15T23:32:14.034 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 msgr2=0x55a5a6be24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc448005fd0 tx=0x7fc448012f20 comp rx=0 tx=0).stop 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 shutdown_connections 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6be6bb0 0x55a5a6be9020 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6be24d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc439ffb640 0 client.15330 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4095097436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 >> 172.21.15.77:0/4095097436 conn(0x55a5a6bc8010 msgr2=0x55a5a6bc9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 shutdown_connections 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4095097436 wait complete. 2024-09-15T23:32:14.035 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.025+0000 7fc45b9c7740 20 client.15330 trim_cache size 0 max 16384 2024-09-15T23:32:14.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.039+0000 7fc45b9c7740 1 Processor -- start 2024-09-15T23:32:14.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.039+0000 7fc45b9c7740 1 -- start start 2024-09-15T23:32:14.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bc8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6be2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.045 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a6550 con 0x55a5a6bd6780 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a8dd0 con 0x55a5a6bd16f0 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a6bc0 con 0x55a5a6bd0db0 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53588/0 (socket says 172.21.15.77:53588) 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 -- 172.21.15.77:0/2753113767 learned_addr learned my addr 172.21.15.77:0/2753113767 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 -- 172.21.15.77:0/2753113767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 msgr2=0x55a5a6bc8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bc8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 -- 172.21.15.77:0/2753113767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 msgr2=0x55a5a6be2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6be2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 -- 172.21.15.77:0/2753113767 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5a6bd1bd0 con 0x55a5a6bd6780 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc451d9b640 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc448001eb0 tx=0x7fc44800b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a47b5164a7c4d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.046 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc43bfff640 1 -- 172.21.15.77:0/2753113767 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448005850 con 0x55a5a6bd6780 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc43bfff640 1 -- 172.21.15.77:0/2753113767 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4480125c0 con 0x55a5a6bd6780 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.040+0000 7fc43bfff640 1 -- 172.21.15.77:0/2753113767 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448003e00 con 0x55a5a6bd6780 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- 172.21.15.77:0/2753113767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 msgr2=0x55a5a6bc9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fc448001eb0 tx=0x7fc44800b710 comp rx=0 tx=0).stop 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- 172.21.15.77:0/2753113767 shutdown_connections 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd6780 0x55a5a6bc9400 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd16f0 0x55a5a6be2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/2753113767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bc8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- 172.21.15.77:0/2753113767 >> 172.21.15.77:0/2753113767 conn(0x55a5a6bc8010 msgr2=0x55a5a6be2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- 172.21.15.77:0/2753113767 shutdown_connections 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- 172.21.15.77:0/2753113767 wait complete. 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- start start 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 Processor -- start 2024-09-15T23:32:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6be0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a7290 con 0x55a5a6bd16f0 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a8700 con 0x55a5a6bd6780 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc4541a7960 con 0x55a5a6bd0db0 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.041+0000 7fc45b9c7740 10 client.0 _ll_register_callbacks cb 0x7fc44800bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:53596/0 (socket says 172.21.15.77:53596) 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 -- 172.21.15.77:0/4002762384 learned_addr learned my addr 172.21.15.77:0/4002762384 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 -- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 msgr2=0x55a5a6bdf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdf7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.048 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 -- 172.21.15.77:0/4002762384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 msgr2=0x55a5a6be0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6be0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 -- 172.21.15.77:0/4002762384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5a6be1330 con 0x55a5a6bd16f0 2024-09-15T23:32:14.049 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45259c640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc444031440 tx=0x7fc444005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c1f538ca90dbb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc439ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc444051060 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fc444004240 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4480125c0 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fc444058050 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45b9c7740 10 client.15336 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.042+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a5a6be2740 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4480125c0 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fc44404c400 con 0x55a5a6bd16f0 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 10 client.15336 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 10 client.15336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 20 client.15336 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6c51bf0 0x55a5a6c54010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 4 client.15336 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a5a6b37d70 con 0x55a5a6c51bf0 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.043+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6c51bf0 0x55a5a6c54010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:14.051 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.044+0000 7fc439ffb640 10 client.15336 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.044+0000 7fc451d9b640 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6c51bf0 0x55a5a6c54010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4dba9c92f64fe0c server_cookie=b04b0490d90846f0 in_seq=0 out_seq=0 2024-09-15T23:32:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc439ffb640 1 -- 172.21.15.77:0/4002762384 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a5a6b37d70 con 0x55a5a6c51bf0 2024-09-15T23:32:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc439ffb640 10 client.15336 handle_command_reply: tid=0 2024-09-15T23:32:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 client.15336 shutdown 2024-09-15T23:32:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 msgr2=0x55a5a6bdfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fc444031440 tx=0x7fc444005760 comp rx=0 tx=0).stop 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 shutdown_connections 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a5a6c51bf0 0x55a5a6c54010 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a5a6bd6780 0x55a5a6be0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a5a6bd16f0 0x55a5a6bdfd10 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 --2- 172.21.15.77:0/4002762384 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a5a6bd0db0 0x55a5a6bdf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc439ffb640 0 client.15336 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 >> 172.21.15.77:0/4002762384 conn(0x55a5a6bc8010 msgr2=0x55a5a6bc69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 shutdown_connections 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 1 -- 172.21.15.77:0/4002762384 wait complete. 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.051+0000 7fc45b9c7740 20 client.15336 trim_cache size 0 max 16384 2024-09-15T23:32:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:32:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:32:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:32:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 msgr2=0x7fc43c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 0x7fc43c0a57b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc44c098be0 tx=0x7fc44c000f40 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 msgr2=0x7fc45419f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00cad0 tx=0x7fc44c00cf90 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 shutdown_connections 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc43c0a32f0 0x7fc43c0a57b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc454103710 0x7fc45419f3c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc454102d50 0x7fc454198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 --2- 172.21.15.77:0/2150340931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc454101b60 0x7fc454197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 >> 172.21.15.77:0/2150340931 conn(0x7fc4540fd2e0 msgr2=0x7fc4541060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 shutdown_connections 2024-09-15T23:32:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:14.052+0000 7fc458b4b640 1 -- 172.21.15.77:0/2150340931 wait complete. 2024-09-15T23:32:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:14 smithi159 ceph-mon[35472]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:14 smithi155 ceph-mon[35631]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:15.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:14 smithi077 ceph-mon[30968]: pgmap v370: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-09-15T23:32:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:16 smithi159 ceph-mon[35472]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T23:32:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:16 smithi155 ceph-mon[35631]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T23:32:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:16 smithi077 ceph-mon[30968]: pgmap v371: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-09-15T23:32:19.040 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.2 2024-09-15T23:32:19.041 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:32:19.166 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:18 smithi155 ceph-mon[35631]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:18 smithi159 ceph-mon[35472]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:19.297 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:19.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:18 smithi077 ceph-mon[30968]: pgmap v372: 129 pgs: 129 active+clean; 652 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/3263600081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 msgr2=0x7fcde410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/3263600081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde410eaa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ca0 tx=0x7fcddc02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/3263600081 shutdown_connections 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/3263600081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde410eaa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/3263600081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 0x7fcde41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/3263600081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 0x7fcde41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.917+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/3263600081 >> 172.21.15.77:0/3263600081 conn(0x7fcde40fd8f0 msgr2=0x7fcde40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:19.926 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/3263600081 shutdown_connections 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/3263600081 wait complete. 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 Processor -- start 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 -- start start 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 0x7fcde40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.918+0000 7fcdeb6f3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 0x7fcde4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdeb6f3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdeb6f3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4111f80 con 0x7fcde4106f20 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdeb6f3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4111e00 con 0x7fcde41027a0 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdeb6f3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcde4112100 con 0x7fcde4101df0 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60134/0 (socket says 172.21.15.77:60134) 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 -- 172.21.15.77:0/1353035780 learned_addr learned my addr 172.21.15.77:0/1353035780 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:19.927 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde8c8e640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 0x7fcde4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde948f640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 0x7fcde40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 -- 172.21.15.77:0/1353035780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 msgr2=0x7fcde40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 0x7fcde40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 -- 172.21.15.77:0/1353035780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 msgr2=0x7fcde4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 0x7fcde4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 -- 172.21.15.77:0/1353035780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde41a68a0 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcde9c90640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcddc031a20 tx=0x7fcddc031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc003c30 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.919+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcddc003dd0 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.920+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde41a6b30 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.920+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc02fcf0 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.920+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde41a70c0 con 0x7fcde4106f20 2024-09-15T23:32:19.928 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.921+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde41021d0 con 0x7fcde4106f20 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.922+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcddc004b40 con 0x7fcde4106f20 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.923+0000 7fcdda7fc640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 0x7fcdd00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.923+0000 7fcde948f640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 0x7fcdd00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.923+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fcddc0f1070 con 0x7fcde4106f20 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.924+0000 7fcde948f640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 0x7fcdd00a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcde0005fd0 tx=0x7fcde000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:19.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:19.927+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcddc0bda30 con 0x7fcde4106f20 2024-09-15T23:32:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.139+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcde4075a20 con 0x7fcde4106f20 2024-09-15T23:32:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.140+0000 7fcdda7fc640 1 -- 172.21.15.77:0/1353035780 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7fcde4075a20 con 0x7fcde4106f20 2024-09-15T23:32:20.141 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:32:20.141 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:32:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:32:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 msgr2=0x7fcdd00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 0x7fcdd00a5780 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcde0005fd0 tx=0x7fcde000b390 comp rx=0 tx=0).stop 2024-09-15T23:32:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 msgr2=0x7fcde4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fcddc031a20 tx=0x7fcddc031a50 comp rx=0 tx=0).stop 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 shutdown_connections 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcdd00a32c0 0x7fcdd00a5780 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcde4106f20 0x7fcde4074f70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcde41027a0 0x7fcde4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 --2- 172.21.15.77:0/1353035780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcde4101df0 0x7fcde40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 >> 172.21.15.77:0/1353035780 conn(0x7fcde40fd8f0 msgr2=0x7fcde40fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 shutdown_connections 2024-09-15T23:32:20.144 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:20.142+0000 7fcdeb6f3640 1 -- 172.21.15.77:0/1353035780 wait complete. 2024-09-15T23:32:20.925 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0' 2024-09-15T23:32:20.925 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db / --timeout 90 --expiration 150.2 --await-for 45.0 2024-09-15T23:32:21.195 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:20 smithi159 ceph-mon[35472]: pgmap v373: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-15T23:32:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:20 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1353035780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:21.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:20 smithi077 ceph-mon[30968]: pgmap v373: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-15T23:32:21.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:20 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1353035780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:20 smithi155 ceph-mon[35631]: pgmap v373: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 938 B/s wr, 4 op/s 2024-09-15T23:32:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:20 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1353035780' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:21.647 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:32:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 -- 172.21.15.77:0/490690633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06581036f0 msgr2=0x7f065810bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 --2- 172.21.15.77:0/490690633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06581036f0 0x7f065810bbe0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0648009900 tx=0x7f064802a480 comp rx=0 tx=0).stop 2024-09-15T23:32:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 -- 172.21.15.77:0/490690633 shutdown_connections 2024-09-15T23:32:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 --2- 172.21.15.77:0/490690633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f065810c1b0 0x7f065810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.705 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 --2- 172.21.15.77:0/490690633 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f06581036f0 0x7f065810bbe0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 --2- 172.21.15.77:0/490690633 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 -- 172.21.15.77:0/490690633 >> 172.21.15.77:0/490690633 conn(0x7f06580fc7d0 msgr2=0x7f06580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 -- 172.21.15.77:0/490690633 shutdown_connections 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.688+0000 7f065f3c1640 1 -- 172.21.15.77:0/490690633 wait complete. 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 Processor -- start 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 -- start start 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06581036f0 0x7f0658198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111fd0 con 0x7f065810c1b0 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111e50 con 0x7f06581036f0 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.689+0000 7f065f3c1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0658112150 con 0x7f0658102dd0 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.706 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d15d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065c95c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06581036f0 0x7f0658198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60156/0 (socket says 172.21.15.77:60156) 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d15d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:35950/0 (socket says 172.21.15.77:35950) 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 -- 172.21.15.77:0/194228051 learned_addr learned my addr 172.21.15.77:0/194228051 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 -- 172.21.15.77:0/194228051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 msgr2=0x7f06581984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 -- 172.21.15.77:0/194228051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06581036f0 msgr2=0x7f0658198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06581036f0 0x7f0658198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 -- 172.21.15.77:0/194228051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065819d4a0 con 0x7f065810c1b0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f065d95e640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0650010ea0 tx=0x7f0650010f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.690+0000 7f064e7fc640 1 -- 172.21.15.77:0/194228051 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0650004b20 con 0x7f065810c1b0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.691+0000 7f064e7fc640 1 -- 172.21.15.77:0/194228051 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0650004cc0 con 0x7f065810c1b0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.691+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065819d790 con 0x7f065810c1b0 2024-09-15T23:32:21.707 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.691+0000 7f064e7fc640 1 -- 172.21.15.77:0/194228051 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06500197d0 con 0x7f065810c1b0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.691+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0658100960 con 0x7f065810c1b0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.693+0000 7f064e7fc640 1 -- 172.21.15.77:0/194228051 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0650005020 con 0x7f065810c1b0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.694+0000 7f064e7fc640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 0x7f06440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.694+0000 7f065d15d640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 0x7f06440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.694+0000 7f064e7fc640 1 -- 172.21.15.77:0/194228051 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f06500d3970 con 0x7f065810c1b0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.694+0000 7f066179a740 1 Processor -- start 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.694+0000 7f066179a740 1 -- start start 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065d15d640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 0x7f06440a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0654005d00 tx=0x7f065400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2e9fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2eacd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5623a2e052a0 con 0x5623a2ea0080 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5623a2dacb10 con 0x5623a2eaa940 2024-09-15T23:32:21.708 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f066179a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5623a2e01260 con 0x5623a2e9f760 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60164/0 (socket says 172.21.15.77:60164) 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 -- 172.21.15.77:0/2511214172 learned_addr learned my addr 172.21.15.77:0/2511214172 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065d15d640 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2e9fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065d95e640 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2eacd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 -- 172.21.15.77:0/2511214172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 msgr2=0x5623a2e9fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2e9fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 -- 172.21.15.77:0/2511214172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 msgr2=0x5623a2eacd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2eacd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 -- 172.21.15.77:0/2511214172 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623a2b76b90 con 0x5623a2ea0080 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.695+0000 7f065c95c640 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0648009900 tx=0x7f0648005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a9fa0048114104 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.696+0000 7f06437fe640 1 -- 172.21.15.77:0/2511214172 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648035030 con 0x5623a2ea0080 2024-09-15T23:32:21.709 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.696+0000 7f06437fe640 1 -- 172.21.15.77:0/2511214172 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06480043c0 con 0x5623a2ea0080 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.696+0000 7f06437fe640 1 -- 172.21.15.77:0/2511214172 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0648004dc0 con 0x5623a2ea0080 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.696+0000 7f066179a740 1 -- 172.21.15.77:0/2511214172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 msgr2=0x5623a2eaa400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.696+0000 7f066179a740 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0648009900 tx=0x7f0648005e60 comp rx=0 tx=0).stop 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 -- 172.21.15.77:0/2511214172 shutdown_connections 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2eacd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2eaa400 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 --2- 172.21.15.77:0/2511214172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2e9fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 -- 172.21.15.77:0/2511214172 >> 172.21.15.77:0/2511214172 conn(0x5623a2e9bcf0 msgr2=0x5623a2e9c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 -- 172.21.15.77:0/2511214172 shutdown_connections 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 -- 172.21.15.77:0/2511214172 wait complete. 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 -- start start 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.697+0000 7f066179a740 1 Processor -- start 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ea7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2ea82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5623a2ead510 con 0x5623a2ea0080 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5623a2d8d6e0 con 0x5623a2eaa940 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5623a2ead690 con 0x5623a2e9f760 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f066179a740 10 client.0 _ll_register_callbacks cb 0x5623a2db1a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065c95c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065c95c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60168/0 (socket says 172.21.15.77:60168) 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ea7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065c95c640 1 -- 172.21.15.77:0/527328219 learned_addr learned my addr 172.21.15.77:0/527328219 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d95e640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2ea82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 -- 172.21.15.77:0/527328219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 msgr2=0x5623a2ea82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2ea82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 -- 172.21.15.77:0/527328219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 msgr2=0x5623a2ea7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 -- 172.21.15.77:0/527328219 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623a2eb6a30 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065c95c640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f065d15d640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ea7850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0654011740 tx=0x7f0654004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31f7ad8f2f690ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.698+0000 7f0640ff9640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065401fa80 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06480043c0 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f065401fc20 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f065401fe60 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 10 client.24919 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5623a2eb9420 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06480043c0 con 0x5623a2e9f760 2024-09-15T23:32:21.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0654026070 con 0x5623a2e9f760 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 10 client.24919 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 10 client.24919 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 20 client.24919 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2eba930 0x5623a2ebcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 4 client.24919 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.699+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5623a2e129d0 con 0x5623a2eba930 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.700+0000 7f065c95c640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2eba930 0x5623a2ebcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.700+0000 7f0640ff9640 10 client.24919 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.700+0000 7f065c95c640 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2eba930 0x5623a2ebcd80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85b1b43e949c6a3f server_cookie=c2633b0777e73e8d in_seq=0 out_seq=0 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f0640ff9640 1 -- 172.21.15.77:0/527328219 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5623a2e129d0 con 0x5623a2eba930 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f0640ff9640 10 client.24919 handle_command_reply: tid=0 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 client.24919 shutdown 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 msgr2=0x5623a2ea7850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ea7850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0654011740 tx=0x7f0654004730 comp rx=0 tx=0).stop 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 shutdown_connections 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2eba930 0x5623a2ebcd80 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2ea82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2ea0080 0x5623a2ea7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 --2- 172.21.15.77:0/527328219 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ea7850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f0640ff9640 0 client.24919 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 >> 172.21.15.77:0/527328219 conn(0x5623a2e9bcf0 msgr2=0x5623a2e9ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.701+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 shutdown_connections 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.702+0000 7f066179a740 1 -- 172.21.15.77:0/527328219 wait complete. 2024-09-15T23:32:21.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.702+0000 7f066179a740 20 client.24919 trim_cache size 0 max 16384 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.722+0000 7f066179a740 1 Processor -- start 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.722+0000 7f066179a740 1 -- start start 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ec2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 0x5623a2ec2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06581aaab0 con 0x5623a2eaa940 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06581ad330 con 0x5623a2ea0080 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f066179a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f06581ab120 con 0x5623a2e9f760 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60180/0 (socket says 172.21.15.77:60180) 2024-09-15T23:32:21.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 -- 172.21.15.77:0/566881624 learned_addr learned my addr 172.21.15.77:0/566881624 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d15d640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ec2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065c95c640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 0x5623a2ec2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 -- 172.21.15.77:0/566881624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 msgr2=0x5623a2ec2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ec2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 -- 172.21.15.77:0/566881624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 msgr2=0x5623a2ec2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 0x5623a2ec2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065d95e640 1 -- 172.21.15.77:0/566881624 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5623a2e97260 con 0x5623a2eaa940 2024-09-15T23:32:21.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.723+0000 7f065c95c640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 0x5623a2ec2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.724+0000 7f065d95e640 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f065009f8a0 tx=0x7f065008a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeab503c2797ac4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.724+0000 7f0642ffd640 1 -- 172.21.15.77:0/566881624 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06500a3f50 con 0x5623a2eaa940 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.724+0000 7f0642ffd640 1 -- 172.21.15.77:0/566881624 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f06500a8810 con 0x5623a2eaa940 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.724+0000 7f0642ffd640 1 -- 172.21.15.77:0/566881624 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065008a0b0 con 0x5623a2eaa940 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- 172.21.15.77:0/566881624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 msgr2=0x5623a2ea4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f065009f8a0 tx=0x7f065008a040 comp rx=0 tx=0).stop 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- 172.21.15.77:0/566881624 shutdown_connections 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2eaa940 0x5623a2ea4ab0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2ea0080 0x5623a2ec2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 --2- 172.21.15.77:0/566881624 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2e9f760 0x5623a2ec2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- 172.21.15.77:0/566881624 >> 172.21.15.77:0/566881624 conn(0x5623a2e9bcf0 msgr2=0x5623a2ea98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- 172.21.15.77:0/566881624 shutdown_connections 2024-09-15T23:32:21.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- 172.21.15.77:0/566881624 wait complete. 2024-09-15T23:32:21.729 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.725+0000 7f066179a740 1 -- start start 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 Processor -- start 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2ea0080 0x5623a2eaf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2f24620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f065d15d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f065d15d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60188/0 (socket says 172.21.15.77:60188) 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f065d15d640 1 -- 172.21.15.77:0/1225116170 learned_addr learned my addr 172.21.15.77:0/1225116170 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f06581ab7f0 con 0x5623a2e9f760 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f06581acc60 con 0x5623a2eaa940 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f06581abec0 con 0x5623a2ea0080 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f065d95e640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2f24620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.730 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.726+0000 7f065c95c640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2ea0080 0x5623a2eaf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 -- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2ea0080 msgr2=0x5623a2eaf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2ea0080 0x5623a2eaf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 -- 172.21.15.77:0/1225116170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 msgr2=0x5623a2f24620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2f24620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5623a2f24b60 con 0x5623a2e9f760 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f066179a740 10 client.0 _ll_register_callbacks cb 0x7f0654011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06500a8810 con 0x5623a2e9f760 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f065d15d640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f065400b4f0 tx=0x7f0654010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d137ae45fe439 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f0640ff9640 10 client.15360 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f0640ff9640 1 -- 172.21.15.77:0/1225116170 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654044050 con 0x5623a2e9f760 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f0640ff9640 1 -- 172.21.15.77:0/1225116170 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f065401f240 con 0x5623a2e9f760 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f0640ff9640 1 -- 172.21.15.77:0/1225116170 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f065403a070 con 0x5623a2e9f760 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f066179a740 10 client.15360 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:21.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.727+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=21}) -- 0x5623a2f25d00 con 0x5623a2e9f760 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f0640ff9640 1 -- 172.21.15.77:0/1225116170 <== mon.0 v2:172.21.15.77:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f0654026050 con 0x5623a2e9f760 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 10 client.15360 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 10 client.15360 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 20 client.15360 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2f26320 0x5623a2f28740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 4 client.15360 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}] 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.2, "await_for": 45.0}) -- 0x5623a2e0cd20 con 0x5623a2f26320 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f065c95c640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2f26320 0x5623a2f28740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f0640ff9640 10 client.15360 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:21.732 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.728+0000 7f065c95c640 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2f26320 0x5623a2f28740 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbf50cf2ba79ebd3 server_cookie=9de591ea1e0aa17 in_seq=0 out_seq=0 2024-09-15T23:32:21.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f0640ff9640 1 -- 172.21.15.77:0/1225116170 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5623a2e0cd20 con 0x5623a2f26320 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f0640ff9640 10 client.15360 handle_command_reply: tid=0 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 client.15360 shutdown 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 msgr2=0x5623a2eaed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f065400b4f0 tx=0x7f0654010c80 comp rx=0 tx=0).stop 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 shutdown_connections 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5623a2f26320 0x5623a2f28740 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5623a2eaa940 0x5623a2f24620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5623a2ea0080 0x5623a2eaf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 --2- 172.21.15.77:0/1225116170 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5623a2e9f760 0x5623a2eaed60 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f0640ff9640 0 client.15360 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 >> 172.21.15.77:0/1225116170 conn(0x5623a2e9bcf0 msgr2=0x5623a2ea90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 shutdown_connections 2024-09-15T23:32:21.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 1 -- 172.21.15.77:0/1225116170 wait complete. 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.737+0000 7f066179a740 20 client.15360 trim_cache size 0 max 16384 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 2, 2024-09-15T23:32:21.741 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "c394b7ec": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 2, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 150.2, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:32:21.742 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:21.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 msgr2=0x7f06440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 0x7f06440a5700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0654005d00 tx=0x7f065400b410 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 msgr2=0x7f065819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0650010ea0 tx=0x7f0650010f90 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 shutdown_connections 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f06440a3240 0x7f06440a5700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f065810c1b0 0x7f065819cdc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f06581036f0 0x7f0658198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 --2- 172.21.15.77:0/194228051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0658102dd0 0x7f06581984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 >> 172.21.15.77:0/194228051 conn(0x7f06580fc7d0 msgr2=0x7f06580fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 shutdown_connections 2024-09-15T23:32:21.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:21.738+0000 7f065f3c1640 1 -- 172.21.15.77:0/194228051 wait complete. 2024-09-15T23:32:22.477 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c394b7ec', quiesce took 3.4 seconds. Will release after: 26.8 2024-09-15T23:32:22.491 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:23.018 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:22 smithi077 ceph-mon[30968]: pgmap v374: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 -- 172.21.15.77:0/3396822562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0106a60 msgr2=0x7f6bc0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 --2- 172.21.15.77:0/3396822562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0106a60 0x7f6bc0106e40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009930 tx=0x7f6bb002a420 comp rx=0 tx=0).stop 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 -- 172.21.15.77:0/3396822562 shutdown_connections 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 --2- 172.21.15.77:0/3396822562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0101400 0x7f6bc010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 --2- 172.21.15.77:0/3396822562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc0100a60 0x7f6bc0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 --2- 172.21.15.77:0/3396822562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0106a60 0x7f6bc0106e40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 -- 172.21.15.77:0/3396822562 >> 172.21.15.77:0/3396822562 conn(0x7f6bc00fc780 msgr2=0x7f6bc00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 -- 172.21.15.77:0/3396822562 shutdown_connections 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.016+0000 7f6bc680d640 1 -- 172.21.15.77:0/3396822562 wait complete. 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 Processor -- start 2024-09-15T23:32:23.040 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 -- start start 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0100a60 0x7f6bc01a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc0106a60 0x7f6bc019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0110e60 con 0x7f6bc0101400 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0110ce0 con 0x7f6bc0100a60 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bc680d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc0110fe0 con 0x7f6bc0106a60 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60208/0 (socket says 172.21.15.77:60208) 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.017+0000 7f6bb7fff640 1 -- 172.21.15.77:0/2383988129 learned_addr learned my addr 172.21.15.77:0/2383988129 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bbffff640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0100a60 0x7f6bc01a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 -- 172.21.15.77:0/2383988129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc0106a60 msgr2=0x7f6bc019eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc0106a60 0x7f6bc019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.041 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 -- 172.21.15.77:0/2383988129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0100a60 msgr2=0x7f6bc01a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0100a60 0x7f6bc01a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 -- 172.21.15.77:0/2383988129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc019f230 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800d770 tx=0x7f6ba800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bbdffb640 1 -- 172.21.15.77:0/2383988129 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8017070 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc019f520 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bbdffb640 1 -- 172.21.15.77:0/2383988129 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ba8005500 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.018+0000 7f6bbdffb640 1 -- 172.21.15.77:0/2383988129 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8004e00 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.019+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc01ab630 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.021+0000 7f6bbdffb640 1 -- 172.21.15.77:0/2383988129 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6ba8004fa0 con 0x7f6bc0101400 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 Processor -- start 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 -- start start 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733edd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733edfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.042 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564733e382e0 con 0x564733ed24a0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564733ddfce0 con 0x564733ed2dc0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564733e342a0 con 0x564733edd680 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bbdffb640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 0x7f6bac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60224/0 (socket says 172.21.15.77:60224) 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 -- 172.21.15.77:0/946604394 learned_addr learned my addr 172.21.15.77:0/946604394 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bbffff640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733edd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 0x7f6bac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bbdffb640 1 -- 172.21.15.77:0/2383988129 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6ba80cf7d0 con 0x7f6bc0101400 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733edfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 -- 172.21.15.77:0/946604394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 msgr2=0x564733edfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733edfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 -- 172.21.15.77:0/946604394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 msgr2=0x564733edd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.043 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733edd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.022+0000 7f6bc4daa640 1 -- 172.21.15.77:0/946604394 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564733dc4440 con 0x564733ed24a0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733edfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8013bd0 tx=0x7f6bb8011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e001608974f1528 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 0x7f6bac0a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8011c50 tx=0x7f6bb801a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bb67fc640 1 -- 172.21.15.77:0/946604394 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8022070 con 0x564733ed24a0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bb67fc640 1 -- 172.21.15.77:0/946604394 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb8003e50 con 0x564733ed24a0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.023+0000 7f6bb67fc640 1 -- 172.21.15.77:0/946604394 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8004020 con 0x564733ed24a0 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- 172.21.15.77:0/946604394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 msgr2=0x564733ed2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8013bd0 tx=0x7f6bb8011750 comp rx=0 tx=0).stop 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- 172.21.15.77:0/946604394 shutdown_connections 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733edfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733edd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/946604394 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ed2880 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.044 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- 172.21.15.77:0/946604394 >> 172.21.15.77:0/946604394 conn(0x564733ecea30 msgr2=0x564733ecee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- 172.21.15.77:0/946604394 shutdown_connections 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- 172.21.15.77:0/946604394 wait complete. 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 -- start start 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.024+0000 7f6bc8be6740 1 Processor -- start 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed2dc0 0x564733eda2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733eda800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564733ee0250 con 0x564733ed24a0 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564733df3050 con 0x564733edd680 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564733ee03d0 con 0x564733ed2dc0 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc8be6740 10 client.0 _ll_register_callbacks cb 0x564733e33160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60240/0 (socket says 172.21.15.77:60240) 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 -- 172.21.15.77:0/3309550769 learned_addr learned my addr 172.21.15.77:0/3309550769 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:23.045 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed2dc0 0x564733eda2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733eda800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 -- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed2dc0 msgr2=0x564733eda2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed2dc0 0x564733eda2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 -- 172.21.15.77:0/3309550769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 msgr2=0x564733eda800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733eda800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 -- 172.21.15.77:0/3309550769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564733ba93c0 con 0x564733ed24a0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733eda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.025+0000 7f6bbffff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009930 tx=0x7f6bb00318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e291f99031036e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0035040 con 0x564733ed24a0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bb8003e50 con 0x564733ed24a0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6bb0004240 con 0x564733ed24a0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bb004e050 con 0x564733ed24a0 2024-09-15T23:32:23.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 10 client.15372 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564733eebbe0 con 0x564733ed24a0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb8003e50 con 0x564733ed24a0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bb0004a40 con 0x564733ed24a0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 10 client.15372 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 20 client.15372 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733eecff0 0x564733eef420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 4 client.15372 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.026+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564733e45850 con 0x564733eecff0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.027+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733eecff0 0x564733eef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.027+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733eecff0 0x564733eef420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da2035ba08d125ff server_cookie=9df84b503852645a in_seq=0 out_seq=0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.027+0000 7f6b9f7fe640 10 client.15372 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/3309550769 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564733e45850 con 0x564733eecff0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6b9f7fe640 10 client.15372 handle_command_reply: tid=0 2024-09-15T23:32:23.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 client.15372 shutdown 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 msgr2=0x564733edcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0009930 tx=0x7f6bb00318b0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 shutdown_connections 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733eecff0 0x564733eef420 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733eda800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed2dc0 0x564733eda2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/3309550769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733edcff0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 >> 172.21.15.77:0/3309550769 conn(0x564733ecea30 msgr2=0x564733ed4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6b9f7fe640 0 client.15372 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 shutdown_connections 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 1 -- 172.21.15.77:0/3309550769 wait complete. 2024-09-15T23:32:23.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.028+0000 7f6bc8be6740 20 client.15372 trim_cache size 0 max 16384 2024-09-15T23:32:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 Processor -- start 2024-09-15T23:32:23.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 -- start start 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed24a0 0x564733ed8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733ef4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b3370 con 0x564733ed2dc0 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b5bf0 con 0x564733edd680 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b39e0 con 0x564733ed24a0 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bb7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60252/0 (socket says 172.21.15.77:60252) 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.046+0000 7f6bb7fff640 1 -- 172.21.15.77:0/1759661947 learned_addr learned my addr 172.21.15.77:0/1759661947 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733ef4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bbffff640 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed24a0 0x564733ed8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 -- 172.21.15.77:0/1759661947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed24a0 msgr2=0x564733ed8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed24a0 0x564733ed8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 -- 172.21.15.77:0/1759661947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 msgr2=0x564733ef4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733ef4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 -- 172.21.15.77:0/1759661947 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564733ed9250 con 0x564733ed2dc0 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009610 tx=0x7f6ba80cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2b5d4f3f491777 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb5ffb640 1 -- 172.21.15.77:0/1759661947 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba80b3070 con 0x564733ed2dc0 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb5ffb640 1 -- 172.21.15.77:0/1759661947 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ba809fe10 con 0x564733ed2dc0 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.047+0000 7f6bb5ffb640 1 -- 172.21.15.77:0/1759661947 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8020040 con 0x564733ed2dc0 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 -- 172.21.15.77:0/1759661947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 msgr2=0x564733ecda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8009610 tx=0x7f6ba80cf040 comp rx=0 tx=0).stop 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 -- 172.21.15.77:0/1759661947 shutdown_connections 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733edd680 0x564733ef4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed2dc0 0x564733ecda80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/1759661947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733ed24a0 0x564733ed8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 -- 172.21.15.77:0/1759661947 >> 172.21.15.77:0/1759661947 conn(0x564733ecea30 msgr2=0x564733ecd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 -- 172.21.15.77:0/1759661947 shutdown_connections 2024-09-15T23:32:23.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.048+0000 7f6bc8be6740 1 -- 172.21.15.77:0/1759661947 wait complete. 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 -- start start 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 Processor -- start 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733ee5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733ee2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b40b0 con 0x564733ed24a0 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b5520 con 0x564733ed2dc0 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc01b4780 con 0x564733edd680 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc8be6740 10 client.0 _ll_register_callbacks cb 0x7f6bb00314d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bbffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60266/0 (socket says 172.21.15.77:60266) 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bbffff640 1 -- 172.21.15.77:0/178659151 learned_addr learned my addr 172.21.15.77:0/178659151 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.049+0000 7f6bc4daa640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733ee2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733ee5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 -- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 msgr2=0x564733ee2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733ee2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 -- 172.21.15.77:0/178659151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 msgr2=0x564733ee5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733ee5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 -- 172.21.15.77:0/178659151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564733ee37a0 con 0x564733ed24a0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733ee5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bbffff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0006010 tx=0x7f6bb00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704fdcf355283456 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6b9f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0035070 con 0x564733ed24a0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6bb00048d0 con 0x564733ed24a0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.050+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ba809fe10 con 0x564733ed24a0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6bb0060050 con 0x564733ed24a0 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 10 client.15378 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:23.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564733f57950 con 0x564733ed24a0 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ba809fe10 con 0x564733ed24a0 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6bb0045470 con 0x564733ed24a0 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 10 client.15378 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 10 client.15378 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 20 client.15378 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733f580f0 0x564733f5a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 4 client.15378 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564733e3fd60 con 0x564733f580f0 2024-09-15T23:32:23.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.051+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733f580f0 0x564733f5a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bb7fff640 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733f580f0 0x564733f5a510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82c52fc6347472ea server_cookie=a7d31009843b80e in_seq=0 out_seq=0 2024-09-15T23:32:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6b9f7fe640 10 client.15378 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6b9f7fe640 1 -- 172.21.15.77:0/178659151 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564733e3fd60 con 0x564733f580f0 2024-09-15T23:32:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6b9f7fe640 10 client.15378 handle_command_reply: tid=0 2024-09-15T23:32:23.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 client.15378 shutdown 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 msgr2=0x564733ee59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0006010 tx=0x7f6bb00038a0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 shutdown_connections 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564733f580f0 0x564733f5a510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564733edd680 0x564733ee2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564733ed2dc0 0x564733ee5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6b9f7fe640 0 client.15378 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 --2- 172.21.15.77:0/178659151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564733ed24a0 0x564733ee59d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 >> 172.21.15.77:0/178659151 conn(0x564733ecea30 msgr2=0x564733ecda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 shutdown_connections 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.052+0000 7f6bc8be6740 1 -- 172.21.15.77:0/178659151 wait complete. 2024-09-15T23:32:23.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc8be6740 20 client.15378 trim_cache size 0 max 16384 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 msgr2=0x7f6bac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.060 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 0x7f6bac0a5700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8011c50 tx=0x7f6bb801a000 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 msgr2=0x7f6bc01a4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800d770 tx=0x7f6ba800dc30 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 shutdown_connections 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bac0a3240 0x7f6bac0a5700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6bc0106a60 0x7f6bc019eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6bc0101400 0x7f6bc01a4ca0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 --2- 172.21.15.77:0/2383988129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc0100a60 0x7f6bc01a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 >> 172.21.15.77:0/2383988129 conn(0x7f6bc00fc780 msgr2=0x7f6bc010c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 shutdown_connections 2024-09-15T23:32:23.061 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:23.053+0000 7f6bc680d640 1 -- 172.21.15.77:0/2383988129 wait complete. 2024-09-15T23:32:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:22 smithi159 ceph-mon[35472]: pgmap v374: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:22 smithi155 ceph-mon[35631]: pgmap v374: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:23.705 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:32:23.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:32:24.011 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:24.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 -- 172.21.15.77:0/2684271560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c102ef0 msgr2=0x7f674c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:24.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 --2- 172.21.15.77:0/2684271560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c102ef0 0x7f674c10da40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f6744009ca0 tx=0x7f674402a950 comp rx=0 tx=0).stop 2024-09-15T23:32:24.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 -- 172.21.15.77:0/2684271560 shutdown_connections 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 --2- 172.21.15.77:0/2684271560 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c102ef0 0x7f674c10da40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 --2- 172.21.15.77:0/2684271560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 0x7f674c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 --2- 172.21.15.77:0/2684271560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c100e20 0x7f674c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 -- 172.21.15.77:0/2684271560 >> 172.21.15.77:0/2684271560 conn(0x7f674c0fc7d0 msgr2=0x7f674c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 -- 172.21.15.77:0/2684271560 shutdown_connections 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 -- 172.21.15.77:0/2684271560 wait complete. 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.505+0000 7f67533aa640 1 Processor -- start 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 -- start start 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 0x7f674c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c102ef0 0x7f674c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f674c110fa0 con 0x7f674c100e20 2024-09-15T23:32:24.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f674c110e20 con 0x7f674c102570 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f67533aa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f674c111120 con 0x7f674c102ef0 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:60276/0 (socket says 172.21.15.77:60276) 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 -- 172.21.15.77:0/56935190 learned_addr learned my addr 172.21.15.77:0/56935190 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6750945640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 0x7f674c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751947640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c102ef0 0x7f674c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 -- 172.21.15.77:0/56935190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c102ef0 msgr2=0x7f674c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c102ef0 0x7f674c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 -- 172.21.15.77:0/56935190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 msgr2=0x7f674c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 0x7f674c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.506+0000 7f6751146640 1 -- 172.21.15.77:0/56935190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c1a6a10 con 0x7f674c100e20 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f6751146640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f673c00b4a0 tx=0x7f673c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c014070 con 0x7f674c100e20 2024-09-15T23:32:24.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f673c010af0 con 0x7f674c100e20 2024-09-15T23:32:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c1a6d00 con 0x7f674c100e20 2024-09-15T23:32:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673c017d10 con 0x7f674c100e20 2024-09-15T23:32:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.507+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c1a7230 con 0x7f674c100e20 2024-09-15T23:32:24.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.508+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c101200 con 0x7f674c100e20 2024-09-15T23:32:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.509+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f673c017070 con 0x7f674c100e20 2024-09-15T23:32:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.510+0000 7f67427fc640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 0x7f67380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.510+0000 7f6750945640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 0x7f67380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.510+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f673c0cef90 con 0x7f674c100e20 2024-09-15T23:32:24.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.510+0000 7f6750945640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 0x7f67380a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f674c0fe710 tx=0x7f674800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:24.515 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.514+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f673c09b920 con 0x7f674c100e20 2024-09-15T23:32:24.733 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.732+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f674c10a0a0 con 0x7f674c100e20 2024-09-15T23:32:24.734 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.733+0000 7f67427fc640 1 -- 172.21.15.77:0/56935190 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f673c09b220 con 0x7f674c100e20 2024-09-15T23:32:24.735 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:32:24.735 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:32:24.735 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:32:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 msgr2=0x7f67380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 0x7f67380a5780 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f674c0fe710 tx=0x7f674800b390 comp rx=0 tx=0).stop 2024-09-15T23:32:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 msgr2=0x7f674c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:24.736 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f673c00b4a0 tx=0x7f673c00b960 comp rx=0 tx=0).stop 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 shutdown_connections 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67380a32c0 0x7f67380a5780 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f674c102ef0 0x7f674c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f674c102570 0x7f674c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 --2- 172.21.15.77:0/56935190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f674c100e20 0x7f674c0fcc80 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 >> 172.21.15.77:0/56935190 conn(0x7f674c0fc7d0 msgr2=0x7f674c06a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 shutdown_connections 2024-09-15T23:32:24.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:24.735+0000 7f67533aa640 1 -- 172.21.15.77:0/56935190 wait complete. 2024-09-15T23:32:25.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:24 smithi077 ceph-mon[30968]: pgmap v375: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:25.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/56935190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:24 smithi159 ceph-mon[35472]: pgmap v375: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/56935190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:24 smithi155 ceph-mon[35631]: pgmap v375: 129 pgs: 129 active+clean; 653 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 938 B/s wr, 3 op/s 2024-09-15T23:32:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:24 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/56935190' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 -- 172.21.15.77:0/1596653885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24100a40 msgr2=0x7fea24100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 --2- 172.21.15.77:0/1596653885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24100a40 0x7fea24100e40 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fea14009900 tx=0x7fea1402a410 comp rx=0 tx=0).stop 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 -- 172.21.15.77:0/1596653885 shutdown_connections 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 --2- 172.21.15.77:0/1596653885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea241025f0 0x7fea24108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 --2- 172.21.15.77:0/1596653885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea24101c30 0x7fea241020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 --2- 172.21.15.77:0/1596653885 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24100a40 0x7fea24100e40 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 -- 172.21.15.77:0/1596653885 >> 172.21.15.77:0/1596653885 conn(0x7fea240fc1e0 msgr2=0x7fea240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 -- 172.21.15.77:0/1596653885 shutdown_connections 2024-09-15T23:32:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.144+0000 7fea289e8640 1 -- 172.21.15.77:0/1596653885 wait complete. 2024-09-15T23:32:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 Processor -- start 2024-09-15T23:32:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 -- start start 2024-09-15T23:32:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea24100a40 0x7fea24197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.148 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 0x7fea2419f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410c720 con 0x7fea24101c30 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410c5a0 con 0x7fea241025f0 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea289e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea2410c8a0 con 0x7fea24100a40 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea21d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea21d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47842/0 (socket says 172.21.15.77:47842) 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea21d9b640 1 -- 172.21.15.77:0/2090152378 learned_addr learned my addr 172.21.15.77:0/2090152378 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.145+0000 7fea2259c640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea24100a40 0x7fea24197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea22d9d640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 0x7fea2419f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 -- 172.21.15.77:0/2090152378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea24100a40 msgr2=0x7fea24197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea24100a40 0x7fea24197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 -- 172.21.15.77:0/2090152378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 msgr2=0x7fea2419f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 0x7fea2419f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 -- 172.21.15.77:0/2090152378 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2419faf0 con 0x7fea24101c30 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea22d9d640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 0x7fea2419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fea1800d950 tx=0x7fea1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea137fe640 1 -- 172.21.15.77:0/2090152378 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea18017070 con 0x7fea24101c30 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea137fe640 1 -- 172.21.15.77:0/2090152378 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea18009c30 con 0x7fea24101c30 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea2419fde0 con 0x7fea24101c30 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea137fe640 1 -- 172.21.15.77:0/2090152378 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1800f6b0 con 0x7fea24101c30 2024-09-15T23:32:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.146+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea241a0320 con 0x7fea24101c30 2024-09-15T23:32:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea137fe640 1 -- 172.21.15.77:0/2090152378 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea180109d0 con 0x7fea24101c30 2024-09-15T23:32:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 Processor -- start 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 -- start start 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e34da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e37830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5624b2d932f0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5624b2d3b270 con 0x5624b2e302e0 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea2b862740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5624b2d8f2b0 con 0x5624b2e35370 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea22d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47848/0 (socket says 172.21.15.77:47848) 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.149+0000 7fea22d9d640 1 -- 172.21.15.77:0/4260060886 learned_addr learned my addr 172.21.15.77:0/4260060886 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea21d9b640 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e37830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea2259c640 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e34da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 -- 172.21.15.77:0/4260060886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 msgr2=0x5624b2e37830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e37830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 -- 172.21.15.77:0/4260060886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 msgr2=0x5624b2e34da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e34da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 -- 172.21.15.77:0/4260060886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b2d3a340 con 0x5624b2e2f9a0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea137fe640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 0x7fea0c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea137fe640 1 -- 172.21.15.77:0/2090152378 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea180cf8d0 con 0x7fea24101c30 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 0x7fea0c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea22d9d640 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fea1c007f30 tx=0x7fea1c00c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dea8088c5c58d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea10ff9640 1 -- 172.21.15.77:0/4260060886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00fc90 con 0x5624b2e2f9a0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea10ff9640 1 -- 172.21.15.77:0/4260060886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1c01b8b0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.150+0000 7fea10ff9640 1 -- 172.21.15.77:0/4260060886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1c00e6e0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 -- 172.21.15.77:0/4260060886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 msgr2=0x5624b2e2fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea22d9d640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 0x7fea0c0a57b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fea1c01b000 tx=0x7fea1c01e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fea1c007f30 tx=0x7fea1c00c750 comp rx=0 tx=0).stop 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 -- 172.21.15.77:0/4260060886 shutdown_connections 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e37830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e34da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 --2- 172.21.15.77:0/4260060886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e2fda0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 -- 172.21.15.77:0/4260060886 >> 172.21.15.77:0/4260060886 conn(0x5624b2e2b010 msgr2=0x5624b2e2b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 -- 172.21.15.77:0/4260060886 shutdown_connections 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.151+0000 7fea2b862740 1 -- 172.21.15.77:0/4260060886 wait complete. 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 -- start start 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 Processor -- start 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.158 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5624b2e38340 con 0x5624b2e2f9a0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5624b2d1c290 con 0x5624b2e302e0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5624b2e384c0 con 0x5624b2e35370 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2b862740 10 client.0 _ll_register_callbacks cb 0x5624b2d4d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47854/0 (socket says 172.21.15.77:47854) 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 -- 172.21.15.77:0/2152656688 learned_addr learned my addr 172.21.15.77:0/2152656688 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea22d9d640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 -- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 msgr2=0x5624b2e410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 -- 172.21.15.77:0/2152656688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 msgr2=0x5624b2e3a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.159 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.152+0000 7fea2259c640 1 -- 172.21.15.77:0/2152656688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b2aa6210 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea2259c640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fea14009900 tx=0x7fea140318e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00424fe8024b566 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14035040 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea14004040 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea1c01b8b0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea1404e050 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea2b862740 10 client.15396 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5624b2b72620 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea1c01b8b0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.153+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea140047f0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 10 client.15396 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 10 client.15396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 20 client.15396 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2e45830 0x5624b2e47c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 4 client.15396 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624b2da0a20 con 0x5624b2e45830 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2e45830 0x5624b2e47c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea09ffb640 10 client.15396 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.154+0000 7fea21d9b640 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2e45830 0x5624b2e47c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bdd54905042ceb1 server_cookie=30af27beb3f8adcd in_seq=0 out_seq=0 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea09ffb640 1 -- 172.21.15.77:0/2152656688 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5624b2da0a20 con 0x5624b2e45830 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea09ffb640 10 client.15396 handle_command_reply: tid=0 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 client.15396 shutdown 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 msgr2=0x5624b2e39b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fea14009900 tx=0x7fea140318e0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 shutdown_connections 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2e45830 0x5624b2e47c60 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea09ffb640 0 client.15396 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 --2- 172.21.15.77:0/2152656688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e39b70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.155+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 >> 172.21.15.77:0/2152656688 conn(0x5624b2e2b010 msgr2=0x5624b2e2c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.156+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 shutdown_connections 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.156+0000 7fea2b862740 1 -- 172.21.15.77:0/2152656688 wait complete. 2024-09-15T23:32:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.156+0000 7fea2b862740 20 client.15396 trim_cache size 0 max 16384 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 Processor -- start 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 -- start start 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e410b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e29ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea241a88c0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea241ab140 con 0x5624b2e302e0 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2b862740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea241a8f30 con 0x5624b2e35370 2024-09-15T23:32:27.173 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47868/0 (socket says 172.21.15.77:47868) 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 -- 172.21.15.77:0/71337744 learned_addr learned my addr 172.21.15.77:0/71337744 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 -- 172.21.15.77:0/71337744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 msgr2=0x5624b2e29ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e29ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 -- 172.21.15.77:0/71337744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 msgr2=0x5624b2e410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 -- 172.21.15.77:0/71337744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624b2e37760 con 0x5624b2e2f9a0 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea2259c640 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ee20f7dfb7e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.171+0000 7fea0bfff640 1 -- 172.21.15.77:0/71337744 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14035030 con 0x5624b2e2f9a0 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea0bfff640 1 -- 172.21.15.77:0/71337744 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea14031950 con 0x5624b2e2f9a0 2024-09-15T23:32:27.174 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea0bfff640 1 -- 172.21.15.77:0/71337744 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14045470 con 0x5624b2e2f9a0 2024-09-15T23:32:27.177 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 -- 172.21.15.77:0/71337744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 msgr2=0x5624b2e299a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fea14000c00 tx=0x7fea14005e00 comp rx=0 tx=0).stop 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 -- 172.21.15.77:0/71337744 shutdown_connections 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e29ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 --2- 172.21.15.77:0/71337744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e299a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 -- 172.21.15.77:0/71337744 >> 172.21.15.77:0/71337744 conn(0x5624b2e2b010 msgr2=0x5624b2e39920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 -- 172.21.15.77:0/71337744 shutdown_connections 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.172+0000 7fea2b862740 1 -- 172.21.15.77:0/71337744 wait complete. 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 -- start start 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 Processor -- start 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.178 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e3fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea241a9600 con 0x5624b2e2f9a0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea241aaa70 con 0x5624b2e302e0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea241a9cd0 con 0x5624b2e35370 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2b862740 10 client.0 _ll_register_callbacks cb 0x7fea14009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47870/0 (socket says 172.21.15.77:47870) 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 -- 172.21.15.77:0/562125736 learned_addr learned my addr 172.21.15.77:0/562125736 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea21d9b640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea22d9d640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e3fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 -- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 msgr2=0x5624b2e3fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e3fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 -- 172.21.15.77:0/562125736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 msgr2=0x5624b2e3ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:27.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 -- 172.21.15.77:0/562125736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624b2e402e0 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea21d9b640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea2259c640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fea14009900 tx=0x7fea14005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282d59b85205c3b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.173+0000 7fea09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14035030 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea14031950 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea14004970 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea14068050 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 10 client.15402 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5624b2eb0540 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea14031950 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea14063030 con 0x5624b2e2f9a0 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 10 client.15402 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:27.180 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 20 client.15402 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2eb0d80 0x5624b2eb31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 4 client.15402 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.174+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624b2d9ad70 con 0x5624b2eb0d80 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.175+0000 7fea21d9b640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2eb0d80 0x5624b2eb31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.175+0000 7fea09ffb640 10 client.15402 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:27.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.175+0000 7fea21d9b640 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2eb0d80 0x5624b2eb31a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff01c9c4a0c7f9a8 server_cookie=1f389b5afddf29e in_seq=0 out_seq=0 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea09ffb640 1 -- 172.21.15.77:0/562125736 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624b2d9ad70 con 0x5624b2eb0d80 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea09ffb640 10 client.15402 handle_command_reply: tid=0 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 client.15402 shutdown 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 msgr2=0x5624b2e3e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fea14009900 tx=0x7fea14005730 comp rx=0 tx=0).stop 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 shutdown_connections 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5624b2eb0d80 0x5624b2eb31a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5624b2e35370 0x5624b2e3fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5624b2e302e0 0x5624b2e3ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea09ffb640 0 client.15402 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 --2- 172.21.15.77:0/562125736 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5624b2e2f9a0 0x5624b2e3e780 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.184 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 >> 172.21.15.77:0/562125736 conn(0x5624b2e2b010 msgr2=0x5624b2e299a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 shutdown_connections 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 1 -- 172.21.15.77:0/562125736 wait complete. 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.182+0000 7fea2b862740 20 client.15402 trim_cache size 0 max 16384 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:32:27.185 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 msgr2=0x7fea0c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 0x7fea0c0a57b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fea1c01b000 tx=0x7fea1c01e000 comp rx=0 tx=0).stop 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 msgr2=0x7fea24198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fea1800d950 tx=0x7fea1800de10 comp rx=0 tx=0).stop 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 shutdown_connections 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea0c0a32f0 0x7fea0c0a57b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea241025f0 0x7fea2419f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.186 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea24101c30 0x7fea24198410 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 --2- 172.21.15.77:0/2090152378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea24100a40 0x7fea24197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 >> 172.21.15.77:0/2090152378 conn(0x7fea240fc1e0 msgr2=0x7fea240fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 shutdown_connections 2024-09-15T23:32:27.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:27.183+0000 7fea289e8640 1 -- 172.21.15.77:0/2090152378 wait complete. 2024-09-15T23:32:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:26 smithi159 ceph-mon[35472]: pgmap v376: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-15T23:32:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:26 smithi155 ceph-mon[35631]: pgmap v376: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-15T23:32:27.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:26 smithi077 ceph-mon[30968]: pgmap v376: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-09-15T23:32:28.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:32:28.532 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:29.046 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 -- 172.21.15.77:0/2891145555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102570 msgr2=0x7ff3f41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 --2- 172.21.15.77:0/2891145555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102570 0x7ff3f41029b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009900 tx=0x7ff3e802a480 comp rx=0 tx=0).stop 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 -- 172.21.15.77:0/2891145555 shutdown_connections 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 --2- 172.21.15.77:0/2891145555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102ef0 0x7ff3f410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 --2- 172.21.15.77:0/2891145555 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102570 0x7ff3f41029b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 --2- 172.21.15.77:0/2891145555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 -- 172.21.15.77:0/2891145555 >> 172.21.15.77:0/2891145555 conn(0x7ff3f40fc7d0 msgr2=0x7ff3f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 -- 172.21.15.77:0/2891145555 shutdown_connections 2024-09-15T23:32:29.047 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 -- 172.21.15.77:0/2891145555 wait complete. 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.029+0000 7ff3f949e640 1 Processor -- start 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 -- start start 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f40fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102570 0x7ff3f40fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f4110f50 con 0x7ff3f4102ef0 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f4110dd0 con 0x7ff3f4100e20 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f949e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41110d0 con 0x7ff3f4102570 2024-09-15T23:32:29.048 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47892/0 (socket says 172.21.15.77:47892) 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 -- 172.21.15.77:0/91182019 learned_addr learned my addr 172.21.15.77:0/91182019 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102570 0x7ff3f40fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f40fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 -- 172.21.15.77:0/91182019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102570 msgr2=0x7ff3f40fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102570 0x7ff3f40fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 -- 172.21.15.77:0/91182019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 msgr2=0x7ff3f40fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f40fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.049 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 -- 172.21.15.77:0/91182019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f41a6920 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.030+0000 7ff3f37fe640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00eaa0 tx=0x7ff3ec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.031+0000 7ff3dbfff640 1 -- 172.21.15.77:0/91182019 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec00cdb0 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.031+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f41a6c10 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.031+0000 7ff3dbfff640 1 -- 172.21.15.77:0/91182019 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3ec005020 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.031+0000 7ff3dbfff640 1 -- 172.21.15.77:0/91182019 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0116b0 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.031+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f41a7100 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.033+0000 7ff3dbfff640 1 -- 172.21.15.77:0/91182019 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff3ec005560 con 0x7ff3f4102ef0 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.033+0000 7ff3fb877740 1 Processor -- start 2024-09-15T23:32:29.050 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 -- start start 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f82a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898f8f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558898ee82f0 con 0x558898f83b40 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558898e8fcf0 con 0x558898f8d370 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3fb877740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558898ee42b0 con 0x558898f825d0 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3dbfff640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 0x7ff3dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47908/0 (socket says 172.21.15.77:47908) 2024-09-15T23:32:29.051 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2495657458 learned_addr learned my addr 172.21.15.77:0/2495657458 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f37fe640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 0x7ff3dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f82a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3dbfff640 1 -- 172.21.15.77:0/91182019 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff3ec0cff60 con 0x7ff3f4102ef0 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898f8f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2495657458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 msgr2=0x558898f82a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f82a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2495657458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 msgr2=0x558898f8f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898f8f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.034+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2495657458 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558898e743a0 con 0x558898f83b40 2024-09-15T23:32:29.052 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.035+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005940 tx=0x7ff3e80095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dbe36bb8eff7d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.035+0000 7ff3f37fe640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 0x7ff3dc0a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec09c180 tx=0x7ff3ec0916d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.035+0000 7ff3d97fa640 1 -- 172.21.15.77:0/2495657458 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8045070 con 0x558898f83b40 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.035+0000 7ff3d97fa640 1 -- 172.21.15.77:0/2495657458 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e80046c0 con 0x558898f83b40 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.035+0000 7ff3d97fa640 1 -- 172.21.15.77:0/2495657458 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8035070 con 0x558898f83b40 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- 172.21.15.77:0/2495657458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 msgr2=0x558898f82090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005940 tx=0x7ff3e80095e0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- 172.21.15.77:0/2495657458 shutdown_connections 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898f8f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f82a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2495657458 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898f82090 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- 172.21.15.77:0/2495657458 >> 172.21.15.77:0/2495657458 conn(0x558898f4b310 msgr2=0x558898f7ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- 172.21.15.77:0/2495657458 shutdown_connections 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- 172.21.15.77:0/2495657458 wait complete. 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- start start 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 Processor -- start 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f825d0 0x558898f8cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f83b40 0x558898f8a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558898f90010 con 0x558898f8d370 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558898ea3060 con 0x558898f825d0 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558898f90190 con 0x558898f83b40 2024-09-15T23:32:29.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.036+0000 7ff3fb877740 10 client.0 _ll_register_callbacks cb 0x558898bf68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47914/0 (socket says 172.21.15.77:47914) 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2950023291 learned_addr learned my addr 172.21.15.77:0/2950023291 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f825d0 0x558898f8cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f83b40 0x558898f8a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f83b40 msgr2=0x558898f8a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f83b40 0x558898f8a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2950023291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f825d0 msgr2=0x558898f8cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f825d0 0x558898f8cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 -- 172.21.15.77:0/2950023291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558898c593c0 con 0x558898f8d370 2024-09-15T23:32:29.055 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8043040 tx=0x7ff3e802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bb821ba3cbc265 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8045040 con 0x558898f8d370 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff3e80035f0 con 0x558898f8d370 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e80046c0 con 0x558898f8d370 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.037+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff3e8035040 con 0x558898f8d370 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 10 client.15414 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:29.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558898f9bb60 con 0x558898f8d370 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e80046c0 con 0x558898f8d370 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff3e804b070 con 0x558898f8d370 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 10 client.15414 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 10 client.15414 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 20 client.15414 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558898f9ceb0 0x558898f9f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 4 client.15414 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558898ef5860 con 0x558898f9ceb0 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.038+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558898f9ceb0 0x558898f9f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.039+0000 7ff3d6ff5640 10 client.15414 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.039+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558898f9ceb0 0x558898f9f2a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5c500683a5e9f4 server_cookie=3a89775e43d29c29 in_seq=0 out_seq=0 2024-09-15T23:32:29.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/2950023291 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558898ef5860 con 0x558898f9ceb0 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3d6ff5640 10 client.15414 handle_command_reply: tid=0 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 client.15414 shutdown 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 msgr2=0x558898f8a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8043040 tx=0x7ff3e802a480 comp rx=0 tx=0).stop 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 shutdown_connections 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558898f9ceb0 0x558898f9f2a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f8a810 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f83b40 0x558898f8a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.058 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 --2- 172.21.15.77:0/2950023291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f825d0 0x558898f8cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 >> 172.21.15.77:0/2950023291 conn(0x558898f4b310 msgr2=0x558898f84930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3d6ff5640 0 client.15414 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 shutdown_connections 2024-09-15T23:32:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 1 -- 172.21.15.77:0/2950023291 wait complete. 2024-09-15T23:32:29.059 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.040+0000 7ff3fb877740 20 client.15414 trim_cache size 0 max 16384 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 Processor -- start 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 -- start start 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f89940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898fa2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41aee10 con 0x558898f83b40 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41b1690 con 0x558898f8d370 2024-09-15T23:32:29.067 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3fb877740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41af480 con 0x558898f825d0 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3f2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3f2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47922/0 (socket says 172.21.15.77:47922) 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.053+0000 7ff3f2ffd640 1 -- 172.21.15.77:0/1264619714 learned_addr learned my addr 172.21.15.77:0/1264619714 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f89940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898fa2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 -- 172.21.15.77:0/1264619714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 msgr2=0x558898f89940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f89940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 -- 172.21.15.77:0/1264619714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 msgr2=0x558898fa2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898fa2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 -- 172.21.15.77:0/1264619714 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558898f89030 con 0x558898f83b40 2024-09-15T23:32:29.068 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898fa2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4005fd0 tx=0x7ff3e400d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca53b2d750f2887 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3d8ff9640 1 -- 172.21.15.77:0/1264619714 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e401d070 con 0x558898f83b40 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3d8ff9640 1 -- 172.21.15.77:0/1264619714 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e4010e50 con 0x558898f83b40 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.054+0000 7ff3d8ff9640 1 -- 172.21.15.77:0/1264619714 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400fb90 con 0x558898f83b40 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- 172.21.15.77:0/1264619714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 msgr2=0x558898fa1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff3e4005fd0 tx=0x7ff3e400d6b0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- 172.21.15.77:0/1264619714 shutdown_connections 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f8d370 0x558898fa2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.069 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f83b40 0x558898fa1ee0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 --2- 172.21.15.77:0/1264619714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898f89940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- 172.21.15.77:0/1264619714 >> 172.21.15.77:0/1264619714 conn(0x558898f4b310 msgr2=0x558898f7e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- 172.21.15.77:0/1264619714 shutdown_connections 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- 172.21.15.77:0/1264619714 wait complete. 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.055+0000 7ff3fb877740 1 -- start start 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 Processor -- start 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898fa22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 0x558898fa2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41afb50 con 0x558898f8d370 2024-09-15T23:32:29.070 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41b0fc0 con 0x558898f83b40 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f41b0220 con 0x558898f825d0 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3fb877740 10 client.0 _ll_register_callbacks cb 0x7ff3e8043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47926/0 (socket says 172.21.15.77:47926) 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 -- 172.21.15.77:0/3641177608 learned_addr learned my addr 172.21.15.77:0/3641177608 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898fa22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 0x558898fa2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 -- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 msgr2=0x558898fa22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898fa22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.071 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 -- 172.21.15.77:0/3641177608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 msgr2=0x558898fa2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 0x558898fa2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f27fc640 1 -- 172.21.15.77:0/3641177608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558898fa00f0 con 0x558898f8d370 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.056+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 0x558898fa2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3f27fc640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005270 tx=0x7ff3e802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c5953fdc80b1b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8005d50 con 0x558898f8d370 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff3e80315b0 con 0x558898f8d370 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3e4010e50 con 0x558898f8d370 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff3e8062050 con 0x558898f8d370 2024-09-15T23:32:29.072 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 10 client.15420 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558899007410 con 0x558898f8d370 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff3e4010e50 con 0x558898f8d370 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff3e805a020 con 0x558898f8d370 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 10 client.15420 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 10 client.15420 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 20 client.15420 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558899007b30 0x558899009f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 4 client.15420 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.057+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558898eefd70 con 0x558899007b30 2024-09-15T23:32:29.073 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558899007b30 0x558899009f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3d6ff5640 10 client.15420 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3f2ffd640 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558899007b30 0x558899009f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f26c4e8d98f9 server_cookie=c39f30fb0217f2c in_seq=0 out_seq=0 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3d6ff5640 1 -- 172.21.15.77:0/3641177608 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558898eefd70 con 0x558899007b30 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3d6ff5640 10 client.15420 handle_command_reply: tid=0 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.058+0000 7ff3fb877740 1 client.15420 shutdown 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 msgr2=0x558898f9f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8005270 tx=0x7ff3e802a480 comp rx=0 tx=0).stop 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 shutdown_connections 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558899007b30 0x558899009f50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.074 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558898f8d370 0x558898f9f8c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558898f83b40 0x558898fa2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 --2- 172.21.15.77:0/3641177608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558898f825d0 0x558898fa22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 >> 172.21.15.77:0/3641177608 conn(0x558898f4b310 msgr2=0x558898f7e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3d6ff5640 0 client.15420 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 shutdown_connections 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 1 -- 172.21.15.77:0/3641177608 wait complete. 2024-09-15T23:32:29.075 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.059+0000 7ff3fb877740 20 client.15420 trim_cache size 0 max 16384 2024-09-15T23:32:29.076 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 msgr2=0x7ff3dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 0x7ff3dc0a5700 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec09c180 tx=0x7ff3ec0916d0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 msgr2=0x7ff3f40fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00eaa0 tx=0x7ff3ec00ef60 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 shutdown_connections 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff3dc0a3240 0x7ff3dc0a5700 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff3f4102ef0 0x7ff3f40fd700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3f4102570 0x7ff3f40fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 --2- 172.21.15.77:0/91182019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff3f4100e20 0x7ff3f40fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 >> 172.21.15.77:0/91182019 conn(0x7ff3f40fc7d0 msgr2=0x7ff3f406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 shutdown_connections 2024-09-15T23:32:29.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:29.060+0000 7ff3f949e640 1 -- 172.21.15.77:0/91182019 wait complete. 2024-09-15T23:32:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:28 smithi159 ceph-mon[35472]: pgmap v377: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:29.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:28 smithi155 ceph-mon[35631]: pgmap v377: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:29.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:28 smithi077 ceph-mon[30968]: pgmap v377: 129 pgs: 129 active+clean; 658 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:30.882 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:32:30.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:32:31.148 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:30 smithi159 ceph-mon[35472]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-15T23:32:31.272 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:30 smithi077 ceph-mon[30968]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-15T23:32:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:30 smithi155 ceph-mon[35631]: pgmap v378: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-09-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 -- 172.21.15.77:0/866584288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8106f00 msgr2=0x7f2dd810ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 --2- 172.21.15.77:0/866584288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8106f00 0x7f2dd810ea80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009ca0 tx=0x7f2dd002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.675 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 -- 172.21.15.77:0/866584288 shutdown_connections 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 --2- 172.21.15.77:0/866584288 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8106f00 0x7f2dd810ea80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 --2- 172.21.15.77:0/866584288 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd81067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 --2- 172.21.15.77:0/866584288 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 -- 172.21.15.77:0/866584288 >> 172.21.15.77:0/866584288 conn(0x7f2dd80fd8b0 msgr2=0x7f2dd80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 -- 172.21.15.77:0/866584288 shutdown_connections 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 -- 172.21.15.77:0/866584288 wait complete. 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.660+0000 7f2ddef35640 1 Processor -- start 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 -- start start 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd8198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8106f00 0x7f2dd819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8111f60 con 0x7f2dd8101dd0 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd8111de0 con 0x7f2dd8102780 2024-09-15T23:32:31.676 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddef35640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd81120e0 con 0x7f2dd8106f00 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47950/0 (socket says 172.21.15.77:47950) 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 -- 172.21.15.77:0/1882435853 learned_addr learned my addr 172.21.15.77:0/1882435853 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd8198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8106f00 0x7f2dd819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 -- 172.21.15.77:0/1882435853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8106f00 msgr2=0x7f2dd819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8106f00 0x7f2dd819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 -- 172.21.15.77:0/1882435853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 msgr2=0x7f2dd8198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd8198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2ddccd1640 1 -- 172.21.15.77:0/1882435853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd819d390 con 0x7f2dd8101dd0 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.661+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c970 tx=0x7f2dcc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.677 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2dd5ffb640 1 -- 172.21.15.77:0/1882435853 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc007bb0 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd819d680 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd81a4f60 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2dd5ffb640 1 -- 172.21.15.77:0/1882435853 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dcc007d50 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.662+0000 7f2dd5ffb640 1 -- 172.21.15.77:0/1882435853 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00f450 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.665+0000 7f2dd5ffb640 1 -- 172.21.15.77:0/1882435853 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2dcc0046c0 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 Processor -- start 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2dd5ffb640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 0x7f2dc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 -- start start 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 0x7f2dc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2dd5ffb640 1 -- 172.21.15.77:0/1882435853 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f2dcc0cfac0 con 0x7f2dd8101dd0 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8db7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d23a82b280 con 0x55d23a8c5f40 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d23a7d2b10 con 0x55d23a8d93e0 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.666+0000 7f2de130e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d23a827240 con 0x55d23a8c70e0 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47956/0 (socket says 172.21.15.77:47956) 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1363430687 learned_addr learned my addr 172.21.15.77:0/1363430687 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1363430687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 msgr2=0x55d23a8c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1363430687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 msgr2=0x55d23a8db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1363430687 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d23a7df1f0 con 0x55d23a8c5f40 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:31.679 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 0x7f2dc80a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0006010 tx=0x7f2dd0031ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400dc30 tx=0x7f2dc400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f16beda203e62cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.667+0000 7f2dc2ffd640 1 -- 172.21.15.77:0/1363430687 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4005020 con 0x55d23a8c5f40 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.668+0000 7f2dc2ffd640 1 -- 172.21.15.77:0/1363430687 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc40047a0 con 0x55d23a8c5f40 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.668+0000 7f2dc2ffd640 1 -- 172.21.15.77:0/1363430687 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc4011730 con 0x55d23a8c5f40 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.668+0000 7f2de130e740 1 -- 172.21.15.77:0/1363430687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 msgr2=0x55d23a8c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.668+0000 7f2de130e740 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400dc30 tx=0x7f2dc400f730 comp rx=0 tx=0).stop 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 -- 172.21.15.77:0/1363430687 shutdown_connections 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8db7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c6380 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 --2- 172.21.15.77:0/1363430687 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 -- 172.21.15.77:0/1363430687 >> 172.21.15.77:0/1363430687 conn(0x55d23a8c20f0 msgr2=0x55d23a8c24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 -- 172.21.15.77:0/1363430687 shutdown_connections 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.669+0000 7f2de130e740 1 -- 172.21.15.77:0/1363430687 wait complete. 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.670+0000 7f2de130e740 1 -- start start 2024-09-15T23:32:31.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.670+0000 7f2de130e740 1 Processor -- start 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.670+0000 7f2de130e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.670+0000 7f2de130e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2de130e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47970/0 (socket says 172.21.15.77:47970) 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2592336330 learned_addr learned my addr 172.21.15.77:0/2592336330 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d23a8dc110 con 0x55d23a8c5f40 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d23a7e5f10 con 0x55d23a8d93e0 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d23a8dc290 con 0x55d23a8c70e0 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2de130e740 10 client.0 _ll_register_callbacks cb 0x55d23a7aea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 msgr2=0x55d23a8c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2592336330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 msgr2=0x55d23a8ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d23a59c6a0 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.671+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc09bce0 tx=0x7f2dcc09be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7c29e53157fd71 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2db7fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc01d040 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f2dcc09b3a0 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dc40047a0 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2dcc0b9050 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2de130e740 10 client.15432 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.672+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d23a8e7e80 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc40047a0 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2dcc0a1450 con 0x55d23a8c5f40 2024-09-15T23:32:31.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 10 client.15432 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 20 client.15432 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a8e93e0 0x55d23a8eb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 4 client.15432 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.673+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d23a8387f0 con 0x55d23a8e93e0 2024-09-15T23:32:31.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.674+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a8e93e0 0x55d23a8eb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.675+0000 7f2db7fff640 10 client.15432 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.675+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a8e93e0 0x55d23a8eb8a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fcf0fad26e23ce server_cookie=561aca35993932e2 in_seq=0 out_seq=0 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.675+0000 7f2db7fff640 1 -- 172.21.15.77:0/2592336330 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d23a8387f0 con 0x55d23a8e93e0 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2db7fff640 10 client.15432 handle_command_reply: tid=0 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 client.15432 shutdown 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 msgr2=0x55d23a8c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc09bce0 tx=0x7f2dcc09be10 comp rx=0 tx=0).stop 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 shutdown_connections 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a8e93e0 0x55d23a8eb8a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8d93e0 0x55d23a8ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c70e0 0x55d23a8c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 --2- 172.21.15.77:0/2592336330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c5f40 0x55d23a8c9760 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 >> 172.21.15.77:0/2592336330 conn(0x55d23a8c20f0 msgr2=0x55d23a8c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2db7fff640 0 client.15432 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 shutdown_connections 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 1 -- 172.21.15.77:0/2592336330 wait complete. 2024-09-15T23:32:31.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.676+0000 7f2de130e740 20 client.15432 trim_cache size 0 max 16384 2024-09-15T23:32:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 Processor -- start 2024-09-15T23:32:31.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 -- start start 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c5f40 0x55d23a8c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8d93e0 0x55d23a8f1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc00dbd0 con 0x55d23a8c70e0 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc010450 con 0x55d23a8c5f40 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2de130e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc00e240 con 0x55d23a8d93e0 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.712 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47982/0 (socket says 172.21.15.77:47982) 2024-09-15T23:32:31.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1193746296 learned_addr learned my addr 172.21.15.77:0/1193746296 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:31.713 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c5f40 0x55d23a8c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.710+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8d93e0 0x55d23a8f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1193746296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8d93e0 msgr2=0x55d23a8f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8d93e0 0x55d23a8f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1193746296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c5f40 msgr2=0x55d23a8c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c5f40 0x55d23a8c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 -- 172.21.15.77:0/1193746296 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d23a8bd830 con 0x55d23a8c70e0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400dc00 tx=0x7f2dc400fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bebd3dedfb2ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dc27fc640 1 -- 172.21.15.77:0/1193746296 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40050b0 con 0x55d23a8c70e0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dc27fc640 1 -- 172.21.15.77:0/1193746296 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc40035f0 con 0x55d23a8c70e0 2024-09-15T23:32:31.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.711+0000 7f2dc27fc640 1 -- 172.21.15.77:0/1193746296 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40266c0 con 0x55d23a8c70e0 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 -- 172.21.15.77:0/1193746296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 msgr2=0x55d23a8c1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2dc400dc00 tx=0x7f2dc400fee0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 -- 172.21.15.77:0/1193746296 shutdown_connections 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8d93e0 0x55d23a8f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8c70e0 0x55d23a8c1160 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 --2- 172.21.15.77:0/1193746296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c5f40 0x55d23a8c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 -- 172.21.15.77:0/1193746296 >> 172.21.15.77:0/1193746296 conn(0x55d23a8c20f0 msgr2=0x55d23a8c0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 -- 172.21.15.77:0/1193746296 shutdown_connections 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.712+0000 7f2de130e740 1 -- 172.21.15.77:0/1193746296 wait complete. 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.713+0000 7f2de130e740 1 -- start start 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.713+0000 7f2de130e740 1 Processor -- start 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.713+0000 7f2de130e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c70e0 0x55d23a8e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8d93e0 0x55d23a8dc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddccd1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:60746/0 (socket says 172.21.15.77:60746) 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2dd7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c70e0 0x55d23a8e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2355782825 learned_addr learned my addr 172.21.15.77:0/2355782825 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddd4d2640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8d93e0 0x55d23a8dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc00e910 con 0x55d23a8d93e0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc00fd80 con 0x55d23a8c70e0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc00efe0 con 0x55d23a8c5f40 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2de130e740 10 client.0 _ll_register_callbacks cb 0x7f2dcc09b890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2355782825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c70e0 msgr2=0x55d23a8e1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.714+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c70e0 0x55d23a8e1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2355782825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8d93e0 msgr2=0x55d23a8dc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:31.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8d93e0 0x55d23a8dc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2ddccd1640 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d23a8dcda0 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2ddccd1640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0cd280 tx=0x7f2dcc007f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=430d391426090728 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2db7fff640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc01d040 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f2dcc097aa0 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2dc40035f0 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2dcc0a0100 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2de130e740 10 client.24979 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.715+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d23a954c00 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2dc40035f0 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f2dcc0ba9e0 con 0x55d23a8c5f40 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 10 client.24979 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:31.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 10 client.24979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 20 client.24979 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a955140 0x55d23a957530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 4 client.24979 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55d23a832d00 con 0x55d23a955140 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.716+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a955140 0x55d23a957530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.717+0000 7f2dd7fff640 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a955140 0x55d23a957530 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9afdcb14ac4a9c0 server_cookie=db4ed941bdfb0486 in_seq=0 out_seq=0 2024-09-15T23:32:31.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.717+0000 7f2db7fff640 10 client.24979 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.718+0000 7f2db7fff640 1 -- 172.21.15.77:0/2355782825 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55d23a832d00 con 0x55d23a955140 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.718+0000 7f2db7fff640 10 client.24979 handle_command_reply: tid=0 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.718+0000 7f2de130e740 1 client.24979 shutdown 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.718+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 msgr2=0x55d23a8e17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.718+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc0cd280 tx=0x7f2dcc007f20 comp rx=0 tx=0).stop 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 shutdown_connections 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d23a955140 0x55d23a957530 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.723 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2db7fff640 0 client.24979 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d23a8d93e0 0x55d23a8dc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d23a8c70e0 0x55d23a8e1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 --2- 172.21.15.77:0/2355782825 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d23a8c5f40 0x55d23a8e17a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 >> 172.21.15.77:0/2355782825 conn(0x55d23a8c20f0 msgr2=0x55d23a8c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 shutdown_connections 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 1 -- 172.21.15.77:0/2355782825 wait complete. 2024-09-15T23:32:31.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.719+0000 7f2de130e740 20 client.24979 trim_cache size 0 max 16384 2024-09-15T23:32:31.725 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:31.725 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:32:31.725 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "a71bc9b3-9a4c-41af-8953-d2fddd563615", 2024-09-15T23:32:31.725 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:32:31.725 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 msgr2=0x7f2dc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 0x7f2dc80a5700 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0006010 tx=0x7f2dd0031ce0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 msgr2=0x7f2dd81983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c970 tx=0x7f2dcc00ce30 comp rx=0 tx=0).stop 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 shutdown_connections 2024-09-15T23:32:31.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2dc80a3240 0x7f2dc80a5700 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd8106f00 0x7f2dd819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2dd8102780 0x7f2dd8198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 --2- 172.21.15.77:0/1882435853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2dd8101dd0 0x7f2dd81983e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 >> 172.21.15.77:0/1882435853 conn(0x7f2dd80fd8b0 msgr2=0x7f2dd80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 shutdown_connections 2024-09-15T23:32:31.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:31.720+0000 7f2ddef35640 1 -- 172.21.15.77:0/1882435853 wait complete. 2024-09-15T23:32:32.482 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:32:32.756 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:33.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:32:33.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:32:33.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.178 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:33.179 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:32 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:33.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:32 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 -- 172.21.15.77:0/2230218767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c101e10 msgr2=0x7fad0c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 --2- 172.21.15.77:0/2230218767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c101e10 0x7fad0c1021f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7facfc009900 tx=0x7facfc02a410 comp rx=0 tx=0).stop 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 -- 172.21.15.77:0/2230218767 shutdown_connections 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 --2- 172.21.15.77:0/2230218767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c106f40 0x7fad0c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 --2- 172.21.15.77:0/2230218767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c1027c0 0x7fad0c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 --2- 172.21.15.77:0/2230218767 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c101e10 0x7fad0c1021f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 -- 172.21.15.77:0/2230218767 >> 172.21.15.77:0/2230218767 conn(0x7fad0c0fd8d0 msgr2=0x7fad0c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 -- 172.21.15.77:0/2230218767 shutdown_connections 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.261+0000 7fad11fb2640 1 -- 172.21.15.77:0/2230218767 wait complete. 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 Processor -- start 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 -- start start 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c101e10 0x7fad0c19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 0x7fad0c19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c111fc0 con 0x7fad0c1027c0 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c111e40 con 0x7fad0c106f40 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad11fb2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c112140 con 0x7fad0c101e10 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48026/0 (socket says 172.21.15.77:48026) 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad0affd640 1 -- 172.21.15.77:0/3518753195 learned_addr learned my addr 172.21.15.77:0/3518753195 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:33.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c101e10 0x7fad0c19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.262+0000 7fad0bfff640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 0x7fad0c19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 -- 172.21.15.77:0/3518753195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c101e10 msgr2=0x7fad0c19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c101e10 0x7fad0c19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 -- 172.21.15.77:0/3518753195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 msgr2=0x7fad0c19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 0x7fad0c19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 -- 172.21.15.77:0/3518753195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0c19f650 con 0x7fad0c1027c0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0bfff640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 0x7fad0c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad0affd640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b4a0 tx=0x7fad0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad08ff9640 1 -- 172.21.15.77:0/3518753195 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00014070 con 0x7fad0c1027c0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad08ff9640 1 -- 172.21.15.77:0/3518753195 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad00010af0 con 0x7fad0c1027c0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad08ff9640 1 -- 172.21.15.77:0/3518753195 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad00017d10 con 0x7fad0c1027c0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad0c19f940 con 0x7fad0c1027c0 2024-09-15T23:32:33.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.263+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0c1a7220 con 0x7fad0c1027c0 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.266+0000 7fad1438b740 1 Processor -- start 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.266+0000 7fad1438b740 1 -- start start 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.266+0000 7fad08ff9640 1 -- 172.21.15.77:0/3518753195 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fad00017070 con 0x7fad0c1027c0 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 0x5603c06cca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603c06252e0 con 0x5603c06bf4a0 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5603c05ccce0 con 0x5603c06bfdc0 2024-09-15T23:32:33.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad1438b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5603c06212a0 con 0x5603c06ca680 2024-09-15T23:32:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48038/0 (socket says 172.21.15.77:48038) 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 -- 172.21.15.77:0/1108366041 learned_addr learned my addr 172.21.15.77:0/1108366041 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0affd640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 0x5603c06cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 -- 172.21.15.77:0/1108366041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 msgr2=0x5603c06cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 0x5603c06cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 -- 172.21.15.77:0/1108366041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 msgr2=0x5603c06ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0bfff640 1 -- 172.21.15.77:0/1108366041 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603c05b1440 con 0x5603c06bf4a0 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad0affd640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 0x5603c06cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.267+0000 7fad08ff9640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 0x7facf40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 0x7facf40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7fad08ff9640 1 -- 172.21.15.77:0/3518753195 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fad000ceff0 con 0x7fad0c1027c0 2024-09-15T23:32:33.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7fad0bfff640 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad04007f40 tx=0x7fad0400e7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511c5a6c747902a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7facf1ffb640 1 -- 172.21.15.77:0/1108366041 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04014070 con 0x5603c06bf4a0 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7facf1ffb640 1 -- 172.21.15.77:0/1108366041 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad04004d20 con 0x5603c06bf4a0 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.268+0000 7facf1ffb640 1 -- 172.21.15.77:0/1108366041 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad04005590 con 0x5603c06bf4a0 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- 172.21.15.77:0/1108366041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 msgr2=0x5603c06bf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 0x7facf40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7facfc000c00 tx=0x7facfc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad04007f40 tx=0x7fad0400e7e0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- 172.21.15.77:0/1108366041 shutdown_connections 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06ca680 0x5603c06cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 --2- 172.21.15.77:0/1108366041 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bf4a0 0x5603c06bf880 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- 172.21.15.77:0/1108366041 >> 172.21.15.77:0/1108366041 conn(0x5603c06bba30 msgr2=0x5603c06bbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- 172.21.15.77:0/1108366041 shutdown_connections 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- 172.21.15.77:0/1108366041 wait complete. 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.269+0000 7fad1438b740 1 -- start start 2024-09-15T23:32:33.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 Processor -- start 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06c7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5603c06cd250 con 0x5603c06bfdc0 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5603c05e0050 con 0x5603c06ca680 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5603c06cd3d0 con 0x5603c06bf4a0 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad1438b740 10 client.0 _ll_register_callbacks cb 0x5603c0620160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad0affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48044/0 (socket says 172.21.15.77:48044) 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad0affd640 1 -- 172.21.15.77:0/4169047226 learned_addr learned my addr 172.21.15.77:0/4169047226 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.270+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 -- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 msgr2=0x5603c06ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 -- 172.21.15.77:0/4169047226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 msgr2=0x5603c06c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.279 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 -- 172.21.15.77:0/4169047226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603c03963c0 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad0affd640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad0009b1b0 tx=0x7fad000047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386b8faf599f1467 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7faceaffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad0001e070 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fad00010ca0 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad04004d20 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fad000b9e60 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad1438b740 10 client.15450 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.271+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5603c06d8ca0 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fad04004d20 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fad00097890 con 0x5603c06bfdc0 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 10 client.15450 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:33.280 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 20 client.15450 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c06dc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 4 client.15450 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603c0632850 con 0x5603c06da160 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.272+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c06dc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.273+0000 7faceaffd640 10 client.15450 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.273+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c06dc590 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc13d62d0457be1e server_cookie=3748b70430acf0cf in_seq=0 out_seq=0 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.273+0000 7faceaffd640 1 -- 172.21.15.77:0/4169047226 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603c0632850 con 0x5603c06da160 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.273+0000 7faceaffd640 10 client.15450 handle_command_reply: tid=0 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 client.15450 shutdown 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 msgr2=0x5603c06c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fad0009b1b0 tx=0x7fad000047d0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 shutdown_connections 2024-09-15T23:32:33.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c06dc590 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7faceaffd640 0 client.15450 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06c72c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 --2- 172.21.15.77:0/4169047226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 >> 172.21.15.77:0/4169047226 conn(0x5603c06bba30 msgr2=0x5603c06c1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 shutdown_connections 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 1 -- 172.21.15.77:0/4169047226 wait complete. 2024-09-15T23:32:33.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.274+0000 7fad1438b740 20 client.15450 trim_cache size 0 max 16384 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.291+0000 7fad1438b740 1 Processor -- start 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.291+0000 7fad1438b740 1 -- start start 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.291+0000 7fad1438b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.291+0000 7fad1438b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06c9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.291+0000 7fad1438b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 0x5603c06e1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad1438b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1aef00 con 0x5603c06ca680 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad1438b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1b1780 con 0x5603c06bfdc0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad1438b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1af570 con 0x5603c06bf4a0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:60800/0 (socket says 172.21.15.77:60800) 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2374727281 learned_addr learned my addr 172.21.15.77:0/2374727281 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0bfff640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 0x5603c06e1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0affd640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2374727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 msgr2=0x5603c06c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2374727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 msgr2=0x5603c06e1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 0x5603c06e1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2374727281 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603c06ca380 con 0x5603c06bf4a0 2024-09-15T23:32:33.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.292+0000 7fad0bfff640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 0x5603c06e1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.293+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facfc004770 tx=0x7facfc03f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e397985a5ce19fc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.293+0000 7facf17fa640 1 -- 172.21.15.77:0/2374727281 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc058070 con 0x5603c06bf4a0 2024-09-15T23:32:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.293+0000 7facf17fa640 1 -- 172.21.15.77:0/2374727281 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc003ad0 con 0x5603c06bf4a0 2024-09-15T23:32:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.293+0000 7facf17fa640 1 -- 172.21.15.77:0/2374727281 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc035040 con 0x5603c06bf4a0 2024-09-15T23:32:33.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- 172.21.15.77:0/2374727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 msgr2=0x5603c06c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7facfc004770 tx=0x7facfc03f000 comp rx=0 tx=0).stop 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- 172.21.15.77:0/2374727281 shutdown_connections 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06ca680 0x5603c06e1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06bfdc0 0x5603c06c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 --2- 172.21.15.77:0/2374727281 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06c6b80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- 172.21.15.77:0/2374727281 >> 172.21.15.77:0/2374727281 conn(0x5603c06bba30 msgr2=0x5603c06c8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- 172.21.15.77:0/2374727281 shutdown_connections 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- 172.21.15.77:0/2374727281 wait complete. 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 -- start start 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.294+0000 7fad1438b740 1 Processor -- start 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1afc40 con 0x5603c06bfdc0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1b10b0 con 0x5603c06ca680 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fad0c1b0310 con 0x5603c06bf4a0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad1438b740 10 client.0 _ll_register_callbacks cb 0x7fad00017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:60808/0 (socket says 172.21.15.77:60808) 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2090965460 learned_addr learned my addr 172.21.15.77:0/2090965460 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0bfff640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2090965460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 msgr2=0x5603c06d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0affd640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2090965460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 msgr2=0x5603c06cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0b7fe640 1 -- 172.21.15.77:0/2090965460 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603c06d0d40 con 0x5603c06bf4a0 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0bfff640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:33.299 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.295+0000 7fad0affd640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7fad0b7fe640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facfc056040 tx=0x7facfc031940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c366093fb24055f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7faceaffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc058070 con 0x5603c06bf4a0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facfc003ad0 con 0x5603c06bf4a0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7facfc0035f0 con 0x5603c06bf4a0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7facfc003e90 con 0x5603c06bf4a0 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7fad1438b740 10 client.24994 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:33.300 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.296+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5603c0744d60 con 0x5603c06bf4a0 2024-09-15T23:32:33.301 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7facfc003ad0 con 0x5603c06bf4a0 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7facfc04b530 con 0x5603c06bf4a0 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 10 client.24994 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 10 client.24994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 20 client.24994 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c0747450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 4 client.24994 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603c062cd60 con 0x5603c06da160 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad0affd640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c0747450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7faceaffd640 10 client.24994 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.297+0000 7fad0affd640 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c0747450 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e21bcbdd95d474 server_cookie=864f3386da450db0 in_seq=0 out_seq=0 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7faceaffd640 1 -- 172.21.15.77:0/2090965460 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5603c062cd60 con 0x5603c06da160 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7faceaffd640 10 client.24994 handle_command_reply: tid=0 2024-09-15T23:32:33.302 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 client.24994 shutdown 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 msgr2=0x5603c06d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7facfc056040 tx=0x7facfc031940 comp rx=0 tx=0).stop 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 shutdown_connections 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5603c06da160 0x5603c0747450 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5603c06ca680 0x5603c06d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5603c06bfdc0 0x5603c06cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7faceaffd640 0 client.24994 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 --2- 172.21.15.77:0/2090965460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5603c06bf4a0 0x5603c06d2c80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.298+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 >> 172.21.15.77:0/2090965460 conn(0x5603c06bba30 msgr2=0x5603c06c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.299+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 shutdown_connections 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.299+0000 7fad1438b740 1 -- 172.21.15.77:0/2090965460 wait complete. 2024-09-15T23:32:33.303 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.299+0000 7fad1438b740 20 client.24994 trim_cache size 0 max 16384 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.299+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 msgr2=0x7facf40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.299+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 0x7facf40a5780 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7facfc000c00 tx=0x7facfc0058d0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 msgr2=0x7fad0c19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fad0000b4a0 tx=0x7fad0000b960 comp rx=0 tx=0).stop 2024-09-15T23:32:33.304 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 shutdown_connections 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7facf40a32c0 0x7facf40a5780 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fad0c106f40 0x7fad0c19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fad0c1027c0 0x7fad0c19abe0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 --2- 172.21.15.77:0/3518753195 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad0c101e10 0x7fad0c19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 >> 172.21.15.77:0/3518753195 conn(0x7fad0c0fd8d0 msgr2=0x7fad0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 shutdown_connections 2024-09-15T23:32:33.305 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:33.300+0000 7fad11fb2640 1 -- 172.21.15.77:0/3518753195 wait complete. 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: pgmap v379: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:32 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:32:34.004 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:32:34.004 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:32:34.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:33 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:32:34.340 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:34.366 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:33 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:32:34.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:33 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:32:34.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 -- 172.21.15.77:0/3144618141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101e20 msgr2=0x7f95a01056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:34.905 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 --2- 172.21.15.77:0/3144618141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101e20 0x7f95a01056b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f9590009900 tx=0x7f959002a3f0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 -- 172.21.15.77:0/3144618141 shutdown_connections 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 --2- 172.21.15.77:0/3144618141 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a010d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 --2- 172.21.15.77:0/3144618141 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101e20 0x7f95a01056b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 --2- 172.21.15.77:0/3144618141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101470 0x7f95a0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 -- 172.21.15.77:0/3144618141 >> 172.21.15.77:0/3144618141 conn(0x7f95a0077230 msgr2=0x7f95a00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 -- 172.21.15.77:0/3144618141 shutdown_connections 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.888+0000 7f95a74f1640 1 -- 172.21.15.77:0/3144618141 wait complete. 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 Processor -- start 2024-09-15T23:32:34.906 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 -- start start 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101e20 0x7f95a01967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a019ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010fd40 con 0x7f95a0101470 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010fbc0 con 0x7f95a0101e20 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a74f1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f95a010fec0 con 0x7f95a0105de0 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a528d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a528d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48082/0 (socket says 172.21.15.77:48082) 2024-09-15T23:32:34.907 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a528d640 1 -- 172.21.15.77:0/1263214608 learned_addr learned my addr 172.21.15.77:0/1263214608 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a4a8c640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101e20 0x7f95a01967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.889+0000 7f95a5a8e640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a019ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 -- 172.21.15.77:0/1263214608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 msgr2=0x7f95a019ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a019ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 -- 172.21.15.77:0/1263214608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101e20 msgr2=0x7f95a01967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101e20 0x7f95a01967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 -- 172.21.15.77:0/1263214608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a019b250 con 0x7f95a0101470 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a5a8e640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a528d640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f959c009860 tx=0x7f959c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c004020 con 0x7f95a0101470 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a019b540 con 0x7f95a0101470 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f959c00ed90 con 0x7f95a0101470 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c003b20 con 0x7f95a0101470 2024-09-15T23:32:34.908 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.890+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01a7230 con 0x7f95a0101470 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.891+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0101850 con 0x7f95a0101470 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.892+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f959c01b020 con 0x7f95a0101470 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.893+0000 7f95967fc640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 0x7f958c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.893+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f959c0cfb20 con 0x7f95a0101470 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.893+0000 7f95a4a8c640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 0x7f958c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.894+0000 7f95a4a8c640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 0x7f958c0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f95a0103730 tx=0x7f9590005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:34.909 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:34.897+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f959c0cfe20 con 0x7f95a0101470 2024-09-15T23:32:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:32:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:32:35.134 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:34 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:32:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:32:35.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:34 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.229+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95a0108fc0 con 0x7f95a0101470 2024-09-15T23:32:35.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.230+0000 7f95967fc640 1 -- 172.21.15.77:0/1263214608 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f959c022060 con 0x7f95a0101470 2024-09-15T23:32:35.232 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:32:35.232 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:32:35.232 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:32:35.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 msgr2=0x7f958c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 0x7f958c0a5700 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f95a0103730 tx=0x7f9590005a20 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 msgr2=0x7f95a01962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f959c009860 tx=0x7f959c009d20 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 shutdown_connections 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f958c0a3240 0x7f958c0a5700 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a0105de0 0x7f95a019ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95a0101e20 0x7f95a01967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 --2- 172.21.15.77:0/1263214608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f95a0101470 0x7f95a01962a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:35.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 >> 172.21.15.77:0/1263214608 conn(0x7f95a0077230 msgr2=0x7f95a00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:35.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 shutdown_connections 2024-09-15T23:32:35.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:35.233+0000 7f95a74f1640 1 -- 172.21.15.77:0/1263214608 wait complete. 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: pgmap v380: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:32:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:34 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:32:35.979 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:32:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:35 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1263214608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:36.248 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:36.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:35 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1263214608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:36.368 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:35 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1263214608' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.777+0000 7fa19fda2640 1 -- 172.21.15.77:0/1362556677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 msgr2=0x7fa198101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.777+0000 7fa19fda2640 1 --2- 172.21.15.77:0/1362556677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa198101200 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa194009950 tx=0x7fa19402a4f0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 -- 172.21.15.77:0/1362556677 shutdown_connections 2024-09-15T23:32:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 --2- 172.21.15.77:0/1362556677 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102ef0 0x7fa19810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 --2- 172.21.15.77:0/1362556677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102570 0x7fa1981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 --2- 172.21.15.77:0/1362556677 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa198101200 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 -- 172.21.15.77:0/1362556677 >> 172.21.15.77:0/1362556677 conn(0x7fa1980fc7d0 msgr2=0x7fa1980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 -- 172.21.15.77:0/1362556677 shutdown_connections 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.778+0000 7fa19fda2640 1 -- 172.21.15.77:0/1362556677 wait complete. 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.779+0000 7fa19fda2640 1 Processor -- start 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.779+0000 7fa19fda2640 1 -- start start 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.779+0000 7fa19fda2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48096/0 (socket says 172.21.15.77:48096) 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19fda2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 0x7fa198197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 -- 172.21.15.77:0/762580702 learned_addr learned my addr 172.21.15.77:0/762580702 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:36.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 0x7fa19819bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa198110f80 con 0x7fa198100e20 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa198110e00 con 0x7fa198102ef0 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa198111100 con 0x7fa198102570 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19d33d640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 0x7fa198197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19e33f640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 0x7fa19819bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 -- 172.21.15.77:0/762580702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 msgr2=0x7fa198197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 0x7fa198197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 -- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 msgr2=0x7fa19819bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 0x7fa19819bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19db3e640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa19819c370 con 0x7fa198100e20 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19d33d640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 0x7fa198197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:36.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.780+0000 7fa19e33f640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 0x7fa19819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:36.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa19db3e640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa194005ab0 tx=0x7fa1940314c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa18effd640 1 -- 172.21.15.77:0/762580702 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194040070 con 0x7fa198100e20 2024-09-15T23:32:36.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa19819c600 con 0x7fa198100e20 2024-09-15T23:32:36.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1981a3f40 con 0x7fa198100e20 2024-09-15T23:32:36.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa18effd640 1 -- 172.21.15.77:0/762580702 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa194004740 con 0x7fa198100e20 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.781+0000 7fa18effd640 1 -- 172.21.15.77:0/762580702 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194035020 con 0x7fa198100e20 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.783+0000 7fa1a217b740 1 Processor -- start 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 -- start start 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e66b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e678760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56120e5d12f0 con 0x56120e66b5d0 2024-09-15T23:32:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56120e578cf0 con 0x56120e66cb40 2024-09-15T23:32:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa1a217b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56120e5cd2b0 con 0x56120e676370 2024-09-15T23:32:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa18effd640 1 -- 172.21.15.77:0/762580702 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa194043070 con 0x7fa198100e20 2024-09-15T23:32:36.804 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa19db3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa19db3e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48102/0 (socket says 172.21.15.77:48102) 2024-09-15T23:32:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa19db3e640 1 -- 172.21.15.77:0/369237527 learned_addr learned my addr 172.21.15.77:0/369237527 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa19e33f640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e66b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.784+0000 7fa19d33d640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e678760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.805 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 -- 172.21.15.77:0/369237527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 msgr2=0x56120e678760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e678760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 -- 172.21.15.77:0/369237527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 msgr2=0x56120e66ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.806 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 -- 172.21.15.77:0/369237527 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120e55d3a0 con 0x56120e66cb40 2024-09-15T23:32:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19db3e640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19d33d640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e678760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa18effd640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 0x7fa1840a7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19e33f640 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e66b090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e40 tx=0x7fa19000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b179b8089666425 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.807 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa19db3e640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 0x7fa1840a7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa18effd640 1 -- 172.21.15.77:0/762580702 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa1940f0590 con 0x7fa198100e20 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa183fff640 1 -- 172.21.15.77:0/369237527 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190003b70 con 0x56120e66cb40 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa183fff640 1 -- 172.21.15.77:0/369237527 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa190003d10 con 0x56120e66cb40 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.785+0000 7fa183fff640 1 -- 172.21.15.77:0/369237527 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1900119a0 con 0x56120e66cb40 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 -- 172.21.15.77:0/369237527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 msgr2=0x56120e66b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa19db3e640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 0x7fa1840a7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa19402aab0 tx=0x7fa1940f3f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e66b090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa190009e40 tx=0x7fa19000f730 comp rx=0 tx=0).stop 2024-09-15T23:32:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 -- 172.21.15.77:0/369237527 shutdown_connections 2024-09-15T23:32:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e678760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66b5d0 0x56120e66ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 --2- 172.21.15.77:0/369237527 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e66b090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.786+0000 7fa1a217b740 1 -- 172.21.15.77:0/369237527 >> 172.21.15.77:0/369237527 conn(0x56120e634310 msgr2=0x56120e667c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.787+0000 7fa1a217b740 1 -- 172.21.15.77:0/369237527 shutdown_connections 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.787+0000 7fa1a217b740 1 -- 172.21.15.77:0/369237527 wait complete. 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.787+0000 7fa1a217b740 1 -- start start 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.787+0000 7fa1a217b740 1 Processor -- start 2024-09-15T23:32:36.810 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66b5d0 0x56120e675ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e6734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56120e679070 con 0x56120e676370 2024-09-15T23:32:36.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56120e58c060 con 0x56120e66cb40 2024-09-15T23:32:36.811 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56120e6791f0 con 0x56120e66b5d0 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa1a217b740 10 client.0 _ll_register_callbacks cb 0x56120e2df8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:36574/0 (socket says 172.21.15.77:36574) 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.788+0000 7fa19d33d640 1 -- 172.21.15.77:0/94750498 learned_addr learned my addr 172.21.15.77:0/94750498 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 -- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66b5d0 msgr2=0x56120e675ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19e33f640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66b5d0 0x56120e675ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19e33f640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e6734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66b5d0 0x56120e675ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 -- 172.21.15.77:0/94750498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 msgr2=0x56120e6734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e6734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 -- 172.21.15.77:0/94750498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120e3423c0 con 0x56120e66cb40 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19e33f640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e6734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa19d33d640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa188012b10 tx=0x7fa18800f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5067d2a85f0aad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa1817fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800fb40 con 0x56120e66cb40 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa18800fce0 con 0x56120e66cb40 2024-09-15T23:32:36.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.789+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa190003d10 con 0x56120e66cb40 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa188010430 con 0x56120e66cb40 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 10 client.24968 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56120e684ba0 con 0x56120e66cb40 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa190003d10 con 0x56120e66cb40 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1880266a0 con 0x56120e66cb40 2024-09-15T23:32:36.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 10 client.24968 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:36.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 10 client.24968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:36.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 20 client.24968 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:36.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e686070 0x56120e6884c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 4 client.24968 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:36.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56120e5de860 con 0x56120e686070 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.790+0000 7fa19e33f640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e686070 0x56120e6884c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.791+0000 7fa1817fa640 10 client.24968 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.791+0000 7fa19e33f640 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e686070 0x56120e6884c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d9fdd561e7a0104 server_cookie=cce58935af936ca0 in_seq=0 out_seq=0 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1817fa640 1 -- 172.21.15.77:0/94750498 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56120e5de860 con 0x56120e686070 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1817fa640 10 client.24968 handle_command_reply: tid=0 2024-09-15T23:32:36.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 client.24968 shutdown 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 msgr2=0x56120e672f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa188012b10 tx=0x7fa18800f3c0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 shutdown_connections 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e686070 0x56120e6884c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1817fa640 0 client.24968 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:36.818 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e6734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66cb40 0x56120e672f90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 --2- 172.21.15.77:0/94750498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66b5d0 0x56120e675ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 >> 172.21.15.77:0/94750498 conn(0x56120e634310 msgr2=0x56120e66d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 shutdown_connections 2024-09-15T23:32:36.819 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 1 -- 172.21.15.77:0/94750498 wait complete. 2024-09-15T23:32:36.820 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.792+0000 7fa1a217b740 20 client.24968 trim_cache size 0 max 16384 2024-09-15T23:32:36.830 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 Processor -- start 2024-09-15T23:32:36.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 -- start start 2024-09-15T23:32:36.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e66e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 0x56120e66e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e68ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.831 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c011f90 con 0x56120e66cb40 2024-09-15T23:32:36.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c014810 con 0x56120e66b5d0 2024-09-15T23:32:36.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.805+0000 7fa1a217b740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c012600 con 0x56120e676370 2024-09-15T23:32:36.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 0x56120e66e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 0x56120e66e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:48122/0 (socket says 172.21.15.77:48122) 2024-09-15T23:32:36.832 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19d33d640 1 -- 172.21.15.77:0/2224359093 learned_addr learned my addr 172.21.15.77:0/2224359093 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e68ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e66e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 -- 172.21.15.77:0/2224359093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 msgr2=0x56120e66e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e66e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 -- 172.21.15.77:0/2224359093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 msgr2=0x56120e66e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.833 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 0x56120e66e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 -- 172.21.15.77:0/2224359093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56120e688b40 con 0x56120e676370 2024-09-15T23:32:36.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa19e33f640 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e68ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x56120e688d40 tx=0x7fa19001d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6364fb59e7d12291 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.806+0000 7fa1837fe640 1 -- 172.21.15.77:0/2224359093 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190013110 con 0x56120e676370 2024-09-15T23:32:36.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1837fe640 1 -- 172.21.15.77:0/2224359093 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa190013dd0 con 0x56120e676370 2024-09-15T23:32:36.834 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1837fe640 1 -- 172.21.15.77:0/2224359093 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa190011b50 con 0x56120e676370 2024-09-15T23:32:36.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 -- 172.21.15.77:0/2224359093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 msgr2=0x56120e68ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e68ddd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x56120e688d40 tx=0x7fa19001d040 comp rx=0 tx=0).stop 2024-09-15T23:32:36.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 -- 172.21.15.77:0/2224359093 shutdown_connections 2024-09-15T23:32:36.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e676370 0x56120e68ddd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.835 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e66cb40 0x56120e66e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 --2- 172.21.15.77:0/2224359093 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e66e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.807+0000 7fa1a217b740 1 -- 172.21.15.77:0/2224359093 >> 172.21.15.77:0/2224359093 conn(0x56120e634310 msgr2=0x56120e675010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.808+0000 7fa1a217b740 1 -- 172.21.15.77:0/2224359093 shutdown_connections 2024-09-15T23:32:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.808+0000 7fa1a217b740 1 -- 172.21.15.77:0/2224359093 wait complete. 2024-09-15T23:32:36.836 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.808+0000 7fa1a217b740 1 -- start start 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.808+0000 7fa1a217b740 1 Processor -- start 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e67e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa1a217b740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e67b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa1a217b740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c012cd0 con 0x56120e676370 2024-09-15T23:32:36.837 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa19d33d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:60892/0 (socket says 172.21.15.77:60892) 2024-09-15T23:32:36.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.809+0000 7fa19d33d640 1 -- 172.21.15.77:0/1358296807 learned_addr learned my addr 172.21.15.77:0/1358296807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:36.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c014140 con 0x56120e66b5d0 2024-09-15T23:32:36.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19e33f640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e67b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.838 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19e33f640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e67e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0133a0 con 0x56120e66cb40 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1a217b740 10 client.0 _ll_register_callbacks cb 0x7fa188009ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 -- 172.21.15.77:0/1358296807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 msgr2=0x56120e67e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e67e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 -- 172.21.15.77:0/1358296807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 msgr2=0x56120e67b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:36.839 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e67b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56120e67ba20 con 0x56120e66cb40 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19e33f640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e67e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa19d33d640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa188026b40 tx=0x7fa18800fe60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94f25ca113778ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1817fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1880267c0 con 0x56120e66cb40 2024-09-15T23:32:36.840 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa190013dd0 con 0x56120e66cb40 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.810+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa188005070 con 0x56120e66cb40 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa1880052b0 con 0x56120e66cb40 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 10 client.25015 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56120e6f1510 con 0x56120e66cb40 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa190013dd0 con 0x56120e66cb40 2024-09-15T23:32:36.841 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa1880105d0 con 0x56120e66cb40 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 10 client.25015 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 10 client.25015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 20 client.25015 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e6f1c80 0x56120e6f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 4 client.25015 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:32:36.842 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.811+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56120e5d8d70 con 0x56120e6f1c80 2024-09-15T23:32:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.812+0000 7fa19e33f640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e6f1c80 0x56120e6f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa19e33f640 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e6f1c80 0x56120e6f40a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eedc217430c3cead server_cookie=8a684c58e139f63e in_seq=0 out_seq=0 2024-09-15T23:32:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1817fa640 10 client.25015 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1817fa640 1 -- 172.21.15.77:0/1358296807 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56120e5d8d70 con 0x56120e6f1c80 2024-09-15T23:32:36.843 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1817fa640 10 client.25015 handle_command_reply: tid=0 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 client.25015 shutdown 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 msgr2=0x56120e67ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa188026b40 tx=0x7fa18800fe60 comp rx=0 tx=0).stop 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 shutdown_connections 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56120e6f1c80 0x56120e6f40a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.844 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1817fa640 0 client.25015 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56120e676370 0x56120e67b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56120e66cb40 0x56120e67ea50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 --2- 172.21.15.77:0/1358296807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56120e66b5d0 0x56120e67e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 >> 172.21.15.77:0/1358296807 conn(0x56120e634310 msgr2=0x56120e666310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 shutdown_connections 2024-09-15T23:32:36.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.813+0000 7fa1a217b740 1 -- 172.21.15.77:0/1358296807 wait complete. 2024-09-15T23:32:36.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa1a217b740 20 client.25015 trim_cache size 0 max 16384 2024-09-15T23:32:36.846 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:32:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 msgr2=0x7fa1840a7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 0x7fa1840a7910 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa19402aab0 tx=0x7fa1940f3f90 comp rx=0 tx=0).stop 2024-09-15T23:32:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 msgr2=0x7fa1981973c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fa194005ab0 tx=0x7fa1940314c0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 shutdown_connections 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa1840a5450 0x7fa1840a7910 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa198102ef0 0x7fa19819bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa198102570 0x7fa198197900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 --2- 172.21.15.77:0/762580702 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa198100e20 0x7fa1981973c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 >> 172.21.15.77:0/762580702 conn(0x7fa1980fc7d0 msgr2=0x7fa1980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 shutdown_connections 2024-09-15T23:32:36.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:36.814+0000 7fa19fda2640 1 -- 172.21.15.77:0/762580702 wait complete. 2024-09-15T23:32:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:36 smithi159 ceph-mon[35472]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:32:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:36 smithi155 ceph-mon[35631]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:32:37.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:36 smithi077 ceph-mon[30968]: pgmap v381: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 5 op/s 2024-09-15T23:32:38.477 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:32:38.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:32:38.856 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:38 smithi159 ceph-mon[35472]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-15T23:32:39.248 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:38 smithi077 ceph-mon[30968]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/816406116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c102d90 msgr2=0x7ff99c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/816406116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c102d90 0x7ff99c103170 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009930 tx=0x7ff98c02a420 comp rx=0 tx=0).stop 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/816406116 shutdown_connections 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/816406116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c108290 0x7ff99c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/816406116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c103740 0x7ff99c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.357 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/816406116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c102d90 0x7ff99c103170 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/816406116 >> 172.21.15.77:0/816406116 conn(0x7ff99c0fc7d0 msgr2=0x7ff99c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/816406116 shutdown_connections 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.338+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/816406116 wait complete. 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 Processor -- start 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 -- start start 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 0x7ff99c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 0x7ff99c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff99b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 0x7ff99c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff99b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 0x7ff99c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:38304/0 (socket says 172.21.15.77:38304) 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44952/0 (socket says 172.21.15.77:44952) 2024-09-15T23:32:39.358 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c112090 con 0x7ff99c103740 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c111f10 con 0x7ff99c108290 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c112210 con 0x7ff99c102d90 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.339+0000 7ff99b7fe640 1 -- 172.21.15.77:0/1741534149 learned_addr learned my addr 172.21.15.77:0/1741534149 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99bfff640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 0x7ff99c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 -- 172.21.15.77:0/1741534149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 msgr2=0x7ff99c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 0x7ff99c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 -- 172.21.15.77:0/1741534149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 msgr2=0x7ff99c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 0x7ff99c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c19d550 con 0x7ff99c103740 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99bfff640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 0x7ff99c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff99affd640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff99000e9c0 tx=0x7ff99000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff998ff9640 1 -- 172.21.15.77:0/1741534149 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99000ccc0 con 0x7ff99c103740 2024-09-15T23:32:39.359 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c19d840 con 0x7ff99c103740 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c1a5120 con 0x7ff99c103740 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff998ff9640 1 -- 172.21.15.77:0/1741534149 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff990010910 con 0x7ff99c103740 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.340+0000 7ff998ff9640 1 -- 172.21.15.77:0/1741534149 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900188e0 con 0x7ff99c103740 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.343+0000 7ff9a41e3740 1 Processor -- start 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 -- start start 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09af560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559df0903280 con 0x559df099e340 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559df08aab10 con 0x559df09ad170 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559df08ff240 con 0x559df099da20 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.360 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:38318/0 (socket says 172.21.15.77:38318) 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 -- 172.21.15.77:0/2588343867 learned_addr learned my addr 172.21.15.77:0/2588343867 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 -- 172.21.15.77:0/2588343867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 msgr2=0x559df09af560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09af560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 -- 172.21.15.77:0/2588343867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 msgr2=0x559df09acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff99bfff640 1 -- 172.21.15.77:0/2588343867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df08b71f0 con 0x559df099da20 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.344+0000 7ff998ff9640 1 -- 172.21.15.77:0/1741534149 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff990010ac0 con 0x7ff99c103740 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.345+0000 7ff99bfff640 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff994009fd0 tx=0x7ff994010860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=facf3f8b0d705295 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.345+0000 7ff981ffb640 1 -- 172.21.15.77:0/2588343867 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994011700 con 0x559df099da20 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.345+0000 7ff981ffb640 1 -- 172.21.15.77:0/2588343867 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff994011d80 con 0x559df099da20 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.345+0000 7ff981ffb640 1 -- 172.21.15.77:0/2588343867 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99400e3c0 con 0x559df099da20 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.345+0000 7ff998ff9640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 0x7ff9840a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.361 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff998ff9640 1 -- 172.21.15.77:0/1741534149 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff9900d0300 con 0x7ff99c103740 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 0x7ff9840a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 -- 172.21.15.77:0/2588343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 msgr2=0x559df099de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff994009fd0 tx=0x7ff994010860 comp rx=0 tx=0).stop 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 -- 172.21.15.77:0/2588343867 shutdown_connections 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.362 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/2588343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df099de00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 -- 172.21.15.77:0/2588343867 >> 172.21.15.77:0/2588343867 conn(0x559df099a110 msgr2=0x559df099a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 -- 172.21.15.77:0/2588343867 shutdown_connections 2024-09-15T23:32:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.346+0000 7ff9a41e3740 1 -- 172.21.15.77:0/2588343867 wait complete. 2024-09-15T23:32:39.505 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 0x7ff9840a5800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff98c005940 tx=0x7ff98c0058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 -- start start 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 Processor -- start 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df09aa140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.506 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559df09afd40 con 0x559df099e340 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559df08bdf10 con 0x559df09ad170 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559df09afec0 con 0x559df099da20 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff9a41e3740 10 client.0 _ll_register_callbacks cb 0x559df0886a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44972/0 (socket says 172.21.15.77:44972) 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.347+0000 7ff99affd640 1 -- 172.21.15.77:0/519676880 learned_addr learned my addr 172.21.15.77:0/519676880 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df09aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99bfff640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 -- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 msgr2=0x559df09aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df09aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 -- 172.21.15.77:0/519676880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 msgr2=0x559df09aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09aabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 -- 172.21.15.77:0/519676880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df06746a0 con 0x559df099e340 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff99affd640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff990098f00 tx=0x7ff99009c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7258a6056a968ba0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff97affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900bc040 con 0x559df099e340 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff994011d80 con 0x559df099e340 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff99009bb80 con 0x559df099e340 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff99009c530 con 0x559df099e340 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff9a41e3740 10 client.15480 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:39.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.348+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559df09a0810 con 0x559df099e340 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff994011d80 con 0x559df099e340 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff99009b3f0 con 0x559df099e340 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 10 client.15480 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 20 client.15480 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df09a1b60 0x559df09a3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 4 client.15480 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559df09107f0 con 0x559df09a1b60 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.349+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df09a1b60 0x559df09a3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.350+0000 7ff97affd640 10 client.15480 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:39.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.350+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df09a1b60 0x559df09a3fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcd53df6b45c1d49 server_cookie=946b35adc377f215 in_seq=0 out_seq=0 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.350+0000 7ff97affd640 1 -- 172.21.15.77:0/519676880 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559df09107f0 con 0x559df09a1b60 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.350+0000 7ff97affd640 10 client.15480 handle_command_reply: tid=0 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.350+0000 7ff9a41e3740 1 client.15480 shutdown 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 msgr2=0x559df09aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff990098f00 tx=0x7ff99009c1a0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 shutdown_connections 2024-09-15T23:32:39.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df09a1b60 0x559df09a3fa0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df09ad170 0x559df09aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df099e340 0x559df09aa680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/519676880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df099da20 0x559df09aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 >> 172.21.15.77:0/519676880 conn(0x559df099a110 msgr2=0x559df0999410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff97affd640 0 client.15480 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 shutdown_connections 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 1 -- 172.21.15.77:0/519676880 wait complete. 2024-09-15T23:32:39.511 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.351+0000 7ff9a41e3740 20 client.15480 trim_cache size 0 max 16384 2024-09-15T23:32:39.512 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:38 smithi155 ceph-mon[35631]: pgmap v382: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 Processor -- start 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 -- start start 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09c09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1aabc0 con 0x559df09ad170 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1ad440 con 0x559df099da20 2024-09-15T23:32:39.517 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1ab230 con 0x559df09a7e40 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff99affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44980/0 (socket says 172.21.15.77:44980) 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff99affd640 1 -- 172.21.15.77:0/3803698433 learned_addr learned my addr 172.21.15.77:0/3803698433 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.369+0000 7ff99bfff640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09c09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 -- 172.21.15.77:0/3803698433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 msgr2=0x559df09c09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09c09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 -- 172.21.15.77:0/3803698433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 msgr2=0x559df09a73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09a73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 -- 172.21.15.77:0/3803698433 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df099e170 con 0x559df09ad170 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99bfff640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:39.518 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff99affd640 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff99009c230 tx=0x7ff99000efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fde0a27f563228e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff9817fa640 1 -- 172.21.15.77:0/3803698433 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9900bc070 con 0x559df09ad170 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff9817fa640 1 -- 172.21.15.77:0/3803698433 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9900a51a0 con 0x559df09ad170 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.370+0000 7ff9817fa640 1 -- 172.21.15.77:0/3803698433 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff990098280 con 0x559df09ad170 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3803698433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 msgr2=0x559df09a7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7ff99009c230 tx=0x7ff99000efb0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3803698433 shutdown_connections 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09c09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09a7900 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3803698433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09a73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3803698433 >> 172.21.15.77:0/3803698433 conn(0x559df099a110 msgr2=0x559df09b8970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.519 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3803698433 shutdown_connections 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.371+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3803698433 wait complete. 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 -- start start 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 Processor -- start 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09c0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09bf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1ab900 con 0x559df09ad170 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1acd70 con 0x559df099da20 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c1abfd0 con 0x559df09a7e40 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.372+0000 7ff9a41e3740 10 client.0 _ll_register_callbacks cb 0x7ff990098110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:44996/0 (socket says 172.21.15.77:44996) 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 -- 172.21.15.77:0/3940618379 learned_addr learned my addr 172.21.15.77:0/3940618379 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09c0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99affd640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09bf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 -- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 msgr2=0x559df09bf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09bf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 -- 172.21.15.77:0/3940618379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 msgr2=0x559df09c0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09c0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 -- 172.21.15.77:0/3940618379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df09bfd10 con 0x559df09ad170 2024-09-15T23:32:39.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff99bfff640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff994009aa0 tx=0x7ff994004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70587a30401bdf01 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff97affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99402c060 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.373+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff9940119d0 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9900a51a0 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff994033050 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 10 client.15486 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559df0a24800 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9900a51a0 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff994026070 con 0x559df09ad170 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 10 client.15486 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:39.522 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 20 client.15486 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df0a24c50 0x559df0a27070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 4 client.15486 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.374+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559df090ad00 con 0x559df0a24c50 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.375+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df0a24c50 0x559df0a27070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.375+0000 7ff97affd640 10 client.15486 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.375+0000 7ff99b7fe640 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df0a24c50 0x559df0a27070 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b755ddfff237dc server_cookie=78fba76a3f6ba8a1 in_seq=0 out_seq=0 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.376+0000 7ff97affd640 1 -- 172.21.15.77:0/3940618379 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559df090ad00 con 0x559df0a24c50 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.376+0000 7ff97affd640 10 client.15486 handle_command_reply: tid=0 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.376+0000 7ff9a41e3740 1 client.15486 shutdown 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 msgr2=0x559df09bf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff994009aa0 tx=0x7ff994004f90 comp rx=0 tx=0).stop 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 shutdown_connections 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559df0a24c50 0x559df0a27070 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.523 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff97affd640 0 client.15486 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559df09ad170 0x559df09bf7d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559df09a7e40 0x559df09bf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 --2- 172.21.15.77:0/3940618379 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df099da20 0x559df09c0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 >> 172.21.15.77:0/3940618379 conn(0x559df099a110 msgr2=0x559df099f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 shutdown_connections 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 1 -- 172.21.15.77:0/3940618379 wait complete. 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.377+0000 7ff9a41e3740 20 client.15486 trim_cache size 0 max 16384 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:32:39.524 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "f2eac10c-b33c-4c87-a025-e9a6da5a6475", 2024-09-15T23:32:39.525 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:32:39.525 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:39.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 msgr2=0x7ff9840a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 0x7ff9840a5800 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff98c005940 tx=0x7ff98c0058b0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 msgr2=0x7ff99c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff99000e9c0 tx=0x7ff99000ee80 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 shutdown_connections 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff9840a3340 0x7ff9840a5800 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff99c108290 0x7ff99c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff99c103740 0x7ff99c198ae0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 --2- 172.21.15.77:0/1741534149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff99c102d90 0x7ff99c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 >> 172.21.15.77:0/1741534149 conn(0x7ff99c0fc7d0 msgr2=0x7ff99c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 shutdown_connections 2024-09-15T23:32:39.526 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:39.378+0000 7ff9a1e0a640 1 -- 172.21.15.77:0/1741534149 wait complete. 2024-09-15T23:32:40.231 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:32:40.318 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 -- 172.21.15.77:0/3464330028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 msgr2=0x7f033c108610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 --2- 172.21.15.77:0/3464330028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c108610 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0334009ca0 tx=0x7f033402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 -- 172.21.15.77:0/3464330028 shutdown_connections 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 --2- 172.21.15.77:0/3464330028 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c108610 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 --2- 172.21.15.77:0/3464330028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1013c0 0x7f033c101840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 --2- 172.21.15.77:0/3464330028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1001d0 0x7f033c1005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 -- 172.21.15.77:0/3464330028 >> 172.21.15.77:0/3464330028 conn(0x7f033c0fb930 msgr2=0x7f033c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 -- 172.21.15.77:0/3464330028 shutdown_connections 2024-09-15T23:32:40.319 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.317+0000 7f0341eb7640 1 -- 172.21.15.77:0/3464330028 wait complete. 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.318+0000 7f0341eb7640 1 Processor -- start 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.318+0000 7f0341eb7640 1 -- start start 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1001d0 0x7f033c197cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1013c0 0x7f033c198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f033c10be90 con 0x7f033c101d80 2024-09-15T23:32:40.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f033c10bd10 con 0x7f033c1001d0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f0341eb7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f033c10c010 con 0x7f033c1013c0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45002/0 (socket says 172.21.15.77:45002) 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 -- 172.21.15.77:0/1948161365 learned_addr learned my addr 172.21.15.77:0/1948161365 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033b7fe640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1001d0 0x7f033c197cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033affd640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1013c0 0x7f033c198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 -- 172.21.15.77:0/1948161365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1013c0 msgr2=0x7f033c198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1013c0 0x7f033c198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 -- 172.21.15.77:0/1948161365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1001d0 msgr2=0x7f033c197cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1001d0 0x7f033c197cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.319+0000 7f033bfff640 1 -- 172.21.15.77:0/1948161365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c19f900 con 0x7f033c101d80 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.320+0000 7f033bfff640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f03340098d0 tx=0x7f033402f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.320+0000 7f0338ff9640 1 -- 172.21.15.77:0/1948161365 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033402fc30 con 0x7f033c101d80 2024-09-15T23:32:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.320+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f033c19fb90 con 0x7f033c101d80 2024-09-15T23:32:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.320+0000 7f0338ff9640 1 -- 172.21.15.77:0/1948161365 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0334003e50 con 0x7f033c101d80 2024-09-15T23:32:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.320+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f033c1a0130 con 0x7f033c101d80 2024-09-15T23:32:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.321+0000 7f0338ff9640 1 -- 172.21.15.77:0/1948161365 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340047b0 con 0x7f033c101d80 2024-09-15T23:32:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.323+0000 7f0344c51740 1 Processor -- start 2024-09-15T23:32:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0338ff9640 1 -- 172.21.15.77:0/1948161365 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f03340305c0 con 0x7f033c101d80 2024-09-15T23:32:40.325 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 -- start start 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be6f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be71c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55603bdc92f0 con 0x55603be6f770 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55603bd71270 con 0x55603be69da0 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f0344c51740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55603bdc52b0 con 0x55603be6a6e0 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f033affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f033affd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:48614/0 (socket says 172.21.15.77:48614) 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f033affd640 1 -- 172.21.15.77:0/26415880 learned_addr learned my addr 172.21.15.77:0/26415880 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.324+0000 7f033affd640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be71c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033b7fe640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be6f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 -- 172.21.15.77:0/26415880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 msgr2=0x55603be6f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be6f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 -- 172.21.15.77:0/26415880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 msgr2=0x55603be71c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be71c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 -- 172.21.15.77:0/26415880 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603bd70340 con 0x55603be69da0 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033b7fe640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be6f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f033affd640 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0330011810 tx=0x7f033000a780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2181188b3ee0ded8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.325+0000 7f0321ffb640 1 -- 172.21.15.77:0/26415880 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0330011e50 con 0x55603be69da0 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.326+0000 7f0338ff9640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 0x7f03240a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.326+0000 7f0321ffb640 1 -- 172.21.15.77:0/26415880 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0330005020 con 0x55603be69da0 2024-09-15T23:32:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.326+0000 7f0321ffb640 1 -- 172.21.15.77:0/26415880 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03300049e0 con 0x55603be69da0 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.326+0000 7f0338ff9640 1 -- 172.21.15.77:0/1948161365 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f03340f1280 con 0x7f033c101d80 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.326+0000 7f033b7fe640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 0x7f03240a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- 172.21.15.77:0/26415880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 msgr2=0x55603be6a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f033b7fe640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 0x7f03240a57b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55603be6b110 tx=0x7f032c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0330011810 tx=0x7f033000a780 comp rx=0 tx=0).stop 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- 172.21.15.77:0/26415880 shutdown_connections 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be71c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be6f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 --2- 172.21.15.77:0/26415880 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be6a1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- 172.21.15.77:0/26415880 >> 172.21.15.77:0/26415880 conn(0x55603be61000 msgr2=0x55603be61400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- 172.21.15.77:0/26415880 shutdown_connections 2024-09-15T23:32:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- 172.21.15.77:0/26415880 wait complete. 2024-09-15T23:32:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 -- start start 2024-09-15T23:32:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.327+0000 7f0344c51740 1 Processor -- start 2024-09-15T23:32:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be74020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be74560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55603be72740 con 0x55603be6f770 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55603bd52290 con 0x55603be69da0 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55603be728c0 con 0x55603be6a6e0 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f0344c51740 10 client.0 _ll_register_callbacks cb 0x55603bd83140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45010/0 (socket says 172.21.15.77:45010) 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 -- 172.21.15.77:0/1638229408 learned_addr learned my addr 172.21.15.77:0/1638229408 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 -- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 msgr2=0x55603be74560 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be74560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 -- 172.21.15.77:0/1638229408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 msgr2=0x55603be74020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be74020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.328+0000 7f033bfff640 1 -- 172.21.15.77:0/1638229408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603badc210 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f033bfff640 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f03340c5d70 tx=0x7f03340b9840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b35a99f135066a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03340bcf90 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f0334004b40 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0330005020 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f03340bb770 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 10 client.15498 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55603bba8620 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0334036040 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f03340d1b50 con 0x55603be6f770 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 10 client.15498 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 10 client.15498 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 20 client.15498 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603be7fd00 0x55603be82140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 4 client.15498 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.329+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0330005020 con 0x55603be7fd00 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.330+0000 7f033b7fe640 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603be7fd00 0x55603be82140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.330+0000 7f031affd640 10 client.15498 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.330+0000 7f033b7fe640 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603be7fd00 0x55603be82140 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b56c7f55f6889825 server_cookie=d4cb9f0e3543d075 in_seq=0 out_seq=0 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.331+0000 7f031affd640 1 -- 172.21.15.77:0/1638229408 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f0330005020 con 0x55603be7fd00 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.331+0000 7f031affd640 10 client.15498 handle_command_reply: tid=0 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.331+0000 7f0344c51740 1 client.15498 shutdown 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 msgr2=0x55603be7b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f03340c5d70 tx=0x7f03340b9840 comp rx=0 tx=0).stop 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 shutdown_connections 2024-09-15T23:32:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603be7fd00 0x55603be82140 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f031affd640 0 client.15498 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6f770 0x55603be7b5a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be74560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 --2- 172.21.15.77:0/1638229408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be69da0 0x55603be74020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 >> 172.21.15.77:0/1638229408 conn(0x55603be61000 msgr2=0x55603be62810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 shutdown_connections 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 1 -- 172.21.15.77:0/1638229408 wait complete. 2024-09-15T23:32:40.336 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.332+0000 7f0344c51740 20 client.15498 trim_cache size 0 max 16384 2024-09-15T23:32:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.360+0000 7f0344c51740 1 Processor -- start 2024-09-15T23:32:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.360+0000 7f0344c51740 1 -- start start 2024-09-15T23:32:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.360+0000 7f0344c51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f0344c51740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be7b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f0344c51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be86f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f0344c51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a63c0 con 0x55603be69da0 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f0344c51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a8c40 con 0x55603be6f770 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f0344c51740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a6a30 con 0x55603be6a6e0 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45022/0 (socket says 172.21.15.77:45022) 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 -- 172.21.15.77:0/3095237967 learned_addr learned my addr 172.21.15.77:0/3095237967 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033affd640 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be7b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 -- 172.21.15.77:0/3095237967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 msgr2=0x55603be7b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be7b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 -- 172.21.15.77:0/3095237967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 msgr2=0x55603be86f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be86f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 -- 172.21.15.77:0/3095237967 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55603be82770 con 0x55603be69da0 2024-09-15T23:32:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f033b7fe640 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f033c1991c0 tx=0x7f032c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d0b955752c657d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.361+0000 7f03217fa640 1 -- 172.21.15.77:0/3095237967 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c003ac0 con 0x55603be69da0 2024-09-15T23:32:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.362+0000 7f03217fa640 1 -- 172.21.15.77:0/3095237967 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f032c005500 con 0x55603be69da0 2024-09-15T23:32:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.362+0000 7f03217fa640 1 -- 172.21.15.77:0/3095237967 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c004d00 con 0x55603be69da0 2024-09-15T23:32:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- 172.21.15.77:0/3095237967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 msgr2=0x55603be869f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f033c1991c0 tx=0x7f032c018000 comp rx=0 tx=0).stop 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- 172.21.15.77:0/3095237967 shutdown_connections 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be86f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be6a6e0 0x55603be7b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 --2- 172.21.15.77:0/3095237967 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be69da0 0x55603be869f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- 172.21.15.77:0/3095237967 >> 172.21.15.77:0/3095237967 conn(0x55603be61000 msgr2=0x55603be60210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- 172.21.15.77:0/3095237967 shutdown_connections 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- 172.21.15.77:0/3095237967 wait complete. 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 -- start start 2024-09-15T23:32:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.363+0000 7f0344c51740 1 Processor -- start 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 0x55603be75cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be7a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a7100 con 0x55603be6a6e0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a8570 con 0x55603be6f770 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f033c1a77d0 con 0x55603be69da0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f0344c51740 10 client.0 _ll_register_callbacks cb 0x7f0334004950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f033affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 0x55603be75cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f033b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f033b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:38424/0 (socket says 172.21.15.77:38424) 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f033b7fe640 1 -- 172.21.15.77:0/2225002165 learned_addr learned my addr 172.21.15.77:0/2225002165 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.364+0000 7f033bfff640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be7a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 -- 172.21.15.77:0/2225002165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 msgr2=0x55603be7a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be7a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 -- 172.21.15.77:0/2225002165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 msgr2=0x55603be75cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 0x55603be75cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 -- 172.21.15.77:0/2225002165 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55603be7aef0 con 0x55603be69da0 2024-09-15T23:32:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033affd640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 0x55603be75cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f033b7fe640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f032c012fd0 tx=0x7f032c004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=499f50bace5e1786 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f031affd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f032c005130 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f032c0052d0 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.365+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f032c005500 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f032c042050 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 10 client.25045 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55603beef840 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f032c005500 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f032c028410 con 0x55603be69da0 2024-09-15T23:32:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 10 client.25045 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 10 client.25045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 20 client.25045 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603bef0200 0x55603bef2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 4 client.25045 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.366+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55603bdd6a20 con 0x55603bef0200 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.367+0000 7f033affd640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603bef0200 0x55603bef2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.367+0000 7f033affd640 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603bef0200 0x55603bef2620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6606e0fb032072c server_cookie=1735834e97a979a6 in_seq=0 out_seq=0 2024-09-15T23:32:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.367+0000 7f031affd640 10 client.25045 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.371+0000 7f031affd640 1 -- 172.21.15.77:0/2225002165 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55603bdd6a20 con 0x55603bef0200 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.371+0000 7f031affd640 10 client.25045 handle_command_reply: tid=0 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.371+0000 7f0344c51740 1 client.25045 shutdown 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.371+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 msgr2=0x55603be75780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.371+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f032c012fd0 tx=0x7f032c004d30 comp rx=0 tx=0).stop 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 shutdown_connections 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55603bef0200 0x55603bef2620 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55603be6f770 0x55603be7a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55603be6a6e0 0x55603be75cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 --2- 172.21.15.77:0/2225002165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55603be69da0 0x55603be75780 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 >> 172.21.15.77:0/2225002165 conn(0x55603be61000 msgr2=0x55603be61e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f031affd640 0 client.25045 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 shutdown_connections 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 1 -- 172.21.15.77:0/2225002165 wait complete. 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.372+0000 7f0344c51740 20 client.25045 trim_cache size 0 max 16384 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:32:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:32:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 msgr2=0x7f03240a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 0x7f03240a57b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55603be6b110 tx=0x7f032c005f90 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 msgr2=0x7f033c19f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f03340098d0 tx=0x7f033402f840 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 shutdown_connections 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f03240a32f0 0x7f03240a57b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f033c101d80 0x7f033c19f260 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f033c1013c0 0x7f033c198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 --2- 172.21.15.77:0/1948161365 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f033c1001d0 0x7f033c197cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.373+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 >> 172.21.15.77:0/1948161365 conn(0x7f033c0fb930 msgr2=0x7f033c0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.374+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 shutdown_connections 2024-09-15T23:32:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:40.374+0000 7f0341eb7640 1 -- 172.21.15.77:0/1948161365 wait complete. 2024-09-15T23:32:40.543 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 -- 172.21.15.77:0/1630352190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 msgr2=0x7fe090107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 --2- 172.21.15.77:0/1630352190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090107b90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe080009930 tx=0x7fe08002a420 comp rx=0 tx=0).stop 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 -- 172.21.15.77:0/1630352190 shutdown_connections 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 --2- 172.21.15.77:0/1630352190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 --2- 172.21.15.77:0/1630352190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090107b90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 --2- 172.21.15.77:0/1630352190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 0x7fe090103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.062+0000 7fe09773e640 1 -- 172.21.15.77:0/1630352190 >> 172.21.15.77:0/1630352190 conn(0x7fe0900fc7d0 msgr2=0x7fe0900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.063+0000 7fe09773e640 1 -- 172.21.15.77:0/1630352190 shutdown_connections 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.063+0000 7fe09773e640 1 -- 172.21.15.77:0/1630352190 wait complete. 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.063+0000 7fe09773e640 1 Processor -- start 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.063+0000 7fe09773e640 1 -- start start 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 0x7fe0901985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe090112060 con 0x7fe0901036e0 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45032/0 (socket says 172.21.15.77:45032) 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 -- 172.21.15.77:0/2754568905 learned_addr learned my addr 172.21.15.77:0/2754568905 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe090111ee0 con 0x7fe0901082a0 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901121e0 con 0x7fe090102d30 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe095cdb640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe0954da640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 0x7fe0901985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 -- 172.21.15.77:0/2754568905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 msgr2=0x7fe0901985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 0x7fe0901985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 -- 172.21.15.77:0/2754568905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 msgr2=0x7fe09019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.064+0000 7fe094cd9640 1 -- 172.21.15.77:0/2754568905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09019d550 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.065+0000 7fe095cdb640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.065+0000 7fe094cd9640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe080005940 tx=0x7fe0800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.065+0000 7fe0867fc640 1 -- 172.21.15.77:0/2754568905 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08003f030 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.065+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09019d7e0 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.065+0000 7fe0867fc640 1 -- 172.21.15.77:0/2754568905 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe080003ce0 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.066+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0901a5120 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.066+0000 7fe0867fc640 1 -- 172.21.15.77:0/2754568905 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe080035070 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.068+0000 7fe0867fc640 1 -- 172.21.15.77:0/2754568905 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe08004c060 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.069+0000 7fe0867fc640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 0x7fe07c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.069+0000 7fe0867fc640 1 -- 172.21.15.77:0/2754568905 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe08004a070 con 0x7fe0901036e0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.069+0000 7fe0954da640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 0x7fe07c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.069+0000 7fe099b17740 1 Processor -- start 2024-09-15T23:32:41.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 -- start start 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82490 0x55d515f82870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f82db0 0x55d515f8d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d515ee82e0 con 0x55d515f8d670 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d515e8fce0 con 0x55d515f82db0 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe099b17740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d515ee42a0 con 0x55d515f82490 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe095cdb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe0954da640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 0x7fe07c0a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0058c0 tx=0x7fe08c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe095cdb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45036/0 (socket says 172.21.15.77:45036) 2024-09-15T23:32:41.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe095cdb640 1 -- 172.21.15.77:0/3620263335 learned_addr learned my addr 172.21.15.77:0/3620263335 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe0954da640 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82490 0x55d515f82870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.070+0000 7fe094cd9640 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f82db0 0x55d515f8d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 -- 172.21.15.77:0/3620263335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82490 msgr2=0x55d515f82870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82490 0x55d515f82870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 -- 172.21.15.77:0/3620263335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f82db0 msgr2=0x55d515f8d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f82db0 0x55d515f8d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 -- 172.21.15.77:0/3620263335 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d515e74440 con 0x55d515f8d670 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe095cdb640 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe088010710 tx=0x7fe088010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca6dc692b0925d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe07b7fe640 1 -- 172.21.15.77:0/3620263335 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08800e8d0 con 0x55d515f8d670 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe07b7fe640 1 -- 172.21.15.77:0/3620263335 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe088012450 con 0x55d515f8d670 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.071+0000 7fe07b7fe640 1 -- 172.21.15.77:0/3620263335 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08801c650 con 0x55d515f8d670 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 -- 172.21.15.77:0/3620263335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 msgr2=0x55d515f8fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fe088010710 tx=0x7fe088010bd0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 -- 172.21.15.77:0/3620263335 shutdown_connections 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f8d670 0x55d515f8fa60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f82db0 0x55d515f8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 --2- 172.21.15.77:0/3620263335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82490 0x55d515f82870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 -- 172.21.15.77:0/3620263335 >> 172.21.15.77:0/3620263335 conn(0x55d515f7ea20 msgr2=0x55d515f7ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 -- 172.21.15.77:0/3620263335 shutdown_connections 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.072+0000 7fe099b17740 1 -- 172.21.15.77:0/3620263335 wait complete. 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 -- start start 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 Processor -- start 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 0x55d515f8a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515f8a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d515f90240 con 0x55d515f82490 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45042/0 (socket says 172.21.15.77:45042) 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d515ea3050 con 0x55d515f8d670 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe0954da640 1 -- 172.21.15.77:0/873434323 learned_addr learned my addr 172.21.15.77:0/873434323 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d515f903c0 con 0x55d515f82db0 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe099b17740 10 client.0 _ll_register_callbacks cb 0x55d515ee3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.073+0000 7fe095cdb640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515f8a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe094cd9640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 0x55d515f8a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 -- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 msgr2=0x55d515f8a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 0x55d515f8a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 -- 172.21.15.77:0/873434323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 msgr2=0x55d515f8a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515f8a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 -- 172.21.15.77:0/873434323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d515c593c0 con 0x55d515f82490 2024-09-15T23:32:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe094cd9640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 0x55d515f8a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:32:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe0954da640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01de30 tx=0x7fe08c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4bc837e95ee5b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe078ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c016070 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe088012450 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe08c005220 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.074+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe08c030050 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 10 client.15516 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d515f9bc50 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe088012450 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe08c024030 con 0x55d515f82490 2024-09-15T23:32:41.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 10 client.15516 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 20 client.15516 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d515f9d0b0 0x55d515f9f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 4 client.15516 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d515ef5850 con 0x55d515f9d0b0 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.075+0000 7fe094cd9640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d515f9d0b0 0x55d515f9f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.076+0000 7fe078ff9640 10 client.15516 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.076+0000 7fe094cd9640 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d515f9d0b0 0x55d515f9f530 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bc91fae335a3491 server_cookie=ef97d243f27f5b8e in_seq=0 out_seq=0 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.077+0000 7fe078ff9640 1 -- 172.21.15.77:0/873434323 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d515ef5850 con 0x55d515f9d0b0 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.077+0000 7fe078ff9640 10 client.15516 handle_command_reply: tid=0 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.077+0000 7fe099b17740 1 client.15516 shutdown 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.077+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 msgr2=0x55d515f8cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.077+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01de30 tx=0x7fe08c004730 comp rx=0 tx=0).stop 2024-09-15T23:32:41.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 shutdown_connections 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d515f9d0b0 0x55d515f9f530 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515f8a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f82db0 0x55d515f8a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 --2- 172.21.15.77:0/873434323 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82490 0x55d515f8cf90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 >> 172.21.15.77:0/873434323 conn(0x55d515f7ea20 msgr2=0x55d515f7dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe078ff9640 0 client.15516 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 shutdown_connections 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 1 -- 172.21.15.77:0/873434323 wait complete. 2024-09-15T23:32:41.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.078+0000 7fe099b17740 20 client.15516 trim_cache size 0 max 16384 2024-09-15T23:32:41.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 Processor -- start 2024-09-15T23:32:41.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 -- start start 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515fa5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f874a0 0x55d515f878f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bbb80 con 0x55d515f82db0 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901be400 con 0x55d515f8d670 2024-09-15T23:32:41.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe099b17740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bc1f0 con 0x55d515f874a0 2024-09-15T23:32:41.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.095+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45044/0 (socket says 172.21.15.77:45044) 2024-09-15T23:32:41.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 -- 172.21.15.77:0/1005325599 learned_addr learned my addr 172.21.15.77:0/1005325599 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:41.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe094cd9640 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515fa5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 -- 172.21.15.77:0/1005325599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f874a0 msgr2=0x55d515f878f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f874a0 0x55d515f878f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 -- 172.21.15.77:0/1005325599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 msgr2=0x55d515fa5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515fa5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.096+0000 7fe0954da640 1 -- 172.21.15.77:0/1005325599 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d515f8d300 con 0x55d515f82db0 2024-09-15T23:32:41.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.097+0000 7fe0954da640 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01b810 tx=0x7fe08c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86444c09c2a92c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.097+0000 7fe07affd640 1 -- 172.21.15.77:0/1005325599 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c03a020 con 0x55d515f82db0 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.097+0000 7fe07affd640 1 -- 172.21.15.77:0/1005325599 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe08c010c90 con 0x55d515f82db0 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.097+0000 7fe07affd640 1 -- 172.21.15.77:0/1005325599 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c004a00 con 0x55d515f82db0 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- 172.21.15.77:0/1005325599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 msgr2=0x55d515fa4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01b810 tx=0x7fe08c00ff90 comp rx=0 tx=0).stop 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- 172.21.15.77:0/1005325599 shutdown_connections 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f874a0 0x55d515f878f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f8d670 0x55d515fa5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 --2- 172.21.15.77:0/1005325599 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515fa4e00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- 172.21.15.77:0/1005325599 >> 172.21.15.77:0/1005325599 conn(0x55d515f7ea20 msgr2=0x55d515f8c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- 172.21.15.77:0/1005325599 shutdown_connections 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- 172.21.15.77:0/1005325599 wait complete. 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 -- start start 2024-09-15T23:32:41.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.098+0000 7fe099b17740 1 Processor -- start 2024-09-15T23:32:41.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f874a0 0x55d515f95e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f8d670 0x55d515f93e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bc8c0 con 0x55d515f82db0 2024-09-15T23:32:41.102 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bdd30 con 0x55d515f874a0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe0901bcf90 con 0x55d515f8d670 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe099b17740 10 client.0 _ll_register_callbacks cb 0x7fe08c01dab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45046/0 (socket says 172.21.15.77:45046) 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 -- 172.21.15.77:0/1309273196 learned_addr learned my addr 172.21.15.77:0/1309273196 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe095cdb640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f8d670 0x55d515f93e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe094cd9640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f874a0 0x55d515f95e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 -- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f8d670 msgr2=0x55d515f93e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f8d670 0x55d515f93e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 -- 172.21.15.77:0/1309273196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f874a0 msgr2=0x55d515f95e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f874a0 0x55d515f95e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 -- 172.21.15.77:0/1309273196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d515f94600 con 0x55d515f82db0 2024-09-15T23:32:41.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe0954da640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01d850 tx=0x7fe08c00a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd29d7bf9785c23 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.099+0000 7fe078ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe08c043060 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe08c036440 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe08c010c90 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe08c016050 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 10 client.15522 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d516008a00 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe08c01ba90 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe08c024040 con 0x55d515f82db0 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 10 client.15522 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 20 client.15522 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:41.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d5160090d0 0x55d51600b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:41.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 4 client.15522 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.100+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fe08c010c90 con 0x55d5160090d0 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe094cd9640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d5160090d0 0x55d51600b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe078ff9640 10 client.15522 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe094cd9640 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d5160090d0 0x55d51600b4f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43a7ba9be2facf71 server_cookie=f8228b206731a98e in_seq=0 out_seq=0 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": { 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout: "f2eac10c-b33c-4c87-a025-e9a6da5a6475": { 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout: "path": "/", 2024-09-15T23:32:41.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tag": "f2eac10c-b33c-4c87-a025-e9a6da5a6475", 2024-09-15T23:32:41.107 INFO:teuthology.orchestra.run.smithi077.stdout: "options": "recursive,force" 2024-09-15T23:32:41.107 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:41.107 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:41.107 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe078ff9640 1 -- 172.21.15.77:0/1309273196 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fe08c010c90 con 0x55d5160090d0 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe078ff9640 10 client.15522 handle_command_reply: tid=0 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.101+0000 7fe099b17740 1 client.15522 shutdown 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 msgr2=0x55d515f95940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe08c01d850 tx=0x7fe08c00a8e0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 shutdown_connections 2024-09-15T23:32:41.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d5160090d0 0x55d51600b4f0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe078ff9640 0 client.15522 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d515f8d670 0x55d515f93e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d515f874a0 0x55d515f95e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 --2- 172.21.15.77:0/1309273196 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d515f82db0 0x55d515f95940 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 >> 172.21.15.77:0/1309273196 conn(0x55d515f7ea20 msgr2=0x55d515f8c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 shutdown_connections 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 1 -- 172.21.15.77:0/1309273196 wait complete. 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.102+0000 7fe099b17740 20 client.15522 trim_cache size 0 max 16384 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 msgr2=0x7fe07c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 0x7fe07c0a5700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0058c0 tx=0x7fe08c00a2d0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 msgr2=0x7fe090198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe080005940 tx=0x7fe0800042f0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 shutdown_connections 2024-09-15T23:32:41.109 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe07c0a3240 0x7fe07c0a5700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0901082a0 0x7fe09019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe0901036e0 0x7fe090198ae0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 --2- 172.21.15.77:0/2754568905 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe090102d30 0x7fe0901985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 >> 172.21.15.77:0/2754568905 conn(0x7fe0900fc7d0 msgr2=0x7fe090105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 shutdown_connections 2024-09-15T23:32:41.110 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:41.103+0000 7fe09773e640 1 -- 172.21.15.77:0/2754568905 wait complete. 2024-09-15T23:32:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:40 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:32:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:40 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:40 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:32:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:40 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:40 smithi159 ceph-mon[35472]: pgmap v383: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-15T23:32:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:40 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:32:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:40 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:40 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:32:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:40 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:40 smithi155 ceph-mon[35631]: pgmap v383: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-15T23:32:41.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:40 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:32:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:40 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:40 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:32:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:40 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:32:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:40 smithi077 ceph-mon[30968]: pgmap v383: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-15T23:32:41.897 INFO:tasks.cephfs.filesystem:scrub status for tag:f2eac10c-b33c-4c87-a025-e9a6da5a6475 - {'path': '/', 'tag': 'f2eac10c-b33c-4c87-a025-e9a6da5a6475', 'options': 'recursive,force'} 2024-09-15T23:32:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:42 smithi159 ceph-mon[35472]: pgmap v384: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-15T23:32:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:42 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:32:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:42 smithi155 ceph-mon[35631]: pgmap v384: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-15T23:32:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:42 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:32:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:42 smithi077 ceph-mon[30968]: pgmap v384: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-15T23:32:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:42 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:32:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:44 smithi159 ceph-mon[35472]: pgmap v385: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-15T23:32:45.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:44 smithi155 ceph-mon[35631]: pgmap v385: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-15T23:32:45.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:44 smithi077 ceph-mon[30968]: pgmap v385: 129 pgs: 129 active+clean; 659 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-15T23:32:47.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:46 smithi159 ceph-mon[35472]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-15T23:32:47.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:46 smithi155 ceph-mon[35631]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-15T23:32:47.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:46 smithi077 ceph-mon[30968]: pgmap v386: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-15T23:32:49.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:48 smithi159 ceph-mon[35472]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:49.278 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:32:49.302 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:48 smithi077 ceph-mon[30968]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:49.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:48 smithi155 ceph-mon[35631]: pgmap v387: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:49.561 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 -- 172.21.15.77:0/3836866975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d41036e0 msgr2=0x7f01d4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 --2- 172.21.15.77:0/3836866975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d41036e0 0x7f01d4107b90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009930 tx=0x7f01c402a420 comp rx=0 tx=0).stop 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 -- 172.21.15.77:0/3836866975 shutdown_connections 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 --2- 172.21.15.77:0/3836866975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41082a0 0x7f01d410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 --2- 172.21.15.77:0/3836866975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d41036e0 0x7f01d4107b90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 --2- 172.21.15.77:0/3836866975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d4102d30 0x7f01d4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.091+0000 7f01dc228640 1 -- 172.21.15.77:0/3836866975 >> 172.21.15.77:0/3836866975 conn(0x7f01d40fc7d0 msgr2=0x7f01d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:50.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.092+0000 7f01dc228640 1 -- 172.21.15.77:0/3836866975 shutdown_connections 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.092+0000 7f01dc228640 1 -- 172.21.15.77:0/3836866975 wait complete. 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 Processor -- start 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 -- start start 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41036e0 0x7f01d4198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:50.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d41082a0 0x7f01d419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01d41120a0 con 0x7f01d4102d30 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01d4111f20 con 0x7f01d41082a0 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01dc228640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01d4112220 con 0x7f01d41036e0 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01d9fc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01d9fc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43676/0 (socket says 172.21.15.77:43676) 2024-09-15T23:32:50.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01d9fc4640 1 -- 172.21.15.77:0/1235061322 learned_addr learned my addr 172.21.15.77:0/1235061322 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01da7c5640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d41082a0 0x7f01d419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.093+0000 7f01d97c3640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41036e0 0x7f01d4198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 -- 172.21.15.77:0/1235061322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41036e0 msgr2=0x7f01d4198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41036e0 0x7f01d4198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 -- 172.21.15.77:0/1235061322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d41082a0 msgr2=0x7f01d419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d41082a0 0x7f01d419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 -- 172.21.15.77:0/1235061322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d419d5f0 con 0x7f01d4102d30 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01d9fc4640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f01d000d950 tx=0x7f01d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d0017070 con 0x7f01d4102d30 2024-09-15T23:32:50.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01d0009c30 con 0x7f01d4102d30 2024-09-15T23:32:50.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01d000f6b0 con 0x7f01d4102d30 2024-09-15T23:32:50.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d419d8e0 con 0x7f01d4102d30 2024-09-15T23:32:50.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.094+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d41a51c0 con 0x7f01d4102d30 2024-09-15T23:32:50.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.096+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d4103110 con 0x7f01d4102d30 2024-09-15T23:32:50.099 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.098+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f01d00109d0 con 0x7f01d4102d30 2024-09-15T23:32:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.099+0000 7f01caffd640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 0x7f01c00a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:50.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.099+0000 7f01d97c3640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 0x7f01c00a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.099+0000 7f01d97c3640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 0x7f01c00a5850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009900 tx=0x7f01c4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:50.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.099+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f01d00cf820 con 0x7f01d4102d30 2024-09-15T23:32:50.108 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.107+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f01d0009de0 con 0x7f01d4102d30 2024-09-15T23:32:50.520 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.518+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01d410a2b0 con 0x7f01d4102d30 2024-09-15T23:32:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.519+0000 7f01caffd640 1 -- 172.21.15.77:0/1235061322 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f01d009c1b0 con 0x7f01d4102d30 2024-09-15T23:32:50.521 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:32:50.521 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:32:50.521 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 msgr2=0x7f01c00a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 0x7f01c00a5850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f01c4009900 tx=0x7f01c4005e50 comp rx=0 tx=0).stop 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 msgr2=0x7f01d4198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f01d000d950 tx=0x7f01d000de10 comp rx=0 tx=0).stop 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 shutdown_connections 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01c00a3390 0x7f01c00a5850 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01d41082a0 0x7f01d419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.524 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d41036e0 0x7f01d4198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 --2- 172.21.15.77:0/1235061322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01d4102d30 0x7f01d4198640 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.522+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 >> 172.21.15.77:0/1235061322 conn(0x7f01d40fc7d0 msgr2=0x7f01d4106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.523+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 shutdown_connections 2024-09-15T23:32:50.525 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:50.523+0000 7f01dc228640 1 -- 172.21.15.77:0/1235061322 wait complete. 2024-09-15T23:32:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:50 smithi077 ceph-mon[30968]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:51.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:50 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1235061322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:51.287 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db --set-id c394b7ec --release --await' 2024-09-15T23:32:51.287 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db --set-id c394b7ec --release --await 2024-09-15T23:32:51.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:50 smithi155 ceph-mon[35631]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:51.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:50 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1235061322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:50 smithi159 ceph-mon[35472]: pgmap v388: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:51.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:50 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1235061322' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:32:51.606 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:32:52.170 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.152+0000 7fba2e6be640 1 -- 172.21.15.77:0/3902223042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28103650 msgr2=0x7fba2810bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.152+0000 7fba2e6be640 1 --2- 172.21.15.77:0/3902223042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28103650 0x7fba2810bb40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009980 tx=0x7fba1c02e8b0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 -- 172.21.15.77:0/3902223042 shutdown_connections 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 --2- 172.21.15.77:0/3902223042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba2810c160 0x7fba2810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 --2- 172.21.15.77:0/3902223042 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba28103650 0x7fba2810bb40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 --2- 172.21.15.77:0/3902223042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba28102d30 0x7fba28103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 -- 172.21.15.77:0/3902223042 >> 172.21.15.77:0/3902223042 conn(0x7fba280fc7d0 msgr2=0x7fba280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 -- 172.21.15.77:0/3902223042 shutdown_connections 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 -- 172.21.15.77:0/3902223042 wait complete. 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 Processor -- start 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.153+0000 7fba2e6be640 1 -- start start 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba28102d30 0x7fba281a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.171 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba2810c160 0x7fba2819e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba2810fdc0 con 0x7fba2810c160 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba2810fc40 con 0x7fba28102d30 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2e6be640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fba2810ff40 con 0x7fba28103650 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba277fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba277fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:51542/0 (socket says 172.21.15.77:51542) 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba277fe640 1 -- 172.21.15.77:0/1273914896 learned_addr learned my addr 172.21.15.77:0/1273914896 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.154+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba2810c160 0x7fba2819e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 -- 172.21.15.77:0/1273914896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba28102d30 msgr2=0x7fba281a46d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba28102d30 0x7fba281a46d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 -- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba2810c160 msgr2=0x7fba2819e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba2810c160 0x7fba2819e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.172 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 -- 172.21.15.77:0/1273914896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba2819efc0 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba277fe640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba1c035520 tx=0x7fba1c0038f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba257fa640 1 -- 172.21.15.77:0/1273914896 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c041020 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba2819f250 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba257fa640 1 -- 172.21.15.77:0/1273914896 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1c035580 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba257fa640 1 -- 172.21.15.77:0/1273914896 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1c03d6f0 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.155+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba281ab5a0 con 0x7fba28103650 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 Processor -- start 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 -- start start 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08ce440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08d9240 0x559dc08db630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559dc0833620 con 0x559dc08ce980 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559dc07dae50 con 0x559dc08d9240 2024-09-15T23:32:52.173 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba30a97740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559dc082f5e0 con 0x559dc08ce060 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.158+0000 7fba27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43702/0 (socket says 172.21.15.77:43702) 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 -- 172.21.15.77:0/1685812330 learned_addr learned my addr 172.21.15.77:0/1685812330 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba257fa640 1 -- 172.21.15.77:0/1273914896 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fba1c044020 con 0x7fba28103650 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 -- 172.21.15.77:0/1685812330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 msgr2=0x559dc08ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 -- 172.21.15.77:0/1685812330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08d9240 msgr2=0x559dc08db630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08d9240 0x559dc08db630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 -- 172.21.15.77:0/1685812330 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc07cbd40 con 0x559dc08ce980 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba27fff640 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fba1800ba50 tx=0x7fba1800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921517808521ee08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.159+0000 7fba0e7fc640 1 -- 172.21.15.77:0/1685812330 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18016070 con 0x559dc08ce980 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba0e7fc640 1 -- 172.21.15.77:0/1685812330 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba18005500 con 0x559dc08ce980 2024-09-15T23:32:52.174 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba0e7fc640 1 -- 172.21.15.77:0/1685812330 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18010460 con 0x559dc08ce980 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba257fa640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 0x7fba100a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba257fa640 1 -- 172.21.15.77:0/1273914896 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fba1c0efcd0 con 0x7fba28103650 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 0x7fba100a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba30a97740 1 -- 172.21.15.77:0/1685812330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 msgr2=0x559dc08d8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 0x7fba100a5800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba20005fd0 tx=0x7fba20009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.160+0000 7fba30a97740 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fba1800ba50 tx=0x7fba1800bf10 comp rx=0 tx=0).stop 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 -- 172.21.15.77:0/1685812330 shutdown_connections 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08d9240 0x559dc08db630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d8d00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 --2- 172.21.15.77:0/1685812330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 -- 172.21.15.77:0/1685812330 >> 172.21.15.77:0/1685812330 conn(0x559dc08ca5f0 msgr2=0x559dc08ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 -- 172.21.15.77:0/1685812330 shutdown_connections 2024-09-15T23:32:52.175 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 -- 172.21.15.77:0/1685812330 wait complete. 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 -- start start 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.161+0000 7fba30a97740 1 Processor -- start 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 0x559dc08d61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559dc08dbe10 con 0x559dc08ce980 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559dc07bbf10 con 0x559dc08ce060 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559dc08dbf90 con 0x559dc08d9240 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba30a97740 10 client.0 _ll_register_callbacks cb 0x559dc07dfdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba277fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.176 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:51562/0 (socket says 172.21.15.77:51562) 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 -- 172.21.15.77:0/984301568 learned_addr learned my addr 172.21.15.77:0/984301568 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba27fff640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 0x559dc08d61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 -- 172.21.15.77:0/984301568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 msgr2=0x559dc08d61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 0x559dc08d61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 -- 172.21.15.77:0/984301568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 msgr2=0x559dc08d6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba2cc5b640 1 -- 172.21.15.77:0/984301568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc0542580 con 0x559dc08d9240 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba277fe640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.162+0000 7fba27fff640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 0x559dc08d61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba20011d40 tx=0x7fba20004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4860c972734a531 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba077fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20004b20 con 0x559dc08d9240 2024-09-15T23:32:52.177 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fba20004cc0 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba18005500 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fba20005020 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba30a97740 10 client.25075 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.163+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559dc060c960 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba18005500 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fba2000f040 con 0x559dc08d9240 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 10 client.25075 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 10 client.25075 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 20 client.25075 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc08eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 4 client.25075 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dc0840b90 con 0x559dc08e8e20 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.164+0000 7fba27fff640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc08eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.165+0000 7fba077fe640 10 client.25075 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:52.178 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.165+0000 7fba27fff640 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc08eb250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b39536ecc43fece8 server_cookie=317b8e2e87799aff in_seq=0 out_seq=0 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba077fe640 1 -- 172.21.15.77:0/984301568 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559dc0840b90 con 0x559dc08e8e20 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba077fe640 10 client.25075 handle_command_reply: tid=0 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 client.25075 shutdown 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 msgr2=0x559dc08d6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba20011d40 tx=0x7fba20004a40 comp rx=0 tx=0).stop 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 shutdown_connections 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc08eb250 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba077fe640 0 client.25075 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08d9240 0x559dc08d6c70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08ce980 0x559dc08d6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 --2- 172.21.15.77:0/984301568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce060 0x559dc08d61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 >> 172.21.15.77:0/984301568 conn(0x559dc08ca5f0 msgr2=0x559dc08d02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.179 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 shutdown_connections 2024-09-15T23:32:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 1 -- 172.21.15.77:0/984301568 wait complete. 2024-09-15T23:32:52.180 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.166+0000 7fba30a97740 20 client.25075 trim_cache size 0 max 16384 2024-09-15T23:32:52.184 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.183+0000 7fba30a97740 1 Processor -- start 2024-09-15T23:32:52.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.183+0000 7fba30a97740 1 -- start start 2024-09-15T23:32:52.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.185 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b3250 con 0x559dc08d9240 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b5ad0 con 0x559dc08ce980 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba30a97740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b38c0 con 0x559dc08ce060 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43722/0 (socket says 172.21.15.77:43722) 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba2cc5b640 1 -- 172.21.15.77:0/3586536259 learned_addr learned my addr 172.21.15.77:0/3586536259 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 -- 172.21.15.77:0/3586536259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 msgr2=0x559dc08f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 -- 172.21.15.77:0/3586536259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 msgr2=0x559dc08d34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba27fff640 1 -- 172.21.15.77:0/3586536259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dc08d1e70 con 0x559dc08ce060 2024-09-15T23:32:52.186 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.184+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.185+0000 7fba27fff640 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08f0b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba18004b30 tx=0x7fba18004c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a54683cedbe075a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.185+0000 7fba0dffb640 1 -- 172.21.15.77:0/3586536259 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18016040 con 0x559dc08ce060 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.185+0000 7fba0dffb640 1 -- 172.21.15.77:0/3586536259 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba1800dc20 con 0x559dc08ce060 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.185+0000 7fba0dffb640 1 -- 172.21.15.77:0/3586536259 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba18005140 con 0x559dc08ce060 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 -- 172.21.15.77:0/3586536259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 msgr2=0x559dc08f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08f0b70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba18004b30 tx=0x7fba18004c30 comp rx=0 tx=0).stop 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 -- 172.21.15.77:0/3586536259 shutdown_connections 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08d34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.188 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 --2- 172.21.15.77:0/3586536259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08f0b70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 -- 172.21.15.77:0/3586536259 >> 172.21.15.77:0/3586536259 conn(0x559dc08ca5f0 msgr2=0x559dc08d8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 -- 172.21.15.77:0/3586536259 shutdown_connections 2024-09-15T23:32:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.186+0000 7fba30a97740 1 -- 172.21.15.77:0/3586536259 wait complete. 2024-09-15T23:32:52.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.187+0000 7fba30a97740 1 -- start start 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.187+0000 7fba30a97740 1 Processor -- start 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.187+0000 7fba30a97740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08e13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.187+0000 7fba30a97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08e1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b3f90 con 0x559dc08d9240 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b5400 con 0x559dc08ce980 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.190 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43724/0 (socket says 172.21.15.77:43724) 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 -- 172.21.15.77:0/2602286985 learned_addr learned my addr 172.21.15.77:0/2602286985 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba27fff640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08e13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fba281b4660 con 0x559dc08ce060 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba277fe640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08e1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 -- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 msgr2=0x559dc08e13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08e13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 -- 172.21.15.77:0/2602286985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 msgr2=0x559dc08e1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08e1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba2cc5b640 1 -- 172.21.15.77:0/2602286985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dc08de9e0 con 0x559dc08d9240 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 10 client.0 _ll_register_callbacks cb 0x7fba200119f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.188+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba1800dc20 con 0x559dc08d9240 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba2cc5b640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fba20018040 tx=0x7fba20032d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22fc3c633005152 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba077fe640 10 client.15546 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba077fe640 1 -- 172.21.15.77:0/2602286985 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba20004ab0 con 0x559dc08d9240 2024-09-15T23:32:52.191 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba077fe640 1 -- 172.21.15.77:0/2602286985 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fba20004c50 con 0x559dc08d9240 2024-09-15T23:32:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba077fe640 1 -- 172.21.15.77:0/2602286985 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fba20004e70 con 0x559dc08d9240 2024-09-15T23:32:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 10 client.15546 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:52.192 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({fsmap=21}) -- 0x559dc0954470 con 0x559dc08d9240 2024-09-15T23:32:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba077fe640 1 -- 172.21.15.77:0/2602286985 <== mon.0 v2:172.21.15.77:3300/0 4 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fba2000f040 con 0x559dc08d9240 2024-09-15T23:32:52.193 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 10 client.15546 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 10 client.15546 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 20 client.15546 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc0956b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 4 client.15546 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c394b7ec", "release": true, "await": true}] 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.189+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c394b7ec", "release": true, "await": true}) -- 0x559dc083b0a0 con 0x559dc08e8e20 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.190+0000 7fba27fff640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc0956b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.190+0000 7fba27fff640 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc0956b40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=756ef788bac0694e server_cookie=ce9b9c57d9ff9ddb in_seq=0 out_seq=0 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.190+0000 7fba077fe640 10 client.15546 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.191+0000 7fba077fe640 1 -- 172.21.15.77:0/2602286985 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559dc083b0a0 con 0x559dc08e8e20 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.191+0000 7fba077fe640 10 client.15546 handle_command_reply: tid=0 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.191+0000 7fba30a97740 1 client.15546 shutdown 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 msgr2=0x559dc08de1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fba20018040 tx=0x7fba20032d80 comp rx=0 tx=0).stop 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 shutdown_connections 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559dc08e8e20 0x559dc0956b40 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559dc08d9240 0x559dc08de1b0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559dc08ce980 0x559dc08e1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 --2- 172.21.15.77:0/2602286985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559dc08ce060 0x559dc08e13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 >> 172.21.15.77:0/2602286985 conn(0x559dc08ca5f0 msgr2=0x559dc08d6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba077fe640 0 client.15546 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 shutdown_connections 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 1 -- 172.21.15.77:0/2602286985 wait complete. 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.192+0000 7fba30a97740 20 client.15546 trim_cache size 0 max 16384 2024-09-15T23:32:52.195 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 4, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "c394b7ec": { 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 4, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:32:52.196 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 150.2, 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:32:52.197 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 msgr2=0x7fba100a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 0x7fba100a5800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fba20005fd0 tx=0x7fba20009600 comp rx=0 tx=0).stop 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 msgr2=0x7fba281a4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fba1c035520 tx=0x7fba1c0038f0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 shutdown_connections 2024-09-15T23:32:52.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fba100a3340 0x7fba100a5800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fba2810c160 0x7fba2819e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba28103650 0x7fba281a4c10 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 --2- 172.21.15.77:0/1273914896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba28102d30 0x7fba281a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 >> 172.21.15.77:0/1273914896 conn(0x7fba280fc7d0 msgr2=0x7fba280fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 shutdown_connections 2024-09-15T23:32:52.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:32:52.193+0000 7fba2e6be640 1 -- 172.21.15.77:0/1273914896 wait complete. 2024-09-15T23:32:52.850 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c394b7ec', total seconds elapsed: 33.8 2024-09-15T23:32:53.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:52 smithi077 ceph-mon[30968]: pgmap v389: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:52 smithi155 ceph-mon[35631]: pgmap v389: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:53.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:52 smithi159 ceph-mon[35472]: pgmap v389: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-15T23:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 -- 172.21.15.77:0/1091175743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 msgr2=0x7fe664100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/1091175743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe664100e40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe654009900 tx=0x7fe65402a410 comp rx=0 tx=0).stop 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 -- 172.21.15.77:0/1091175743 shutdown_connections 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/1091175743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6641025f0 0x7fe664108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/1091175743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe664101c30 0x7fe6641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/1091175743 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe664100e40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 -- 172.21.15.77:0/1091175743 >> 172.21.15.77:0/1091175743 conn(0x7fe6640fc1e0 msgr2=0x7fe6640fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 -- 172.21.15.77:0/1091175743 shutdown_connections 2024-09-15T23:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.511+0000 7fe66a3b7640 1 -- 172.21.15.77:0/1091175743 wait complete. 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe66a3b7640 1 Processor -- start 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe66a3b7640 1 -- start start 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe66a3b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe66a3b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe664101c30 0x7fe66419c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43742/0 (socket says 172.21.15.77:43742) 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe663fff640 1 -- 172.21.15.77:0/2802179585 learned_addr learned my addr 172.21.15.77:0/2802179585 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.512+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6641025f0 0x7fe66419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c6c0 con 0x7fe664100a40 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c540 con 0x7fe664101c30 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe66410c840 con 0x7fe6641025f0 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe6637fe640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe664101c30 0x7fe66419c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe668954640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6641025f0 0x7fe66419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 -- 172.21.15.77:0/2802179585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6641025f0 msgr2=0x7fe66419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6641025f0 0x7fe66419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 -- 172.21.15.77:0/2802179585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe664101c30 msgr2=0x7fe66419c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe664101c30 0x7fe66419c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe66419f8b0 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe663fff640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe654009850 tx=0x7fe6540319e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.513+0000 7fe6617fa640 1 -- 172.21.15.77:0/2802179585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65403f030 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.514+0000 7fe6617fa640 1 -- 172.21.15.77:0/2802179585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe654003d60 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.514+0000 7fe6617fa640 1 -- 172.21.15.77:0/2802179585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe654035070 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.514+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe66419fae0 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.514+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe66419ffd0 con 0x7fe664100a40 2024-09-15T23:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.516+0000 7fe6617fa640 1 -- 172.21.15.77:0/2802179585 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe654042030 con 0x7fe664100a40 2024-09-15T23:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.517+0000 7fe6617fa640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 0x7fe64c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.517+0000 7fe6617fa640 1 -- 172.21.15.77:0/2802179585 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe6540f0310 con 0x7fe664100a40 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.517+0000 7fe66d22d740 1 Processor -- start 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.517+0000 7fe6637fe640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 0x7fe64c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 -- start start 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8ffac4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8ffac7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffa232f0 con 0x55c8ffabf9a0 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c8ff9cb270 con 0x55c8ffac5370 2024-09-15T23:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe66d22d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffa1f2b0 con 0x55c8ffac02e0 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43750/0 (socket says 172.21.15.77:43750) 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 -- 172.21.15.77:0/106249802 learned_addr learned my addr 172.21.15.77:0/106249802 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe668954640 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8ffac7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe6637fe640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 0x7fe64c0a57b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe66406a180 tx=0x7fe65800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe6637fe640 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8ffac4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 -- 172.21.15.77:0/106249802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 msgr2=0x55c8ffac4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8ffac4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 -- 172.21.15.77:0/106249802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 msgr2=0x55c8ffac7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8ffac7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 -- 172.21.15.77:0/106249802 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ff9ca340 con 0x55c8ffabf9a0 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.518+0000 7fe663fff640 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe6540c4ce0 tx=0x7fe654003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fae8dcb3b06f13 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe64a7fc640 1 -- 172.21.15.77:0/106249802 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540bbf00 con 0x55c8ffabf9a0 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe64a7fc640 1 -- 172.21.15.77:0/106249802 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6540bcca0 con 0x55c8ffabf9a0 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe64a7fc640 1 -- 172.21.15.77:0/106249802 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b0c0 con 0x55c8ffabf9a0 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe66d22d740 1 -- 172.21.15.77:0/106249802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 msgr2=0x55c8ffabfda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe66d22d740 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe6540c4ce0 tx=0x7fe654003f10 comp rx=0 tx=0).stop 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.519+0000 7fe66d22d740 1 -- 172.21.15.77:0/106249802 shutdown_connections 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8ffac7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8ffac4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- 172.21.15.77:0/106249802 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabfda0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- 172.21.15.77:0/106249802 >> 172.21.15.77:0/106249802 conn(0x55c8ffabb010 msgr2=0x55c8ffabb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- 172.21.15.77:0/106249802 shutdown_connections 2024-09-15T23:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- 172.21.15.77:0/106249802 wait complete. 2024-09-15T23:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- start start 2024-09-15T23:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 Processor -- start 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 0x55c8ffac9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffac9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffac8100 con 0x55c8ffac5370 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c8ff9ac290 con 0x55c8ffac02e0 2024-09-15T23:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.520+0000 7fe66d22d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c8ffac8280 con 0x55c8ffabf9a0 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe66d22d740 10 client.0 _ll_register_callbacks cb 0x55c8ff9dd140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43760/0 (socket says 172.21.15.77:43760) 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 -- 172.21.15.77:0/777728048 learned_addr learned my addr 172.21.15.77:0/777728048 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe663fff640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 0x55c8ffac9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 -- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 msgr2=0x55c8ffac9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 0x55c8ffac9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 -- 172.21.15.77:0/777728048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 msgr2=0x55c8ffac9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffac9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 -- 172.21.15.77:0/777728048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ff736210 con 0x55c8ffac5370 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe663fff640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 0x55c8ffac9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe668954640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe65c003c20 tx=0x7fe65c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ee01df23c4ffe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe6437fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011850 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe65c0119f0 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe6540bcca0 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe65c024050 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.521+0000 7fe66d22d740 10 client.15558 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c8ff802620 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe6540bcca0 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe65c019020 con 0x55c8ffac5370 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 10 client.15558 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 20 client.15558 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffad55f0 0x55c8ffad7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 4 client.15558 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:32:53.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8ffa30a20 con 0x55c8ffad55f0 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.522+0000 7fe663fff640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffad55f0 0x55c8ffad7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.523+0000 7fe6437fe640 10 client.15558 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.523+0000 7fe663fff640 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffad55f0 0x55c8ffad7a70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74268176c76310c9 server_cookie=b18e358f9886ad4c in_seq=0 out_seq=0 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe6437fe640 1 -- 172.21.15.77:0/777728048 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c8ffa30a20 con 0x55c8ffad55f0 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe6437fe640 10 client.15558 handle_command_reply: tid=0 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 client.15558 shutdown 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 msgr2=0x55c8ffad0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe65c003c20 tx=0x7fe65c004410 comp rx=0 tx=0).stop 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 shutdown_connections 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffad55f0 0x55c8ffad7a70 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffac5370 0x55c8ffad0e30 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe6437fe640 0 client.15558 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffac9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 --2- 172.21.15.77:0/777728048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffabf9a0 0x55c8ffac9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 >> 172.21.15.77:0/777728048 conn(0x55c8ffabb010 msgr2=0x55c8ffabc820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 shutdown_connections 2024-09-15T23:32:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 1 -- 172.21.15.77:0/777728048 wait complete. 2024-09-15T23:32:53.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.524+0000 7fe66d22d740 20 client.15558 trim_cache size 0 max 16384 2024-09-15T23:32:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 Processor -- start 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 -- start start 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffad0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac5370 0x55c8ffabc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.538+0000 7fe66d22d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641a86a0 con 0x55c8ffabf9a0 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe66d22d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641aaf20 con 0x55c8ffac02e0 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe66d22d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641a8d10 con 0x55c8ffac5370 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:43772/0 (socket says 172.21.15.77:43772) 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 -- 172.21.15.77:0/3769955512 learned_addr learned my addr 172.21.15.77:0/3769955512 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe668954640 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac5370 0x55c8ffabc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 -- 172.21.15.77:0/3769955512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac5370 msgr2=0x55c8ffabc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac5370 0x55c8ffabc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 -- 172.21.15.77:0/3769955512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 msgr2=0x55c8ffad0df0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffad0df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 -- 172.21.15.77:0/3769955512 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8ffabae30 con 0x55c8ffabf9a0 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe663fff640 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe654031a50 tx=0x7fe65403b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4af0ffd2fcb490 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.539+0000 7fe649ffb640 1 -- 172.21.15.77:0/3769955512 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540bbf00 con 0x55c8ffabf9a0 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe649ffb640 1 -- 172.21.15.77:0/3769955512 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65400b0b0 con 0x55c8ffabf9a0 2024-09-15T23:32:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe649ffb640 1 -- 172.21.15.77:0/3769955512 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540ba930 con 0x55c8ffabf9a0 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 -- 172.21.15.77:0/3769955512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 msgr2=0x55c8ffabbe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fe654031a50 tx=0x7fe65403b9a0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 -- 172.21.15.77:0/3769955512 shutdown_connections 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac5370 0x55c8ffabc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac02e0 0x55c8ffad0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 --2- 172.21.15.77:0/3769955512 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffabf9a0 0x55c8ffabbe90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 -- 172.21.15.77:0/3769955512 >> 172.21.15.77:0/3769955512 conn(0x55c8ffabb010 msgr2=0x55c8ffac9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 -- 172.21.15.77:0/3769955512 shutdown_connections 2024-09-15T23:32:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.540+0000 7fe66d22d740 1 -- 172.21.15.77:0/3769955512 wait complete. 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 -- start start 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 Processor -- start 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8fface8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 0x55c8ffacf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641a93e0 con 0x55c8ffad55f0 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641aa850 con 0x55c8ffac5370 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe6641a9ab0 con 0x55c8ffac02e0 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.541+0000 7fe66d22d740 10 client.0 _ll_register_callbacks cb 0x7fe65c009ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe668954640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 0x55c8ffacf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:51626/0 (socket says 172.21.15.77:51626) 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 -- 172.21.15.77:0/560190173 learned_addr learned my addr 172.21.15.77:0/560190173 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:32:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe6637fe640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8fface8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 -- 172.21.15.77:0/560190173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 msgr2=0x55c8fface8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8fface8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 -- 172.21.15.77:0/560190173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 msgr2=0x55c8ffacf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 0x55c8ffacf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 -- 172.21.15.77:0/560190173 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8ffacfec0 con 0x55c8ffac02e0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe668954640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 0x55c8ffacf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe663fff640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6540b8a00 tx=0x7fe654005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c40739ccdcadb42d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe6437fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6540bbf00 con 0x55c8ffac02e0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe65400b0b0 con 0x55c8ffac02e0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.542+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe6540ba910 con 0x55c8ffac02e0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.543+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe6540bcca0 con 0x55c8ffac02e0 2024-09-15T23:32:53.548 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.543+0000 7fe66d22d740 10 client.25096 fetch_fsmap learned FSMap version 21 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.543+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c8ffb40350 con 0x55c8ffac02e0 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.543+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe65400b0b0 con 0x55c8ffac02e0 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.543+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe6540b8c10 con 0x55c8ffac02e0 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 10 client.25096 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 10 client.25096 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 20 client.25096 populate_metadata read hostname 'smithi077' 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffb40980 0x55c8ffb42da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 4 client.25096 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c8ffa2ad70 con 0x55c8ffb40980 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe6637fe640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffb40980 0x55c8ffb42da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe6637fe640 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffb40980 0x55c8ffb42da0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a423c76a41659832 server_cookie=e057a8d534bf84d3 in_seq=0 out_seq=0 2024-09-15T23:32:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.544+0000 7fe6437fe640 10 client.25096 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.548+0000 7fe6437fe640 1 -- 172.21.15.77:0/560190173 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c8ffa2ad70 con 0x55c8ffb40980 2024-09-15T23:32:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.548+0000 7fe6437fe640 10 client.25096 handle_command_reply: tid=0 2024-09-15T23:32:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.548+0000 7fe66d22d740 1 client.25096 shutdown 2024-09-15T23:32:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.548+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 msgr2=0x55c8fface3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.548+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6540b8a00 tx=0x7fe654005c00 comp rx=0 tx=0).stop 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 shutdown_connections 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c8ffb40980 0x55c8ffb42da0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c8ffad55f0 0x55c8ffacf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe6437fe640 0 client.25096 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c8ffac5370 0x55c8fface8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 --2- 172.21.15.77:0/560190173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c8ffac02e0 0x55c8fface3b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 >> 172.21.15.77:0/560190173 conn(0x55c8ffabb010 msgr2=0x55c8ffab99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 shutdown_connections 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 1 -- 172.21.15.77:0/560190173 wait complete. 2024-09-15T23:32:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.550+0000 7fe66d22d740 20 client.25096 trim_cache size 0 max 16384 2024-09-15T23:32:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:32:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:32:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:32:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 msgr2=0x7fe64c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 0x7fe64c0a57b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe66406a180 tx=0x7fe65800b390 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 msgr2=0x7fe66406a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe654009850 tx=0x7fe6540319e0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 shutdown_connections 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe64c0a32f0 0x7fe64c0a57b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe6641025f0 0x7fe66419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe664101c30 0x7fe66419c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 --2- 172.21.15.77:0/2802179585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe664100a40 0x7fe66406a410 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 >> 172.21.15.77:0/2802179585 conn(0x7fe6640fc1e0 msgr2=0x7fe664104e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:32:53.554 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 shutdown_connections 2024-09-15T23:32:53.555 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:32:53.551+0000 7fe66a3b7640 1 -- 172.21.15.77:0/2802179585 wait complete. 2024-09-15T23:32:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:54 smithi155 ceph-mon[35631]: pgmap v390: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:32:55.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:54 smithi077 ceph-mon[30968]: pgmap v390: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:32:55.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:54 smithi159 ceph-mon[35472]: pgmap v390: 129 pgs: 129 active+clean; 660 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:32:57.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:56 smithi155 ceph-mon[35631]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:57.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:56 smithi077 ceph-mon[30968]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:57.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:56 smithi159 ceph-mon[35472]: pgmap v391: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-15T23:32:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:32:58 smithi155 ceph-mon[35631]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-15T23:32:59.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:32:58 smithi077 ceph-mon[30968]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-15T23:32:59.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:32:58 smithi159 ceph-mon[35472]: pgmap v392: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-09-15T23:33:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:00 smithi155 ceph-mon[35631]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:01.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:00 smithi077 ceph-mon[30968]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:01.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:00 smithi159 ceph-mon[35472]: pgmap v393: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:01.689 INFO:tasks.workunit.client.0.smithi077.stderr:Note: switching to 'ad35db06e8924912f01e32b35576297c0f1352b4'. 2024-09-15T23:33:01.689 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.689 INFO:tasks.workunit.client.0.smithi077.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-15T23:33:01.689 INFO:tasks.workunit.client.0.smithi077.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-15T23:33:01.689 INFO:tasks.workunit.client.0.smithi077.stderr:state without impacting any branches by switching back to a branch. 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: git switch -c 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr:Or undo this operation with: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: git switch - 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr: 2024-09-15T23:33:01.690 INFO:tasks.workunit.client.0.smithi077.stderr:HEAD is now at ad35db06e89 Merge pull request #59794 from zdover23/wip-doc-2024-09-15-backport-59613-to-squid 2024-09-15T23:33:01.694 DEBUG:teuthology.orchestra.run.smithi077:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-15T23:33:01.760 INFO:tasks.workunit.client.0.smithi077.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-15T23:33:01.762 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T23:33:01.762 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-15T23:33:02.477 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-15T23:33:02.541 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-15T23:33:02.582 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-15T23:33:02.583 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T23:33:02.583 INFO:tasks.workunit.client.0.smithi077.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-15T23:33:02.622 INFO:tasks.workunit.client.0.smithi077.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-15T23:33:02.626 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:33:02.626 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-15T23:33:02.682 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-09-15T23:33:02.684 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-09-15T23:33:02.684 DEBUG:teuthology.orchestra.run.smithi077:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ad35db06e8924912f01e32b35576297c0f1352b4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-09-15T23:33:02.764 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-15T23:33:02.866 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-15T23:33:02.867 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Sun Sep 15 23:33:02 2024 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 1048576 kB 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 16 kB 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-09-15T23:33:02.868 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-09-15T23:33:02.869 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-09-15T23:33:02.869 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-09-15T23:33:02.869 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-09-15T23:33:02.869 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-09-15T23:33:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:02 smithi155 ceph-mon[35631]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:03.392 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:02 smithi077 ceph-mon[30968]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:03.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:02 smithi159 ceph-mon[35472]: pgmap v394: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:04.251 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:04.251 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 758749.62 kB/sec 2024-09-15T23:33:04.251 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 758644.66 kB/sec 2024-09-15T23:33:04.251 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 758749.62 kB/sec 2024-09-15T23:33:04.252 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 758749.62 kB/sec 2024-09-15T23:33:04.252 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 758749.62 kB/sec 2024-09-15T23:33:04.252 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:05.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:04 smithi155 ceph-mon[35631]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:05.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:04 smithi077 ceph-mon[30968]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:05.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:04 smithi159 ceph-mon[35472]: pgmap v395: 129 pgs: 129 active+clean; 661 KiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:33:06.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 -- 172.21.15.77:0/3093357976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec107850 msgr2=0x7f74ec109cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 --2- 172.21.15.77:0/3093357976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec107850 0x7f74ec109cc0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009ca0 tx=0x7f74e402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 -- 172.21.15.77:0/3093357976 shutdown_connections 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 --2- 172.21.15.77:0/3093357976 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec107850 0x7f74ec109cc0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 --2- 172.21.15.77:0/3093357976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec104f20 0x7f74ec107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 --2- 172.21.15.77:0/3093357976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 0x7f74ec1049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 -- 172.21.15.77:0/3093357976 >> 172.21.15.77:0/3093357976 conn(0x7f74ec0fc1f0 msgr2=0x7f74ec0fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 -- 172.21.15.77:0/3093357976 shutdown_connections 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.649+0000 7f74f23d6640 1 -- 172.21.15.77:0/3093357976 wait complete. 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 Processor -- start 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 -- start start 2024-09-15T23:33:06.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 0x7f74ec197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec107850 0x7f74ec19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec10d830 con 0x7f74ec104f20 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec10d6b0 con 0x7f74ec1025f0 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74f23d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec10d9b0 con 0x7f74ec107850 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74eb7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51038/0 (socket says 172.21.15.77:51038) 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.650+0000 7f74eb7fe640 1 -- 172.21.15.77:0/2596115963 learned_addr learned my addr 172.21.15.77:0/2596115963 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74ebfff640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 0x7f74ec197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74f0973640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec107850 0x7f74ec19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 -- 172.21.15.77:0/2596115963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec107850 msgr2=0x7f74ec19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec107850 0x7f74ec19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.654 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 -- 172.21.15.77:0/2596115963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 msgr2=0x7f74ec197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 0x7f74ec197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 -- 172.21.15.77:0/2596115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec19fad0 con 0x7f74ec104f20 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d740 tx=0x7f74e000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74e97fa640 1 -- 172.21.15.77:0/2596115963 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0017070 con 0x7f74ec104f20 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74e97fa640 1 -- 172.21.15.77:0/2596115963 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74e000de50 con 0x7f74ec104f20 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74ec19fdc0 con 0x7f74ec104f20 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74e97fa640 1 -- 172.21.15.77:0/2596115963 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0004e00 con 0x7f74ec104f20 2024-09-15T23:33:06.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.651+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74ec1a0230 con 0x7f74ec104f20 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.653+0000 7f74e97fa640 1 -- 172.21.15.77:0/2596115963 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f74e0004fa0 con 0x7f74ec104f20 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 Processor -- start 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 -- start start 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 0x55a3453ee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a34534a2f0 con 0x55a3453e69a0 2024-09-15T23:33:06.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a3452f2270 con 0x55a3453e72e0 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f524e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a3453462b0 con 0x55a3453ec370 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f0973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f0973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51054/0 (socket says 172.21.15.77:51054) 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f0973640 1 -- 172.21.15.77:0/1246552590 learned_addr learned my addr 172.21.15.77:0/1246552590 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74e97fa640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 0x7f74d40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 0x55a3453ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.654+0000 7f74f0973640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 0x7f74d40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 -- 172.21.15.77:0/1246552590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 msgr2=0x55a3453ee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 0x55a3453ee830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 -- 172.21.15.77:0/1246552590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 msgr2=0x55a3453e6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 -- 172.21.15.77:0/1246552590 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3452f1340 con 0x55a3453e72e0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 0x55a3453ee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74f0973640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74e97fa640 1 -- 172.21.15.77:0/2596115963 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f74e00cf5c0 con 0x7f74ec104f20 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453ebda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bbf0 tx=0x7f74dc0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d06692f73ade46a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74f0973640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 0x7f74d40a57b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74e4004af0 tx=0x7f74e402a8c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74d27fc640 1 -- 172.21.15.77:0/1246552590 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc004030 con 0x55a3453e72e0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74d27fc640 1 -- 172.21.15.77:0/1246552590 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74dc0041d0 con 0x55a3453e72e0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.655+0000 7f74d27fc640 1 -- 172.21.15.77:0/1246552590 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc0116a0 con 0x55a3453e72e0 2024-09-15T23:33:06.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- 172.21.15.77:0/1246552590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 msgr2=0x55a3453ebda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453ebda0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f74dc00bbf0 tx=0x7f74dc0107a0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- 172.21.15.77:0/1246552590 shutdown_connections 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453ec370 0x55a3453ee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453ebda0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 --2- 172.21.15.77:0/1246552590 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- 172.21.15.77:0/1246552590 >> 172.21.15.77:0/1246552590 conn(0x55a3453e2010 msgr2=0x55a3453e2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- 172.21.15.77:0/1246552590 shutdown_connections 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- 172.21.15.77:0/1246552590 wait complete. 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.656+0000 7f74f524e740 1 -- start start 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 Processor -- start 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453f8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55a3453ef340 con 0x55a3453e69a0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a3452d3290 con 0x55a3453ec370 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55a3453ef4c0 con 0x55a3453e72e0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f524e740 10 client.0 _ll_register_callbacks cb 0x55a345304140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51058/0 (socket says 172.21.15.77:51058) 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 -- 172.21.15.77:0/1908667383 learned_addr learned my addr 172.21.15.77:0/1908667383 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f0973640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 -- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 msgr2=0x55a3453f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 -- 172.21.15.77:0/1908667383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 msgr2=0x55a3453f8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453f8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 -- 172.21.15.77:0/1908667383 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a34505d210 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74f0973640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74ebfff640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000c00 tx=0x7f74dc00bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d70603b63f3812 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.657+0000 7f74cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc02a060 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f74dc005040 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74dc0041d0 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f74dc031050 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 10 client.15576 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a345129620 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74dc0041d0 con 0x55a3453e69a0 2024-09-15T23:33:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f74dc004860 con 0x55a3453e69a0 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 10 client.15576 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 20 client.15576 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a3453fc570 0x55a3453fe960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 4 client.15576 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.658+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a345357a20 con 0x55a3453fc570 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.659+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a3453fc570 0x55a3453fe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.659+0000 7f74cb7fe640 10 client.15576 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.659+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a3453fc570 0x55a3453fe960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57b35a10212b17a server_cookie=eb9e26dc899dd50f in_seq=0 out_seq=0 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74cb7fe640 1 -- 172.21.15.77:0/1908667383 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a345357a20 con 0x55a3453fc570 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74cb7fe640 10 client.15576 handle_command_reply: tid=0 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 client.15576 shutdown 2024-09-15T23:33:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 msgr2=0x55a3453f0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f74dc000c00 tx=0x7f74dc00bfd0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 shutdown_connections 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a3453fc570 0x55a3453fe960 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453f8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74cb7fe640 0 client.15576 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 --2- 172.21.15.77:0/1908667383 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453f0b90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 >> 172.21.15.77:0/1908667383 conn(0x55a3453e2010 msgr2=0x55a3453e3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 shutdown_connections 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 1 -- 172.21.15.77:0/1908667383 wait complete. 2024-09-15T23:33:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.660+0000 7f74f524e740 20 client.15576 trim_cache size 0 max 16384 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.674+0000 7f74f524e740 1 Processor -- start 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 -- start start 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453e3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1a87a0 con 0x55a3453e69a0 2024-09-15T23:33:06.680 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1ab020 con 0x55a3453ec370 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f524e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1a8e10 con 0x55a3453e72e0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51072/0 (socket says 172.21.15.77:51072) 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 -- 172.21.15.77:0/2971377014 learned_addr learned my addr 172.21.15.77:0/2971377014 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f0973640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453e3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 -- 172.21.15.77:0/2971377014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 msgr2=0x55a3453f80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 -- 172.21.15.77:0/2971377014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 msgr2=0x55a3453e3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453e3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 -- 172.21.15.77:0/2971377014 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3453e1e30 con 0x55a3453e69a0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74f0973640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453e3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74ebfff640 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74dc004280 tx=0x7f74dc00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d1070ce7090c4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.681 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74d1ffb640 1 -- 172.21.15.77:0/2971377014 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc01f070 con 0x55a3453e69a0 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74d1ffb640 1 -- 172.21.15.77:0/2971377014 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74dc0116a0 con 0x55a3453e69a0 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.675+0000 7f74d1ffb640 1 -- 172.21.15.77:0/2971377014 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74dc02a070 con 0x55a3453e69a0 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- 172.21.15.77:0/2971377014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 msgr2=0x55a3453e10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f74dc004280 tx=0x7f74dc00b390 comp rx=0 tx=0).stop 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- 172.21.15.77:0/2971377014 shutdown_connections 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453ec370 0x55a3453e3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e72e0 0x55a3453f80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 --2- 172.21.15.77:0/2971377014 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453e69a0 0x55a3453e10b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- 172.21.15.77:0/2971377014 >> 172.21.15.77:0/2971377014 conn(0x55a3453e2010 msgr2=0x55a3453e09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- 172.21.15.77:0/2971377014 shutdown_connections 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- 172.21.15.77:0/2971377014 wait complete. 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.676+0000 7f74f524e740 1 -- start start 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 Processor -- start 2024-09-15T23:33:06.682 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e69a0 0x55a3453f5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1a94e0 con 0x55a3453ec370 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1aa950 con 0x55a3453e72e0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f74ec1a9bb0 con 0x55a3453e69a0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f524e740 10 client.0 _ll_register_callbacks cb 0x7f74e4004a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51082/0 (socket says 172.21.15.77:51082) 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 -- 172.21.15.77:0/3682348649 learned_addr learned my addr 172.21.15.77:0/3682348649 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74ebfff640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e69a0 0x55a3453f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74eb7fe640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 -- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e69a0 msgr2=0x55a3453f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.683 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e69a0 0x55a3453f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 -- 172.21.15.77:0/3682348649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 msgr2=0x55a3453f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453f5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 -- 172.21.15.77:0/3682348649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3453f74f0 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74f0973640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74e4031780 tx=0x7f74e40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48e8c3722f4d2656 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.677+0000 7f74cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40047c0 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f74e402f610 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74dc0116a0 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f74e4004b40 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 10 client.15582 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55a3454673d0 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74dc0116a0 con 0x55a3453ec370 2024-09-15T23:33:06.684 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f74e40306c0 con 0x55a3453ec370 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 10 client.15582 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 20 client.15582 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a345467da0 0x55a34546a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 4 client.15582 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a345351d70 con 0x55a345467da0 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.678+0000 7f74ebfff640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a345467da0 0x55a34546a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.679+0000 7f74ebfff640 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a345467da0 0x55a34546a1c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5748290b27de1ff4 server_cookie=b8c584fefc29b96e in_seq=0 out_seq=0 2024-09-15T23:33:06.685 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.679+0000 7f74cb7fe640 10 client.15582 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74cb7fe640 1 -- 172.21.15.77:0/3682348649 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a345351d70 con 0x55a345467da0 2024-09-15T23:33:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74cb7fe640 10 client.15582 handle_command_reply: tid=0 2024-09-15T23:33:06.690 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 client.15582 shutdown 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 msgr2=0x55a3453f6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f74e4031780 tx=0x7f74e40095c0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 shutdown_connections 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55a345467da0 0x55a34546a1c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55a3453ec370 0x55a3453f6ee0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74cb7fe640 0 client.15582 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a3453e72e0 0x55a3453f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 --2- 172.21.15.77:0/3682348649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55a3453e69a0 0x55a3453f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 >> 172.21.15.77:0/3682348649 conn(0x55a3453e2010 msgr2=0x55a3453e11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 shutdown_connections 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 1 -- 172.21.15.77:0/3682348649 wait complete. 2024-09-15T23:33:06.691 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f524e740 20 client.15582 trim_cache size 0 max 16384 2024-09-15T23:33:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:33:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:33:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:33:06.692 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.689+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 msgr2=0x7f74d40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 0x7f74d40a57b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74e4004af0 tx=0x7f74e402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 msgr2=0x7f74ec1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f74e000d740 tx=0x7f74e000dc00 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 shutdown_connections 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f74d40a32f0 0x7f74d40a57b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74ec107850 0x7f74ec19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f74ec104f20 0x7f74ec1983f0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 --2- 172.21.15.77:0/2596115963 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74ec1025f0 0x7f74ec197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:06.693 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 >> 172.21.15.77:0/2596115963 conn(0x7f74ec0fc1f0 msgr2=0x7f74ec102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 shutdown_connections 2024-09-15T23:33:06.694 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:06.690+0000 7f74f23d6640 1 -- 172.21.15.77:0/2596115963 wait complete. 2024-09-15T23:33:07.260 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:06 smithi077 ceph-mon[30968]: pgmap v396: 129 pgs: 129 active+clean; 549 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 15 op/s 2024-09-15T23:33:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:06 smithi155 ceph-mon[35631]: pgmap v396: 129 pgs: 129 active+clean; 549 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 15 op/s 2024-09-15T23:33:07.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:06 smithi159 ceph-mon[35472]: pgmap v396: 129 pgs: 129 active+clean; 549 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 46 MiB/s wr, 15 op/s 2024-09-15T23:33:08.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:07 smithi155 ceph-mon[35631]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 78 MiB/s wr, 22 op/s 2024-09-15T23:33:08.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:07 smithi077 ceph-mon[30968]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 78 MiB/s wr, 22 op/s 2024-09-15T23:33:08.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:07 smithi159 ceph-mon[35472]: pgmap v397: 129 pgs: 129 active+clean; 937 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 78 MiB/s wr, 22 op/s 2024-09-15T23:33:09.692 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:09.692 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 813874.75 kB/sec 2024-09-15T23:33:09.693 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 813730.22 kB/sec 2024-09-15T23:33:09.693 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 813874.75 kB/sec 2024-09-15T23:33:09.693 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 813874.75 kB/sec 2024-09-15T23:33:09.693 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 813874.75 kB/sec 2024-09-15T23:33:09.693 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:11.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:10 smithi159 ceph-mon[35472]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 92 MiB/s wr, 29 op/s 2024-09-15T23:33:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:10 smithi155 ceph-mon[35631]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 92 MiB/s wr, 29 op/s 2024-09-15T23:33:11.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:10 smithi077 ceph-mon[30968]: pgmap v398: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 92 MiB/s wr, 29 op/s 2024-09-15T23:33:11.898 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:33:12.160 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 7247100.50 kB/sec 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 7238202.94 kB/sec 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7247100.50 kB/sec 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7247100.50 kB/sec 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7247100.50 kB/sec 2024-09-15T23:33:12.646 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 -- 172.21.15.77:0/3864921691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4102790 msgr2=0x7f00b41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 --2- 172.21.15.77:0/3864921691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4102790 0x7f00b41067e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009900 tx=0x7f00a802a410 comp rx=0 tx=0).stop 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 -- 172.21.15.77:0/3864921691 shutdown_connections 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 --2- 172.21.15.77:0/3864921691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4106f10 0x7f00b410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 --2- 172.21.15.77:0/3864921691 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4102790 0x7f00b41067e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 --2- 172.21.15.77:0/3864921691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4101de0 0x7f00b41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 -- 172.21.15.77:0/3864921691 >> 172.21.15.77:0/3864921691 conn(0x7f00b40fd8c0 msgr2=0x7f00b40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 -- 172.21.15.77:0/3864921691 shutdown_connections 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 -- 172.21.15.77:0/3864921691 wait complete. 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.712+0000 7f00ba120640 1 Processor -- start 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 -- start start 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4101de0 0x7f00b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 0x7f00b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4111f90 con 0x7f00b4106f10 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4111e10 con 0x7f00b4102790 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00ba120640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f00b4112110 con 0x7f00b4101de0 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45066/0 (socket says 172.21.15.77:45066) 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 -- 172.21.15.77:0/1211623950 learned_addr learned my addr 172.21.15.77:0/1211623950 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b37fe640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4101de0 0x7f00b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.955 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 0x7f00b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 -- 172.21.15.77:0/1211623950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4101de0 msgr2=0x7f00b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4101de0 0x7f00b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 -- 172.21.15.77:0/1211623950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 msgr2=0x7f00b4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 0x7f00b4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 -- 172.21.15.77:0/1211623950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b41a68e0 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 0x7f00b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.713+0000 7f00b3fff640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b970 tx=0x7f00ac00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.714+0000 7f00b0ff9640 1 -- 172.21.15.77:0/1211623950 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac019070 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.714+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b41a6bd0 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.714+0000 7f00b0ff9640 1 -- 172.21.15.77:0/1211623950 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00ac014440 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.714+0000 7f00b0ff9640 1 -- 172.21.15.77:0/1211623950 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0075d0 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.714+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b41a70c0 con 0x7f00b4106f10 2024-09-15T23:33:12.956 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00b0ff9640 1 -- 172.21.15.77:0/1211623950 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f00ac01c070 con 0x7f00b4106f10 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 Processor -- start 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 -- start start 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc2f680 0x563a4fc31a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a4fb8a2e0 con 0x563a4fc244a0 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563a4fb31ce0 con 0x563a4fc2f680 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563a4fb862a0 con 0x563a4fc24dc0 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45082/0 (socket says 172.21.15.77:45082) 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.716+0000 7f00b2ffd640 1 -- 172.21.15.77:0/449844202 learned_addr learned my addr 172.21.15.77:0/449844202 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b37fe640 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b0ff9640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 0x7f009c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 -- 172.21.15.77:0/449844202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 msgr2=0x563a4fc2f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 -- 172.21.15.77:0/449844202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc2f680 msgr2=0x563a4fc31a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc2f680 0x563a4fc31a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 -- 172.21.15.77:0/449844202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4fb16440 con 0x563a4fc244a0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b3fff640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 0x7f009c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b0ff9640 1 -- 172.21.15.77:0/1211623950 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f00ac0cf2d0 con 0x7f00b4106f10 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005ab0 tx=0x7f00a8032df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca84158121329a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f0099ffb640 1 -- 172.21.15.77:0/449844202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035050 con 0x563a4fc244a0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f0099ffb640 1 -- 172.21.15.77:0/449844202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a80317b0 con 0x563a4fc244a0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.717+0000 7f0099ffb640 1 -- 172.21.15.77:0/449844202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a80046c0 con 0x563a4fc244a0 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- 172.21.15.77:0/449844202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 msgr2=0x563a4fc24880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.958 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00b3fff640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 0x7f009c0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b940 tx=0x7f00ac06e3e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005ab0 tx=0x7f00a8032df0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- 172.21.15.77:0/449844202 shutdown_connections 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc2f680 0x563a4fc31a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/449844202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc244a0 0x563a4fc24880 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- 172.21.15.77:0/449844202 >> 172.21.15.77:0/449844202 conn(0x563a4fc20a30 msgr2=0x563a4fc20e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- 172.21.15.77:0/449844202 shutdown_connections 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- 172.21.15.77:0/449844202 wait complete. 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.718+0000 7f00bc4f9740 1 -- start start 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 Processor -- start 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc244a0 0x563a4fc2ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563a4fc32250 con 0x563a4fc2f680 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563a4fb45050 con 0x563a4fc244a0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563a4fc323d0 con 0x563a4fc24dc0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00bc4f9740 10 client.0 _ll_register_callbacks cb 0x563a4fb85160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45096/0 (socket says 172.21.15.77:45096) 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 -- 172.21.15.77:0/1312763417 learned_addr learned my addr 172.21.15.77:0/1312763417 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b37fe640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc244a0 0x563a4fc2ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 -- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 msgr2=0x563a4fc2c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 -- 172.21.15.77:0/1312763417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc244a0 msgr2=0x563a4fc2ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc244a0 0x563a4fc2ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 -- 172.21.15.77:0/1312763417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4f8fb3c0 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005a80 tx=0x7f00a80053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8700a9b7dd0c4b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.719+0000 7f0092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035030 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f00a8004310 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a80317b0 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f00a8058050 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 10 client.15594 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563a4fc3dba0 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a80317b0 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f00a8003ab0 con 0x563a4fc2f680 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 10 client.15594 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 10 client.15594 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:12.961 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 20 client.15594 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc3eef0 0x563a4fc412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 4 client.15594 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a4fb97850 con 0x563a4fc3eef0 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.720+0000 7f00b37fe640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc3eef0 0x563a4fc412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.721+0000 7f0092ffd640 10 client.15594 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.721+0000 7f00b37fe640 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc3eef0 0x563a4fc412e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1ff1591dbc96a82 server_cookie=d58e0b2e6acb727c in_seq=0 out_seq=0 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f0092ffd640 1 -- 172.21.15.77:0/1312763417 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563a4fb97850 con 0x563a4fc3eef0 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f0092ffd640 10 client.15594 handle_command_reply: tid=0 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 client.15594 shutdown 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 msgr2=0x563a4fc2c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005a80 tx=0x7f00a80053e0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 shutdown_connections 2024-09-15T23:33:12.962 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc3eef0 0x563a4fc412e0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc2f680 0x563a4fc2c720 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc24dc0 0x563a4fc2c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f0092ffd640 0 client.15594 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/1312763417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc244a0 0x563a4fc2ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 >> 172.21.15.77:0/1312763417 conn(0x563a4fc20a30 msgr2=0x563a4fc26760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 shutdown_connections 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 1 -- 172.21.15.77:0/1312763417 wait complete. 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.722+0000 7f00bc4f9740 20 client.15594 trim_cache size 0 max 16384 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 Processor -- start 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 -- start start 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.963 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc24dc0 0x563a4fc44300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41aedd0 con 0x563a4fc20a30 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41b1650 con 0x563a4fc24dc0 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41af440 con 0x563a4fc244a0 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45110/0 (socket says 172.21.15.77:45110) 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 -- 172.21.15.77:0/813682644 learned_addr learned my addr 172.21.15.77:0/813682644 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 -- 172.21.15.77:0/813682644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 msgr2=0x563a4fc277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 -- 172.21.15.77:0/813682644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc24dc0 msgr2=0x563a4fc44300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc24dc0 0x563a4fc44300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 -- 172.21.15.77:0/813682644 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a4fc24bf0 con 0x563a4fc20a30 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.739+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005270 tx=0x7f00a8005450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb38edd1805223f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00997fa640 1 -- 172.21.15.77:0/813682644 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8035040 con 0x563a4fc20a30 2024-09-15T23:33:12.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00997fa640 1 -- 172.21.15.77:0/813682644 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a803a610 con 0x563a4fc20a30 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00997fa640 1 -- 172.21.15.77:0/813682644 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a803a910 con 0x563a4fc20a30 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- 172.21.15.77:0/813682644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 msgr2=0x563a4fc2c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f00a8005270 tx=0x7f00a8005450 comp rx=0 tx=0).stop 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- 172.21.15.77:0/813682644 shutdown_connections 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc24dc0 0x563a4fc44300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/813682644 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc20a30 0x563a4fc2c1a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- 172.21.15.77:0/813682644 >> 172.21.15.77:0/813682644 conn(0x563a4fc2c880 msgr2=0x563a4fc270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- 172.21.15.77:0/813682644 shutdown_connections 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- 172.21.15.77:0/813682644 wait complete. 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.740+0000 7f00bc4f9740 1 -- start start 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 Processor -- start 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc20a30 0x563a4fc42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.965 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41afb10 con 0x563a4fc24dc0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41b0f80 con 0x563a4fc20a30 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f00b41b01e0 con 0x563a4fc244a0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00bc4f9740 10 client.0 _ll_register_callbacks cb 0x7f00a8032cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45118/0 (socket says 172.21.15.77:45118) 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 -- 172.21.15.77:0/2351256794 learned_addr learned my addr 172.21.15.77:0/2351256794 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b37fe640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc20a30 0x563a4fc42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 -- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 msgr2=0x563a4fc425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.966 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 -- 172.21.15.77:0/2351256794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc20a30 msgr2=0x563a4fc42090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc20a30 0x563a4fc42090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b2ffd640 1 -- 172.21.15.77:0/2351256794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a4fca8830 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.741+0000 7f00b37fe640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00b2ffd640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f00a8032ea0 tx=0x7f00a802ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3741ce57a59d696b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a806a060 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f00a8031d70 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a803a610 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f00a8004110 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 10 client.15600 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563a4fca9a90 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f00a803a610 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f00a80048f0 con 0x563a4fc24dc0 2024-09-15T23:33:12.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 10 client.15600 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 10 client.15600 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 20 client.15600 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc2f680 0x563a4fcabf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 4 client.15600 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.742+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a4fb91d60 con 0x563a4fc2f680 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00b37fe640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc2f680 0x563a4fcabf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00b37fe640 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc2f680 0x563a4fcabf70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6f5d0b1ed04545 server_cookie=e81b927d33f20f5a in_seq=0 out_seq=0 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f0092ffd640 10 client.15600 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f0092ffd640 1 -- 172.21.15.77:0/2351256794 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a4fb91d60 con 0x563a4fc2f680 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f0092ffd640 10 client.15600 handle_command_reply: tid=0 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 client.15600 shutdown 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 msgr2=0x563a4fc42b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f00a8032ea0 tx=0x7f00a802ab90 comp rx=0 tx=0).stop 2024-09-15T23:33:12.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 shutdown_connections 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563a4fc2f680 0x563a4fcabf70 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563a4fc24dc0 0x563a4fc42b10 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563a4fc244a0 0x563a4fc425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f0092ffd640 0 client.15600 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:33:12.969 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 --2- 172.21.15.77:0/2351256794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563a4fc20a30 0x563a4fc42090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 >> 172.21.15.77:0/2351256794 conn(0x563a4fc2c880 msgr2=0x563a4fc2e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 shutdown_connections 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.743+0000 7f00bc4f9740 1 -- 172.21.15.77:0/2351256794 wait complete. 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00bc4f9740 20 client.15600 trim_cache size 0 max 16384 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 msgr2=0x7f009c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 0x7f009c0a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b940 tx=0x7f00ac06e3e0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 msgr2=0x7f00b4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00b970 tx=0x7f00ac00bd70 comp rx=0 tx=0).stop 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 shutdown_connections 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f009c0a3240 0x7f009c0a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f00b4106f10 0x7f00b4074f70 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f00b4102790 0x7f00b4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 --2- 172.21.15.77:0/1211623950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00b4101de0 0x7f00b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 >> 172.21.15.77:0/1211623950 conn(0x7f00b40fd8c0 msgr2=0x7f00b40fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 shutdown_connections 2024-09-15T23:33:12.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:12.744+0000 7f00ba120640 1 -- 172.21.15.77:0/1211623950 wait complete. 2024-09-15T23:33:13.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:12 smithi159 ceph-mon[35472]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 140 MiB/s wr, 41 op/s 2024-09-15T23:33:13.310 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:12 smithi077 ceph-mon[30968]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 140 MiB/s wr, 41 op/s 2024-09-15T23:33:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:12 smithi155 ceph-mon[35631]: pgmap v399: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 140 MiB/s wr, 41 op/s 2024-09-15T23:33:13.612 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:33:13.613 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:33:13.862 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 -- 172.21.15.77:0/4066102089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 msgr2=0x7f42881021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 --2- 172.21.15.77:0/4066102089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f42881021d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4278009900 tx=0x7f427802a410 comp rx=0 tx=0).stop 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 -- 172.21.15.77:0/4066102089 shutdown_connections 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 --2- 172.21.15.77:0/4066102089 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 0x7f428810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 --2- 172.21.15.77:0/4066102089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 0x7f42881067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 --2- 172.21.15.77:0/4066102089 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f42881021d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 -- 172.21.15.77:0/4066102089 >> 172.21.15.77:0/4066102089 conn(0x7f42880fd8b0 msgr2=0x7f42880ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 -- 172.21.15.77:0/4066102089 shutdown_connections 2024-09-15T23:33:14.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.406+0000 7f428e296640 1 -- 172.21.15.77:0/4066102089 wait complete. 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 Processor -- start 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 -- start start 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 0x7f42881989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 0x7f428819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f4288111fc0 con 0x7f4288101df0 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4288111e40 con 0x7f4288106f20 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428e296640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4288112140 con 0x7f42881027a0 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f4287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f4287fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45142/0 (socket says 172.21.15.77:45142) 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f4287fff640 1 -- 172.21.15.77:0/3227905744 learned_addr learned my addr 172.21.15.77:0/3227905744 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f42877fe640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 0x7f42881989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:14.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.407+0000 7f428c833640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 0x7f428819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 -- 172.21.15.77:0/3227905744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 msgr2=0x7f42881989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 0x7f42881989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 -- 172.21.15.77:0/3227905744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 msgr2=0x7f428819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 0x7f428819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 -- 172.21.15.77:0/3227905744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428819d440 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f4287fff640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4278006010 tx=0x7f42780042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427803f030 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4278003ce0 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f428819d6d0 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4278035070 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.408+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42881a5010 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.409+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42881032d0 con 0x7f4288101df0 2024-09-15T23:33:14.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.410+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4278042030 con 0x7f4288101df0 2024-09-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.411+0000 7f42857fa640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 0x7f42700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.411+0000 7f42877fe640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 0x7f42700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.411+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f42780f0550 con 0x7f4288101df0 2024-09-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.411+0000 7f42877fe640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 0x7f42700a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42880fdd40 tx=0x7f427c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:14.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.414+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f42780bc950 con 0x7f4288101df0 2024-09-15T23:33:14.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.614+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f428810a100 con 0x7f4288101df0 2024-09-15T23:33:14.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.615+0000 7f42857fa640 1 -- 172.21.15.77:0/3227905744 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f42780c0c50 con 0x7f4288101df0 2024-09-15T23:33:14.616 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:33:14.617 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:33:14.617 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 msgr2=0x7f42700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 0x7f42700a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42880fdd40 tx=0x7f427c00b390 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 msgr2=0x7f4288198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4278006010 tx=0x7f42780042f0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 shutdown_connections 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f42700a3240 0x7f42700a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4288106f20 0x7f428819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42881027a0 0x7f42881989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 --2- 172.21.15.77:0/3227905744 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f4288101df0 0x7f4288198490 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.617+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 >> 172.21.15.77:0/3227905744 conn(0x7f42880fd8b0 msgr2=0x7f42880feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:14.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.618+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 shutdown_connections 2024-09-15T23:33:14.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:14.618+0000 7f428e296640 1 -- 172.21.15.77:0/3227905744 wait complete. 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 7228626.00 kB/sec 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 7218411.04 kB/sec 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7228626.00 kB/sec 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7228626.00 kB/sec 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7228626.00 kB/sec 2024-09-15T23:33:15.033 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:14 smithi159 ceph-mon[35472]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 157 MiB/s wr, 45 op/s 2024-09-15T23:33:15.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:14 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3227905744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:14 smithi155 ceph-mon[35631]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 157 MiB/s wr, 45 op/s 2024-09-15T23:33:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:14 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3227905744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:15.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:14 smithi077 ceph-mon[30968]: pgmap v400: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 157 MiB/s wr, 45 op/s 2024-09-15T23:33:15.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:14 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3227905744' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:15.499 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:33:15.748 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:16.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 -- 172.21.15.77:0/307411921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 msgr2=0x7f18681021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 --2- 172.21.15.77:0/307411921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681021c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1858009900 tx=0x7f185802a410 comp rx=0 tx=0).stop 2024-09-15T23:33:16.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 -- 172.21.15.77:0/307411921 shutdown_connections 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 --2- 172.21.15.77:0/307411921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 0x7f186810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 --2- 172.21.15.77:0/307411921 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 0x7f18681067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 --2- 172.21.15.77:0/307411921 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681021c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 -- 172.21.15.77:0/307411921 >> 172.21.15.77:0/307411921 conn(0x7f18680fd8c0 msgr2=0x7f18680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 -- 172.21.15.77:0/307411921 shutdown_connections 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.209+0000 7f186dd1a640 1 -- 172.21.15.77:0/307411921 wait complete. 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 Processor -- start 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 -- start start 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 0x7f1868198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 0x7f186819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1868112010 con 0x7f1868101de0 2024-09-15T23:33:16.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1868111e90 con 0x7f1868106f10 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f186dd1a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1868112190 con 0x7f1868102790 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45160/0 (socket says 172.21.15.77:45160) 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 -- 172.21.15.77:0/75858994 learned_addr learned my addr 172.21.15.77:0/75858994 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f1867fff640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 0x7f186819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f1866ffd640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 0x7f1868198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 -- 172.21.15.77:0/75858994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 msgr2=0x7f1868198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 0x7f1868198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 -- 172.21.15.77:0/75858994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 msgr2=0x7f186819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 0x7f186819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 -- 172.21.15.77:0/75858994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186819d560 con 0x7f1868101de0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.210+0000 7f18677fe640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1858005ab0 tx=0x7f18580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.211+0000 7f1864ff9640 1 -- 172.21.15.77:0/75858994 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185803f030 con 0x7f1868101de0 2024-09-15T23:33:16.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.211+0000 7f1864ff9640 1 -- 172.21.15.77:0/75858994 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1858003ce0 con 0x7f1868101de0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.211+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186819d7f0 con 0x7f1868101de0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.211+0000 7f1864ff9640 1 -- 172.21.15.77:0/75858994 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858035070 con 0x7f1868101de0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.211+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18681a5130 con 0x7f1868101de0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.213+0000 7f1864ff9640 1 -- 172.21.15.77:0/75858994 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1858042030 con 0x7f1868101de0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.213+0000 7f18700f3740 1 Processor -- start 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.213+0000 7f18700f3740 1 -- start start 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d5714fe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d5714fea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1864ff9640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d5714642f0 con 0x55d57150d780 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d57140bcf0 con 0x55d5714fe5d0 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18700f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d5714602b0 con 0x55d5714ffb40 2024-09-15T23:33:16.230 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1867fff640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45170/0 (socket says 172.21.15.77:45170) 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 -- 172.21.15.77:0/3446378012 learned_addr learned my addr 172.21.15.77:0/3446378012 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1867fff640 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d5714fe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1864ff9640 1 -- 172.21.15.77:0/75858994 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f18580f0640 con 0x7f1868101de0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f18677fe640 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d5714fea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 -- 172.21.15.77:0/3446378012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 msgr2=0x55d5714fe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d5714fe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 -- 172.21.15.77:0/3446378012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 msgr2=0x55d5714fea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d5714fea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 -- 172.21.15.77:0/3446378012 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5713f03a0 con 0x55d57150d780 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1867fff640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 0x7f18540a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1860009fd0 tx=0x7f1860009d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f1866ffd640 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f185000b770 tx=0x7f185000bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a565b10cd906295 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f185dffb640 1 -- 172.21.15.77:0/3446378012 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185000d950 con 0x55d57150d780 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.214+0000 7f185dffb640 1 -- 172.21.15.77:0/3446378012 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1850018070 con 0x55d57150d780 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f185dffb640 1 -- 172.21.15.77:0/3446378012 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18500123e0 con 0x55d57150d780 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 -- 172.21.15.77:0/3446378012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 msgr2=0x55d57150fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f185000b770 tx=0x7f185000bc30 comp rx=0 tx=0).stop 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 -- 172.21.15.77:0/3446378012 shutdown_connections 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d57150fb70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d5714fea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 --2- 172.21.15.77:0/3446378012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d5714fe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 -- 172.21.15.77:0/3446378012 >> 172.21.15.77:0/3446378012 conn(0x55d5714c7310 msgr2=0x55d5714fac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 -- 172.21.15.77:0/3446378012 shutdown_connections 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.215+0000 7f18700f3740 1 -- 172.21.15.77:0/3446378012 wait complete. 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 -- start start 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 Processor -- start 2024-09-15T23:33:16.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d57150a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d57150d780 0x55d57150a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55d571510480 con 0x55d5714fe5d0 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d57141f060 con 0x55d5714ffb40 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55d571510600 con 0x55d57150d780 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18700f3740 10 client.0 _ll_register_callbacks cb 0x55d5711728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18677fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45174/0 (socket says 172.21.15.77:45174) 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f18677fe640 1 -- 172.21.15.77:0/1924837105 learned_addr learned my addr 172.21.15.77:0/1924837105 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f1867fff640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d57150d780 0x55d57150a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.216+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d57150a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 -- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d57150d780 msgr2=0x55d57150a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d57150d780 0x55d57150a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 -- 172.21.15.77:0/1924837105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 msgr2=0x55d57150a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d57150a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 -- 172.21.15.77:0/1924837105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5711d53c0 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18677fe640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f18580ee120 tx=0x7f18580bc410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1187e2949a39d00f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1858049030 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1850018070 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f185803bd70 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f18580bc8d0 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 10 client.15618 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d57151be90 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1850018070 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f18580b8f40 con 0x55d5714fe5d0 2024-09-15T23:33:16.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 10 client.15618 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 10 client.15618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 20 client.15618 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d57151d2d0 0x55d57151f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 4 client.15618 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.217+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d571471860 con 0x55d57151d2d0 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.218+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d57151d2d0 0x55d57151f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.218+0000 7f1846ffd640 10 client.15618 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.218+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d57151d2d0 0x55d57151f6e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55cc0326b2973ce1 server_cookie=207a1d5ae0527045 in_seq=0 out_seq=0 2024-09-15T23:33:16.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f1846ffd640 1 -- 172.21.15.77:0/1924837105 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d571471860 con 0x55d57151d2d0 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f1846ffd640 10 client.15618 handle_command_reply: tid=0 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 client.15618 shutdown 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 msgr2=0x55d57150d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f18580ee120 tx=0x7f18580bc410 comp rx=0 tx=0).stop 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 shutdown_connections 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d57151d2d0 0x55d57151f6e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d57150d780 0x55d57150a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d57150a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f1846ffd640 0 client.15618 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 --2- 172.21.15.77:0/1924837105 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d5714fe5d0 0x55d57150d0f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 >> 172.21.15.77:0/1924837105 conn(0x55d5714c7310 msgr2=0x55d571500960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 shutdown_connections 2024-09-15T23:33:16.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 1 -- 172.21.15.77:0/1924837105 wait complete. 2024-09-15T23:33:16.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.219+0000 7f18700f3740 20 client.15618 trim_cache size 0 max 16384 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.233+0000 7f18700f3740 1 Processor -- start 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.233+0000 7f18700f3740 1 -- start start 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.233+0000 7f18700f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d571519720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.233+0000 7f18700f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d571500820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.233+0000 7f18700f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f18700f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18681aaa90 con 0x55d57150d780 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f18700f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ad310 con 0x55d5714fe5d0 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f18700f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ab100 con 0x55d5714ffb40 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45182/0 (socket says 172.21.15.77:45182) 2024-09-15T23:33:16.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 -- 172.21.15.77:0/1352193231 learned_addr learned my addr 172.21.15.77:0/1352193231 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d571500820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f18677fe640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d571519720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 -- 172.21.15.77:0/1352193231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 msgr2=0x55d571500820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d571500820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 -- 172.21.15.77:0/1352193231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 msgr2=0x55d571519720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d571519720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 -- 172.21.15.77:0/1352193231 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5715088f0 con 0x55d57150d780 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d571500820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f1867fff640 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c40 tx=0x7f186001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a434f80292429a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f185d7fa640 1 -- 172.21.15.77:0/1352193231 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860013040 con 0x55d57150d780 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f185d7fa640 1 -- 172.21.15.77:0/1352193231 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f186002a070 con 0x55d57150d780 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.234+0000 7f185d7fa640 1 -- 172.21.15.77:0/1352193231 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860025d30 con 0x55d57150d780 2024-09-15T23:33:16.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- 172.21.15.77:0/1352193231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 msgr2=0x55d571500d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1860009c40 tx=0x7f186001c000 comp rx=0 tx=0).stop 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- 172.21.15.77:0/1352193231 shutdown_connections 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d571500d60 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714ffb40 0x55d571500820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 --2- 172.21.15.77:0/1352193231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714fe5d0 0x55d571519720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- 172.21.15.77:0/1352193231 >> 172.21.15.77:0/1352193231 conn(0x55d5714c7310 msgr2=0x55d571500110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- 172.21.15.77:0/1352193231 shutdown_connections 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- 172.21.15.77:0/1352193231 wait complete. 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.235+0000 7f18700f3740 1 -- start start 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 Processor -- start 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714fe5d0 0x55d571515b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d5715160b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18681ab7d0 con 0x55d57150d780 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18681acc40 con 0x55d5714ffb40 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18681abea0 con 0x55d5714fe5d0 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18700f3740 10 client.0 _ll_register_callbacks cb 0x7f18580bc790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:45196/0 (socket says 172.21.15.77:45196) 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 -- 172.21.15.77:0/1434603799 learned_addr learned my addr 172.21.15.77:0/1434603799 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d5715160b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f18677fe640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714fe5d0 0x55d571515b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 -- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714fe5d0 msgr2=0x55d571515b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714fe5d0 0x55d571515b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 -- 172.21.15.77:0/1434603799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 msgr2=0x55d5715160b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d5715160b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 -- 172.21.15.77:0/1434603799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5715131a0 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1866ffd640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d5715160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1867fff640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1860009580 tx=0x7f186000a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9890f38bc6897282 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.236+0000 7f1846ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1860034020 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1860022040 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f186002a070 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f186003f050 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 10 client.15624 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55d571588c10 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f186002a070 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1860030840 con 0x55d57150d780 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 10 client.15624 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 10 client.15624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:16.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 20 client.15624 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d571589350 0x55d57158b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 4 client.15624 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.237+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d57146bd70 con 0x55d571589350 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18677fe640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d571589350 0x55d57158b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18677fe640 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d571589350 0x55d57158b770 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2d3e2ebfe61522 server_cookie=382f0d03d1438c16 in_seq=0 out_seq=0 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f1846ffd640 10 client.15624 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f1846ffd640 1 -- 172.21.15.77:0/1434603799 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d57146bd70 con 0x55d571589350 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f1846ffd640 10 client.15624 handle_command_reply: tid=0 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 client.15624 shutdown 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 msgr2=0x55d5715129a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f1860009580 tx=0x7f186000a630 comp rx=0 tx=0).stop 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 shutdown_connections 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55d571589350 0x55d57158b770 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55d57150d780 0x55d5715129a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f1846ffd640 0 client.15624 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d5714ffb40 0x55d5715160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 --2- 172.21.15.77:0/1434603799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55d5714fe5d0 0x55d571515b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 >> 172.21.15.77:0/1434603799 conn(0x55d5714c7310 msgr2=0x55d5714f9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 shutdown_connections 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.238+0000 7f18700f3740 1 -- 172.21.15.77:0/1434603799 wait complete. 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f18700f3740 20 client.15624 trim_cache size 0 max 16384 2024-09-15T23:33:16.248 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 msgr2=0x7f18540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 0x7f18540a5700 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1860009fd0 tx=0x7f1860009d80 comp rx=0 tx=0).stop 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 msgr2=0x7f18681985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1858005ab0 tx=0x7f18580042f0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 shutdown_connections 2024-09-15T23:33:16.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f18540a3240 0x7f18540a5700 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1868106f10 0x7f186819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1868102790 0x7f1868198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 --2- 172.21.15.77:0/75858994 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1868101de0 0x7f18681985b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 >> 172.21.15.77:0/75858994 conn(0x7f18680fd8c0 msgr2=0x7f18680fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 shutdown_connections 2024-09-15T23:33:16.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:16.239+0000 7f186dd1a640 1 -- 172.21.15.77:0/75858994 wait complete. 2024-09-15T23:33:17.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:16 smithi159 ceph-mon[35472]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 171 MiB/s wr, 49 op/s 2024-09-15T23:33:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:16 smithi155 ceph-mon[35631]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 171 MiB/s wr, 49 op/s 2024-09-15T23:33:17.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:16 smithi077 ceph-mon[30968]: pgmap v401: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 171 MiB/s wr, 49 op/s 2024-09-15T23:33:17.914 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:33:17.915 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:33:18.176 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:18.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 -- 172.21.15.77:0/991237079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 msgr2=0x7ff0b010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 --2- 172.21.15.77:0/991237079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b010bb50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009900 tx=0x7ff0a402a480 comp rx=0 tx=0).stop 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 -- 172.21.15.77:0/991237079 shutdown_connections 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 --2- 172.21.15.77:0/991237079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 0x7ff0b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 --2- 172.21.15.77:0/991237079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b010bb50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 --2- 172.21.15.77:0/991237079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 0x7ff0b0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 -- 172.21.15.77:0/991237079 >> 172.21.15.77:0/991237079 conn(0x7ff0b00fc7a0 msgr2=0x7ff0b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 -- 172.21.15.77:0/991237079 shutdown_connections 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.661+0000 7ff0b622c640 1 -- 172.21.15.77:0/991237079 wait complete. 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 Processor -- start 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 -- start start 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 0x7ff0b0198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 0x7ff0b019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0111fb0 con 0x7ff0b0103660 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0111e30 con 0x7ff0b0102d40 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0b622c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b0112130 con 0x7ff0b010c170 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51568/0 (socket says 172.21.15.77:51568) 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0aeffd640 1 -- 172.21.15.77:0/3578933768 learned_addr learned my addr 172.21.15.77:0/3578933768 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.662+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 0x7ff0b0198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0affff640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 0x7ff0b019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 -- 172.21.15.77:0/3578933768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 msgr2=0x7ff0b019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 0x7ff0b019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 -- 172.21.15.77:0/3578933768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 msgr2=0x7ff0b0198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 0x7ff0b0198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 -- 172.21.15.77:0/3578933768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0b019d420 con 0x7ff0b0103660 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4006010 tx=0x7ff0a40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.682 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0acff9640 1 -- 172.21.15.77:0/3578933768 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a403f030 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0acff9640 1 -- 172.21.15.77:0/3578933768 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a4003ce0 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0b019d6b0 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0acff9640 1 -- 172.21.15.77:0/3578933768 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4035070 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.663+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0b01a4ff0 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.665+0000 7ff0acff9640 1 -- 172.21.15.77:0/3578933768 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff0a4042030 con 0x7ff0b0103660 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 Processor -- start 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 -- start start 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f59130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd70eb1280 con 0x55fd70f4c480 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fd70e58b10 con 0x55fd70f4bb60 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0b8605740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fd70ead240 con 0x55fd70f56d40 2024-09-15T23:33:18.683 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51574/0 (socket says 172.21.15.77:51574) 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 -- 172.21.15.77:0/737723285 learned_addr learned my addr 172.21.15.77:0/737723285 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0acff9640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 0x7ff0980a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f59130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0affff640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 -- 172.21.15.77:0/737723285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 msgr2=0x55fd70f59130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f59130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 -- 172.21.15.77:0/737723285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 msgr2=0x55fd70f4bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 -- 172.21.15.77:0/737723285 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd70e651f0 con 0x55fd70f4c480 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f59130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0acff9640 1 -- 172.21.15.77:0/3578933768 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff0a40f0280 con 0x7ff0b0103660 2024-09-15T23:33:18.684 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0affff640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 0x7ff0980a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.666+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00039f0 tx=0x7ff0a0003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725a780fd998a22b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff095ffb640 1 -- 172.21.15.77:0/737723285 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004b20 con 0x55fd70f4c480 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff095ffb640 1 -- 172.21.15.77:0/737723285 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a0004cc0 con 0x55fd70f4c480 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff095ffb640 1 -- 172.21.15.77:0/737723285 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0012740 con 0x55fd70f4c480 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 -- 172.21.15.77:0/737723285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 msgr2=0x55fd70f56800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff0a00039f0 tx=0x7ff0a0003eb0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0affff640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 0x7ff0980a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b8e0 tx=0x7ff0a80047d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 -- 172.21.15.77:0/737723285 shutdown_connections 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f59130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f56800 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 --2- 172.21.15.77:0/737723285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.667+0000 7ff0b8605740 1 -- 172.21.15.77:0/737723285 >> 172.21.15.77:0/737723285 conn(0x55fd70f480f0 msgr2=0x55fd70f484d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- 172.21.15.77:0/737723285 shutdown_connections 2024-09-15T23:33:18.685 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- 172.21.15.77:0/737723285 wait complete. 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- start start 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 Processor -- start 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f53be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fd70f59910 con 0x55fd70f4c480 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fd70e6bf10 con 0x55fd70f4bb60 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fd70f59a90 con 0x55fd70f56d40 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0b8605740 10 client.0 _ll_register_callbacks cb 0x55fd70e34a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51578/0 (socket says 172.21.15.77:51578) 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.668+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4122248185 learned_addr learned my addr 172.21.15.77:0/4122248185 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f53be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.686 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 msgr2=0x55fd70f54660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0affff640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f54660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4122248185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 msgr2=0x55fd70f53be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f53be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4122248185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd70c226a0 con 0x55fd70f4c480 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f53be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0affff640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f54660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40bc560 tx=0x7ff0a4009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be76cf3dda67727b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4049050 con 0x55fd70f4c480 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff0a40b8c40 con 0x55fd70f4c480 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a0004cc0 con 0x55fd70f4c480 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0a40da050 con 0x55fd70f4c480 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0b8605740 10 client.15636 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:18.687 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fd70f65450 con 0x55fd70f4c480 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a0004cc0 con 0x55fd70f4c480 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.669+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0a40c4db0 con 0x55fd70f4c480 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 10 client.15636 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 20 client.15636 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70f66900 0x55fd70f68d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 4 client.15636 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd70ebe7f0 con 0x55fd70f66900 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70f66900 0x55fd70f68d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff08effd640 10 client.15636 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.670+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70f66900 0x55fd70f68d60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=203d2d419fd83dcd server_cookie=15a84e2362a318a1 in_seq=0 out_seq=0 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff08effd640 1 -- 172.21.15.77:0/4122248185 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd70ebe7f0 con 0x55fd70f66900 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff08effd640 10 client.15636 handle_command_reply: tid=0 2024-09-15T23:33:18.688 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 client.15636 shutdown 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 msgr2=0x55fd70f54120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40bc560 tx=0x7ff0a4009560 comp rx=0 tx=0).stop 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 shutdown_connections 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70f66900 0x55fd70f68d60 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f54660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f54120 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4122248185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f53be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff08effd640 0 client.15636 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 >> 172.21.15.77:0/4122248185 conn(0x55fd70f480f0 msgr2=0x55fd70f4de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 shutdown_connections 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.671+0000 7ff0b8605740 1 -- 172.21.15.77:0/4122248185 wait complete. 2024-09-15T23:33:18.689 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.672+0000 7ff0b8605740 20 client.15636 trim_cache size 0 max 16384 2024-09-15T23:33:18.691 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 Processor -- start 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 -- start start 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01acd20 con 0x55fd70f4c480 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01af5a0 con 0x55fd70f4bb60 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0b8605740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ad390 con 0x55fd70f56d40 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51588/0 (socket says 172.21.15.77:51588) 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4134985928 learned_addr learned my addr 172.21.15.77:0/4134985928 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4134985928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 msgr2=0x55fd70f5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.692 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4134985928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 msgr2=0x55fd70f4e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 -- 172.21.15.77:0/4134985928 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd70f54bb0 con 0x55fd70f4c480 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.689+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40bc2d0 tx=0x7ff0a4031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b47e2280b832b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0957fa640 1 -- 172.21.15.77:0/4134985928 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4075030 con 0x55fd70f4c480 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0957fa640 1 -- 172.21.15.77:0/4134985928 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a40c5240 con 0x55fd70f4c480 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0957fa640 1 -- 172.21.15.77:0/4134985928 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4049070 con 0x55fd70f4c480 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 -- 172.21.15.77:0/4134985928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 msgr2=0x55fd70f5f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff0a40bc2d0 tx=0x7ff0a4031a60 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 -- 172.21.15.77:0/4134985928 shutdown_connections 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f56d40 0x55fd70f5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f4c480 0x55fd70f5f0c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4134985928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 -- 172.21.15.77:0/4134985928 >> 172.21.15.77:0/4134985928 conn(0x55fd70f480f0 msgr2=0x55fd70f52cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.693 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 -- 172.21.15.77:0/4134985928 shutdown_connections 2024-09-15T23:33:18.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.690+0000 7ff0b8605740 1 -- 172.21.15.77:0/4134985928 wait complete. 2024-09-15T23:33:18.694 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 -- start start 2024-09-15T23:33:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 Processor -- start 2024-09-15T23:33:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f4c480 0x55fd70f503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.697 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ada60 con 0x55fd70f56d40 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01aeed0 con 0x55fd70f4bb60 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff0b01ae130 con 0x55fd70f4c480 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0b8605740 10 client.0 _ll_register_callbacks cb 0x7ff0a4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0affff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51602/0 (socket says 172.21.15.77:51602) 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0affff640 1 -- 172.21.15.77:0/4014472013 learned_addr learned my addr 172.21.15.77:0/4014472013 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.691+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0aeffd640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f4c480 0x55fd70f503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 -- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f4c480 msgr2=0x55fd70f503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f4c480 0x55fd70f503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 -- 172.21.15.77:0/4014472013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 msgr2=0x55fd70f4fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:18.698 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 -- 172.21.15.77:0/4014472013 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd70f510f0 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0affff640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80156b0 tx=0x7ff0a8015ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81b9926575cc943 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff08effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a8024020 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff0a8020860 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0a40c5240 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff0a802f050 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0b8605740 10 client.15642 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fd70fd5c70 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.692+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff0a40c5240 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7ff0a8013c50 con 0x55fd70f56d40 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 10 client.15642 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:18.699 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 20 client.15642 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70fd63e0 0x55fd70fd8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 4 client.15642 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fd70eb8d00 con 0x55fd70fd63e0 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70fd63e0 0x55fd70fd8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff0af7fe640 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70fd63e0 0x55fd70fd8800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca988d86a09ad51 server_cookie=9c43baf8d443e2cf in_seq=0 out_seq=0 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.693+0000 7ff08effd640 10 client.15642 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff08effd640 1 -- 172.21.15.77:0/4014472013 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fd70eb8d00 con 0x55fd70fd63e0 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff08effd640 10 client.15642 handle_command_reply: tid=0 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff0b8605740 1 client.15642 shutdown 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 msgr2=0x55fd70f508f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff0a80156b0 tx=0x7ff0a8015ab0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 shutdown_connections 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.694+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fd70fd63e0 0x55fd70fd8800 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.700 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fd70f56d40 0x55fd70f508f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fd70f4c480 0x55fd70f503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 --2- 172.21.15.77:0/4014472013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fd70f4bb60 0x55fd70f4fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff08effd640 0 client.15642 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 >> 172.21.15.77:0/4014472013 conn(0x55fd70f480f0 msgr2=0x55fd70f46a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 shutdown_connections 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 1 -- 172.21.15.77:0/4014472013 wait complete. 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b8605740 20 client.15642 trim_cache size 0 max 16384 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "693bb0bd-33d6-412b-98a2-b72b0d7a1cdd", 2024-09-15T23:33:18.701 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:33:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 msgr2=0x7ff0980a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 0x7ff0980a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff0a800b8e0 tx=0x7ff0a80047d0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 msgr2=0x7ff0b01989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4006010 tx=0x7ff0a40042f0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 shutdown_connections 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff0980a3240 0x7ff0980a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b010c170 0x7ff0b019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff0b0103660 0x7ff0b01989b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 --2- 172.21.15.77:0/3578933768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff0b0102d40 0x7ff0b0198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.695+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 >> 172.21.15.77:0/3578933768 conn(0x7ff0b00fc7a0 msgr2=0x7ff0b00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.696+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 shutdown_connections 2024-09-15T23:33:18.703 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:18.696+0000 7ff0b622c640 1 -- 172.21.15.77:0/3578933768 wait complete. 2024-09-15T23:33:19.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:18 smithi159 ceph-mon[35472]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 MiB/s wr, 36 op/s 2024-09-15T23:33:19.252 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:18 smithi077 ceph-mon[30968]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 MiB/s wr, 36 op/s 2024-09-15T23:33:19.280 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:33:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:18 smithi155 ceph-mon[35631]: pgmap v402: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 125 MiB/s wr, 36 op/s 2024-09-15T23:33:19.529 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:19.782 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.778+0000 7f7dce3d6640 1 -- 172.21.15.77:0/2449149204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8101b60 msgr2=0x7f7dc8101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.778+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/2449149204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8101b60 0x7f7dc8101f60 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7db8009900 tx=0x7f7db802a410 comp rx=0 tx=0).stop 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.778+0000 7f7dce3d6640 1 -- 172.21.15.77:0/2449149204 shutdown_connections 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.778+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/2449149204 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/2449149204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8102d50 0x7f7dc81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/2449149204 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8101b60 0x7f7dc8101f60 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- 172.21.15.77:0/2449149204 >> 172.21.15.77:0/2449149204 conn(0x7f7dc80fd2e0 msgr2=0x7f7dc80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- 172.21.15.77:0/2449149204 shutdown_connections 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- 172.21.15.77:0/2449149204 wait complete. 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 Processor -- start 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- start start 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 0x7f7dc8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.783 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc810d7e0 con 0x7f7dc8102d50 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc810d660 con 0x7f7dc8103710 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.779+0000 7f7dce3d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc810d960 con 0x7f7dc8101b60 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51622/0 (socket says 172.21.15.77:51622) 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 -- 172.21.15.77:0/1891758116 learned_addr learned my addr 172.21.15.77:0/1891758116 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:19.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 0x7f7dc8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 -- 172.21.15.77:0/1891758116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 msgr2=0x7f7dc8197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 0x7f7dc8197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 -- 172.21.15.77:0/1891758116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 msgr2=0x7f7dc819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 -- 172.21.15.77:0/1891758116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dc819fa20 con 0x7f7dc8102d50 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 0x7f7dc8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:19.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc57fa640 1 -- 172.21.15.77:0/1891758116 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc00cd80 con 0x7f7dc8102d50 2024-09-15T23:33:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc57fa640 1 -- 172.21.15.77:0/1891758116 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc005500 con 0x7f7dc8102d50 2024-09-15T23:33:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dc819fd10 con 0x7f7dc8102d50 2024-09-15T23:33:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dc57fa640 1 -- 172.21.15.77:0/1891758116 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc010690 con 0x7f7dc8102d50 2024-09-15T23:33:19.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.780+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dc81a01b0 con 0x7f7dc8102d50 2024-09-15T23:33:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 Processor -- start 2024-09-15T23:33:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 -- start start 2024-09-15T23:33:19.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dc57fa640 1 -- 172.21.15.77:0/1891758116 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7dbc0046c0 con 0x7f7dc8102d50 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d39a0 0x55aac69d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69d8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aac69372f0 con 0x55aac69d9370 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aac68df270 con 0x55aac69d42e0 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.783+0000 7f7dd1251740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55aac69332b0 con 0x55aac69d39a0 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51626/0 (socket says 172.21.15.77:51626) 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 -- 172.21.15.77:0/320304310 learned_addr learned my addr 172.21.15.77:0/320304310 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69d8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dcc973640 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d39a0 0x55aac69d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 -- 172.21.15.77:0/320304310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d39a0 msgr2=0x55aac69d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d39a0 0x55aac69d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 -- 172.21.15.77:0/320304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 msgr2=0x55aac69d8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69d8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 -- 172.21.15.77:0/320304310 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac68de340 con 0x55aac69d9370 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc57fa640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 0x7f7db00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d8260 tx=0x7f7dbc0d8350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eace53c6f486cf83 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 0x7f7db00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dae7fc640 1 -- 172.21.15.77:0/320304310 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc098710 con 0x55aac69d9370 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dc57fa640 1 -- 172.21.15.77:0/1891758116 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7dbc0d01e0 con 0x7f7dc8102d50 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dae7fc640 1 -- 172.21.15.77:0/320304310 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc052eb0 con 0x55aac69d9370 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.784+0000 7f7dae7fc640 1 -- 172.21.15.77:0/320304310 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0b5850 con 0x55aac69d9370 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- 172.21.15.77:0/320304310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 msgr2=0x55aac69db830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc0d8260 tx=0x7f7dbc0d8350 comp rx=0 tx=0).stop 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 0x7f7db00a57b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0005fd0 tx=0x7f7dc0009920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- 172.21.15.77:0/320304310 shutdown_connections 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69db830 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69d8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 --2- 172.21.15.77:0/320304310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d39a0 0x55aac69d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- 172.21.15.77:0/320304310 >> 172.21.15.77:0/320304310 conn(0x55aac69cf010 msgr2=0x55aac69cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- 172.21.15.77:0/320304310 shutdown_connections 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- 172.21.15.77:0/320304310 wait complete. 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.785+0000 7f7dd1251740 1 -- start start 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 Processor -- start 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55aac69dc280 con 0x55aac69d39a0 2024-09-15T23:33:19.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55aac68c0290 con 0x55aac69d42e0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55aac69dc400 con 0x55aac69d9370 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dd1251740 10 client.0 _ll_register_callbacks cb 0x55aac68f1140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51634/0 (socket says 172.21.15.77:51634) 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 -- 172.21.15.77:0/1956722085 learned_addr learned my addr 172.21.15.77:0/1956722085 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 -- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 msgr2=0x55aac69e4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 -- 172.21.15.77:0/1956722085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 msgr2=0x55aac69ddfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69ddfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 -- 172.21.15.77:0/1956722085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac664a210 con 0x55aac69d39a0 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dcc973640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:19.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005940 tx=0x7f7db8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3a667629520c81 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.786+0000 7f7da77fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7db8040070 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dbc052eb0 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7db8004240 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7db804d050 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 10 client.15654 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aac6716620 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dbc052eb0 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7db8004a90 con 0x55aac69d39a0 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 10 client.15654 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 20 client.15654 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac69e96e0 0x55aac69ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.798 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 4 client.15654 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aac6944a20 con 0x55aac69e96e0 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.787+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac69e96e0 0x55aac69ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.788+0000 7f7da77fe640 10 client.15654 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.788+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac69e96e0 0x55aac69ebb70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3eb0d7589d86e54 server_cookie=879dae1b63aebd1a in_seq=0 out_seq=0 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.788+0000 7f7da77fe640 1 -- 172.21.15.77:0/1956722085 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aac6944a20 con 0x55aac69e96e0 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.788+0000 7f7da77fe640 10 client.15654 handle_command_reply: tid=0 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.788+0000 7f7dd1251740 1 client.15654 shutdown 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 msgr2=0x55aac69dda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7db8005940 tx=0x7f7db8009880 comp rx=0 tx=0).stop 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 shutdown_connections 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac69e96e0 0x55aac69ebb70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7da77fe640 0 client.15654 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d42e0 0x55aac69ddfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 --2- 172.21.15.77:0/1956722085 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d39a0 0x55aac69dda70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 >> 172.21.15.77:0/1956722085 conn(0x55aac69cf010 msgr2=0x55aac69d0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 shutdown_connections 2024-09-15T23:33:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 1 -- 172.21.15.77:0/1956722085 wait complete. 2024-09-15T23:33:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.789+0000 7f7dd1251740 20 client.15654 trim_cache size 0 max 16384 2024-09-15T23:33:19.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 Processor -- start 2024-09-15T23:33:19.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 -- start start 2024-09-15T23:33:19.805 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69dc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d42e0 0x55aac69e4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81a87c0 con 0x55aac69d9370 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81ab040 con 0x55aac69d39a0 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dd1251740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81a8e30 con 0x55aac69d42e0 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51646/0 (socket says 172.21.15.77:51646) 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 -- 172.21.15.77:0/2610795151 learned_addr learned my addr 172.21.15.77:0/2610795151 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d42e0 0x55aac69e4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69dc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.806 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 -- 172.21.15.77:0/2610795151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d42e0 msgr2=0x55aac69e4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d42e0 0x55aac69e4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 -- 172.21.15.77:0/2610795151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 msgr2=0x55aac69dc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69dc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.803+0000 7f7dcc973640 1 -- 172.21.15.77:0/2610795151 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aac69cee30 con 0x55aac69d9370 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dcc973640 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00127d0 tx=0x7f7dc0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151756d90a307d03 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dadffb640 1 -- 172.21.15.77:0/2610795151 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0011960 con 0x55aac69d9370 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dadffb640 1 -- 172.21.15.77:0/2610795151 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dc001f420 con 0x55aac69d9370 2024-09-15T23:33:19.807 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dadffb640 1 -- 172.21.15.77:0/2610795151 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc0027660 con 0x55aac69d9370 2024-09-15T23:33:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dd1251740 1 -- 172.21.15.77:0/2610795151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 msgr2=0x55aac69ce0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dd1251740 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00127d0 tx=0x7f7dc0013000 comp rx=0 tx=0).stop 2024-09-15T23:33:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dd1251740 1 -- 172.21.15.77:0/2610795151 shutdown_connections 2024-09-15T23:33:19.811 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.804+0000 7f7dd1251740 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d9370 0x55aac69ce0b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d42e0 0x55aac69e4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 --2- 172.21.15.77:0/2610795151 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69dc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 -- 172.21.15.77:0/2610795151 >> 172.21.15.77:0/2610795151 conn(0x55aac69cf010 msgr2=0x55aac69cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 -- 172.21.15.77:0/2610795151 shutdown_connections 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 -- 172.21.15.77:0/2610795151 wait complete. 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 -- start start 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 Processor -- start 2024-09-15T23:33:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69e2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.805+0000 7f7dd1251740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51654/0 (socket says 172.21.15.77:51654) 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 -- 172.21.15.77:0/4176698688 learned_addr learned my addr 172.21.15.77:0/4176698688 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81a9500 con 0x55aac69d42e0 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81aa970 con 0x55aac69d39a0 2024-09-15T23:33:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7dc81a9bd0 con 0x55aac69d9370 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dcc973640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dd1251740 10 client.0 _ll_register_callbacks cb 0x7f7db8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 -- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 msgr2=0x55aac69e3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 -- 172.21.15.77:0/4176698688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 msgr2=0x55aac69e2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69e2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aac69e41b0 con 0x55aac69d42e0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7dc77fe640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c6a0 tx=0x7f7dbc0b3c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c224e270feae78f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.806+0000 7f7da77fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dbc0b3aa0 con 0x55aac69d42e0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7dbc09a770 con 0x55aac69d42e0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7dc001f420 con 0x55aac69d42e0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7dbc0b3ce0 con 0x55aac69d42e0 2024-09-15T23:33:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 10 client.15660 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55aac6a544b0 con 0x55aac69d42e0 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7dc001f420 con 0x55aac69d42e0 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7dbc09c6d0 con 0x55aac69d42e0 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 10 client.15660 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 20 client.15660 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac6a54960 0x55aac6a56d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 4 client.15660 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55aac693ed70 con 0x55aac6a54960 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.807+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac6a54960 0x55aac6a56d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.808+0000 7f7da77fe640 10 client.15660 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.808+0000 7f7dc7fff640 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac6a54960 0x55aac6a56d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15fb86b890a5b308 server_cookie=2dba060768dc46df in_seq=0 out_seq=0 2024-09-15T23:33:19.818 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.816+0000 7f7da77fe640 1 -- 172.21.15.77:0/4176698688 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55aac693ed70 con 0x55aac6a54960 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.816+0000 7f7da77fe640 10 client.15660 handle_command_reply: tid=0 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.816+0000 7f7dd1251740 1 client.15660 shutdown 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 msgr2=0x55aac69e2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00c6a0 tx=0x7f7dbc0b3c40 comp rx=0 tx=0).stop 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 shutdown_connections 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55aac6a54960 0x55aac6a56d50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55aac69d9370 0x55aac69e3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7da77fe640 0 client.15660 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55aac69d42e0 0x55aac69e2b90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 --2- 172.21.15.77:0/4176698688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55aac69d39a0 0x55aac69e2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 >> 172.21.15.77:0/4176698688 conn(0x55aac69cf010 msgr2=0x55aac69ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.819 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 shutdown_connections 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 1 -- 172.21.15.77:0/4176698688 wait complete. 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dd1251740 20 client.15660 trim_cache size 0 max 16384 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:33:19.820 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 msgr2=0x7f7db00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 0x7f7db00a57b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0005fd0 tx=0x7f7dc0009920 comp rx=0 tx=0).stop 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 msgr2=0x7f7dc8198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.817+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7dbc00e9f0 tx=0x7f7dbc00edf0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 shutdown_connections 2024-09-15T23:33:19.821 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7db00a32f0 0x7f7db00a57b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7dc8103710 0x7f7dc819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7dc8102d50 0x7f7dc8198340 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 --2- 172.21.15.77:0/1891758116 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7dc8101b60 0x7f7dc8197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 >> 172.21.15.77:0/1891758116 conn(0x7f7dc80fd2e0 msgr2=0x7f7dc8106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 shutdown_connections 2024-09-15T23:33:19.822 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:19.818+0000 7f7dce3d6640 1 -- 172.21.15.77:0/1891758116 wait complete. 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 -- 172.21.15.77:0/1779909516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850106f10 msgr2=0x7f185010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 --2- 172.21.15.77:0/1779909516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850106f10 0x7f185010ea90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1848009ca0 tx=0x7f184802a8c0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 -- 172.21.15.77:0/1779909516 shutdown_connections 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 --2- 172.21.15.77:0/1779909516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850106f10 0x7f185010ea90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 --2- 172.21.15.77:0/1779909516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 0x7f18501067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 --2- 172.21.15.77:0/1779909516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850101de0 0x7f18501021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 -- 172.21.15.77:0/1779909516 >> 172.21.15.77:0/1779909516 conn(0x7f18500fd8c0 msgr2=0x7f18500ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 -- 172.21.15.77:0/1779909516 shutdown_connections 2024-09-15T23:33:20.133 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.111+0000 7f185863a640 1 -- 172.21.15.77:0/1779909516 wait complete. 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 Processor -- start 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 -- start start 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 0x7f1850198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 0x7f185019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1850112010 con 0x7f1850101de0 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1850111e90 con 0x7f1850102790 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f185863a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1850112190 con 0x7f1850106f10 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51670/0 (socket says 172.21.15.77:51670) 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 -- 172.21.15.77:0/1201689604 learned_addr learned my addr 172.21.15.77:0/1201689604 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:20.134 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f1856bd7640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 0x7f185019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f1855bd5640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 0x7f1850198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 -- 172.21.15.77:0/1201689604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 msgr2=0x7f185019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 0x7f185019cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 -- 172.21.15.77:0/1201689604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 msgr2=0x7f1850198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 0x7f1850198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f18563d6640 1 -- 172.21.15.77:0/1201689604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185019d5a0 con 0x7f1850101de0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.112+0000 7f1856bd7640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 0x7f185019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f18563d6640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f184400b4a0 tx=0x7f184400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f18437fe640 1 -- 172.21.15.77:0/1201689604 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844014070 con 0x7f1850101de0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f18437fe640 1 -- 172.21.15.77:0/1201689604 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1844010af0 con 0x7f1850101de0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185019d890 con 0x7f1850101de0 2024-09-15T23:33:20.135 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f18437fe640 1 -- 172.21.15.77:0/1201689604 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844017d10 con 0x7f1850101de0 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.113+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18501a5170 con 0x7f1850101de0 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.115+0000 7f18437fe640 1 -- 172.21.15.77:0/1201689604 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1844017070 con 0x7f1850101de0 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.115+0000 7f185aa13740 1 Processor -- start 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 -- start start 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d210740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d1762e0 con 0x55cb5d21fa90 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d11dce0 con 0x55cb5d210c80 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f18437fe640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.136 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f185aa13740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d1722a0 con 0x55cb5d210360 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1856bd7640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51682/0 (socket says 172.21.15.77:51682) 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f18563d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 -- 172.21.15.77:0/625916571 learned_addr learned my addr 172.21.15.77:0/625916571 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1856bd7640 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d210740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f18437fe640 1 -- 172.21.15.77:0/1201689604 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f18440cf0b0 con 0x7f1850101de0 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 -- 172.21.15.77:0/625916571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 msgr2=0x55cb5d210740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d210740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 -- 172.21.15.77:0/625916571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 msgr2=0x55cb5d21f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.137 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.116+0000 7f1855bd5640 1 -- 172.21.15.77:0/625916571 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5d102440 con 0x55cb5d21fa90 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f1856bd7640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 0x7f183c0a5780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f184802f540 tx=0x7f1848009880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f1855bd5640 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b7f0 tx=0x7f184c00bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df067829475f6dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f1840ff9640 1 -- 172.21.15.77:0/625916571 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c00d950 con 0x55cb5d21fa90 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f1840ff9640 1 -- 172.21.15.77:0/625916571 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c018070 con 0x55cb5d21fa90 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f1840ff9640 1 -- 172.21.15.77:0/625916571 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c013e50 con 0x55cb5d21fa90 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f185aa13740 1 -- 172.21.15.77:0/625916571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 msgr2=0x55cb5d221e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.117+0000 7f185aa13740 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f184c00b7f0 tx=0x7f184c00bcb0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- 172.21.15.77:0/625916571 shutdown_connections 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d21fa90 0x55cb5d221e80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- 172.21.15.77:0/625916571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d210740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.138 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- 172.21.15.77:0/625916571 >> 172.21.15.77:0/625916571 conn(0x55cb5d20ca30 msgr2=0x55cb5d20ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- 172.21.15.77:0/625916571 shutdown_connections 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- 172.21.15.77:0/625916571 wait complete. 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- start start 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 Processor -- start 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d21fa90 0x55cb5d21cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d222660 con 0x55cb5d210360 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d131050 con 0x55cb5d210c80 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55cb5d2227e0 con 0x55cb5d21fa90 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f185aa13740 10 client.0 _ll_register_callbacks cb 0x55cb5d171160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:20.139 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51686/0 (socket says 172.21.15.77:51686) 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.118+0000 7f18563d6640 1 -- 172.21.15.77:0/3691934305 learned_addr learned my addr 172.21.15.77:0/3691934305 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1855bd5640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1856bd7640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d21fa90 0x55cb5d21cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 -- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d21fa90 msgr2=0x55cb5d21cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d21fa90 0x55cb5d21cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 -- 172.21.15.77:0/3691934305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 msgr2=0x55cb5d21c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 -- 172.21.15.77:0/3691934305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5cee73c0 con 0x55cb5d210360 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f18563d6640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1844009420 tx=0x7f184401de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ba369259c37923 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:20.140 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1844013170 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1844010ca0 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184c018070 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f184409ba40 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f185aa13740 10 client.15672 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cb5d22e0d0 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.119+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c018070 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f18440ccce0 con 0x55cb5d210360 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 10 client.15672 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 10 client.15672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 20 client.15672 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:20.141 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d22f590 0x55cb5d231a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 4 client.15672 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb5d183850 con 0x55cb5d22f590 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.120+0000 7f1855bd5640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d22f590 0x55cb5d231a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f1839ffb640 10 client.15672 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f1855bd5640 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d22f590 0x55cb5d231a00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d751d9191fc3f994 server_cookie=215d756e781be151 in_seq=0 out_seq=0 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f1839ffb640 1 -- 172.21.15.77:0/3691934305 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb5d183850 con 0x55cb5d22f590 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f1839ffb640 10 client.15672 handle_command_reply: tid=0 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 client.15672 shutdown 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 msgr2=0x55cb5d21f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1844009420 tx=0x7f184401de80 comp rx=0 tx=0).stop 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 shutdown_connections 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d22f590 0x55cb5d231a00 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.142 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d21fa90 0x55cb5d21cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d210c80 0x55cb5d21c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f1839ffb640 0 client.15672 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 --2- 172.21.15.77:0/3691934305 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d21f3f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.121+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 >> 172.21.15.77:0/3691934305 conn(0x55cb5d20ca30 msgr2=0x55cb5d212790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.122+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 shutdown_connections 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.122+0000 7f185aa13740 1 -- 172.21.15.77:0/3691934305 wait complete. 2024-09-15T23:33:20.143 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.122+0000 7f185aa13740 20 client.15672 trim_cache size 0 max 16384 2024-09-15T23:33:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 Processor -- start 2024-09-15T23:33:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 -- start start 2024-09-15T23:33:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d22b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.148 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d20ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18501aabb0 con 0x55cb5d210c80 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18501ad430 con 0x55cb5d21fa90 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f185aa13740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18501ab220 con 0x55cb5d210360 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51696/0 (socket says 172.21.15.77:51696) 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 -- 172.21.15.77:0/64424049 learned_addr learned my addr 172.21.15.77:0/64424049 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 -- 172.21.15.77:0/64424049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 msgr2=0x55cb5d22b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d22b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 -- 172.21.15.77:0/64424049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 msgr2=0x55cb5d20ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d20ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 -- 172.21.15.77:0/64424049 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb5d21b650 con 0x55cb5d210c80 2024-09-15T23:33:20.149 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.139+0000 7f1855bd5640 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55cb5d20db20 tx=0x7f184c00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d9c0dfb6a5cbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f183bfff640 1 -- 172.21.15.77:0/64424049 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c029070 con 0x55cb5d210c80 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f183bfff640 1 -- 172.21.15.77:0/64424049 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c018040 con 0x55cb5d210c80 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f183bfff640 1 -- 172.21.15.77:0/64424049 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184c025680 con 0x55cb5d210c80 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 -- 172.21.15.77:0/64424049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 msgr2=0x55cb5d21af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x55cb5d20db20 tx=0x7f184c00f040 comp rx=0 tx=0).stop 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 -- 172.21.15.77:0/64424049 shutdown_connections 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d20ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210c80 0x55cb5d21af70 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 --2- 172.21.15.77:0/64424049 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210360 0x55cb5d22b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 -- 172.21.15.77:0/64424049 >> 172.21.15.77:0/64424049 conn(0x55cb5d20ca30 msgr2=0x55cb5d20b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 -- 172.21.15.77:0/64424049 shutdown_connections 2024-09-15T23:33:20.150 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.140+0000 7f185aa13740 1 -- 172.21.15.77:0/64424049 wait complete. 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 -- start start 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 Processor -- start 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210c80 0x55cb5d223f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d2244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f18501ab8f0 con 0x55cb5d210360 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18501acd60 con 0x55cb5d21fa90 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f18501abfc0 con 0x55cb5d210c80 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f185aa13740 10 client.0 _ll_register_callbacks cb 0x7f184400b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51706/0 (socket says 172.21.15.77:51706) 2024-09-15T23:33:20.151 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 -- 172.21.15.77:0/3272178824 learned_addr learned my addr 172.21.15.77:0/3272178824 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f1856bd7640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d2244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 -- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210c80 msgr2=0x55cb5d223f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210c80 0x55cb5d223f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 -- 172.21.15.77:0/3272178824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 msgr2=0x55cb5d2244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d2244d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.141+0000 7f18563d6640 1 -- 172.21.15.77:0/3272178824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb5d299580 con 0x55cb5d210360 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f18563d6640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f184400be60 tx=0x7f1844017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea7a1578405c112 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f184401e050 con 0x55cb5d210360 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f18440b41d0 con 0x55cb5d210360 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f184c018040 con 0x55cb5d210360 2024-09-15T23:33:20.152 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f184409f6f0 con 0x55cb5d210360 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f185aa13740 10 client.15678 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55cb5d29a810 con 0x55cb5d210360 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f184c018040 con 0x55cb5d210360 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.142+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f18440ccce0 con 0x55cb5d210360 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 10 client.15678 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 20 client.15678 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:20.153 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d29ad50 0x55cb5d29d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 4 client.15678 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cb5d17dd60 con 0x55cb5d29ad50 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f1855bd5640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d29ad50 0x55cb5d29d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f1839ffb640 10 client.15678 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f1855bd5640 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d29ad50 0x55cb5d29d140 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaaa11aadc3658ae server_cookie=486d975b0422a232 in_seq=0 out_seq=0 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f1839ffb640 1 -- 172.21.15.77:0/3272178824 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55cb5d17dd60 con 0x55cb5d29ad50 2024-09-15T23:33:20.154 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.143+0000 7f1839ffb640 10 client.15678 handle_command_reply: tid=0 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 client.15678 shutdown 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 msgr2=0x55cb5d223a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f184400be60 tx=0x7f1844017730 comp rx=0 tx=0).stop 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 shutdown_connections 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55cb5d29ad50 0x55cb5d29d140 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cb5d21fa90 0x55cb5d2244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55cb5d210c80 0x55cb5d223f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f1839ffb640 0 client.15678 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 --2- 172.21.15.77:0/3272178824 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55cb5d210360 0x55cb5d223a50 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 >> 172.21.15.77:0/3272178824 conn(0x55cb5d20ca30 msgr2=0x55cb5d20b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 shutdown_connections 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 1 -- 172.21.15.77:0/3272178824 wait complete. 2024-09-15T23:33:20.155 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185aa13740 20 client.15678 trim_cache size 0 max 16384 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": { 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "693bb0bd-33d6-412b-98a2-b72b0d7a1cdd": { 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "path": "/", 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "tag": "693bb0bd-33d6-412b-98a2-b72b0d7a1cdd", 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: "options": "recursive,force" 2024-09-15T23:33:20.156 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:20.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:20.157 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:33:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 msgr2=0x7f183c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 0x7f183c0a5780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f184802f540 tx=0x7f1848009880 comp rx=0 tx=0).stop 2024-09-15T23:33:20.157 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 msgr2=0x7f18501985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f184400b4a0 tx=0x7f184400b960 comp rx=0 tx=0).stop 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.144+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 shutdown_connections 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f183c0a32c0 0x7f183c0a5780 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1850106f10 0x7f185019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1850102790 0x7f1850198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 --2- 172.21.15.77:0/1201689604 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1850101de0 0x7f18501985f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 >> 172.21.15.77:0/1201689604 conn(0x7f18500fd8c0 msgr2=0x7f18500fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 shutdown_connections 2024-09-15T23:33:20.158 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:20.145+0000 7f185863a640 1 -- 172.21.15.77:0/1201689604 wait complete. 2024-09-15T23:33:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:19 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:33:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:19 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:19 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:33:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:19 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:19 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:33:20.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:19 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:19 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:33:20.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:19 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:19 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:33:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:19 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:19 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:33:20.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:19 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:33:20.823 INFO:tasks.cephfs.filesystem:scrub status for tag:693bb0bd-33d6-412b-98a2-b72b0d7a1cdd - {'path': '/', 'tag': '693bb0bd-33d6-412b-98a2-b72b0d7a1cdd', 'options': 'recursive,force'} 2024-09-15T23:33:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:20 smithi077 ceph-mon[30968]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 93 MiB/s wr, 29 op/s 2024-09-15T23:33:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:20 smithi159 ceph-mon[35472]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 93 MiB/s wr, 29 op/s 2024-09-15T23:33:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:20 smithi155 ceph-mon[35631]: pgmap v403: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 93 MiB/s wr, 29 op/s 2024-09-15T23:33:21.578 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.578 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.579 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.579 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-09-15T23:33:21.579 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-15T23:33:21.644 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-15T23:33:21.645 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Sun Sep 15 23:33:21 2024 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 1048576 kB 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 1024 kB 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-09-15T23:33:21.646 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-09-15T23:33:21.647 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-09-15T23:33:21.647 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-09-15T23:33:22.993 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:22.993 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 796727.94 kB/sec 2024-09-15T23:33:22.993 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 796603.85 kB/sec 2024-09-15T23:33:22.993 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 796727.94 kB/sec 2024-09-15T23:33:22.994 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 796727.94 kB/sec 2024-09-15T23:33:22.994 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 796727.94 kB/sec 2024-09-15T23:33:22.994 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:22 smithi159 ceph-mon[35472]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 MiB/s wr, 24 op/s 2024-09-15T23:33:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:22 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:33:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:22 smithi155 ceph-mon[35631]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 MiB/s wr, 24 op/s 2024-09-15T23:33:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:22 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:33:23.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:22 smithi077 ceph-mon[30968]: pgmap v404: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 78 MiB/s wr, 24 op/s 2024-09-15T23:33:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:22 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:33:25.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:24 smithi159 ceph-mon[35472]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 14 op/s 2024-09-15T23:33:25.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:24 smithi155 ceph-mon[35631]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 14 op/s 2024-09-15T23:33:25.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:24 smithi077 ceph-mon[30968]: pgmap v405: 129 pgs: 129 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 38 MiB/s wr, 14 op/s 2024-09-15T23:33:26.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:26 smithi155 ceph-mon[35631]: pgmap v406: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 70 MiB/s wr, 32 op/s 2024-09-15T23:33:26.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:26 smithi077 ceph-mon[30968]: pgmap v406: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 70 MiB/s wr, 32 op/s 2024-09-15T23:33:26.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:26 smithi159 ceph-mon[35472]: pgmap v406: 129 pgs: 129 active+clean; 1.4 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 70 MiB/s wr, 32 op/s 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 865269.38 kB/sec 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 865091.03 kB/sec 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 865269.38 kB/sec 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 865269.38 kB/sec 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 865269.38 kB/sec 2024-09-15T23:33:26.561 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:28 smithi159 ceph-mon[35472]: pgmap v407: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 97 MiB/s wr, 46 op/s 2024-09-15T23:33:29.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:28 smithi077 ceph-mon[30968]: pgmap v407: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 97 MiB/s wr, 46 op/s 2024-09-15T23:33:29.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:28 smithi155 ceph-mon[35631]: pgmap v407: 129 pgs: 129 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 97 MiB/s wr, 46 op/s 2024-09-15T23:33:29.813 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:29.813 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 7598313.00 kB/sec 2024-09-15T23:33:29.813 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 7586071.97 kB/sec 2024-09-15T23:33:29.813 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7598313.00 kB/sec 2024-09-15T23:33:29.814 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7598313.00 kB/sec 2024-09-15T23:33:29.814 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7598313.00 kB/sec 2024-09-15T23:33:29.814 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:31.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:30 smithi159 ceph-mon[35472]: pgmap v408: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 127 MiB/s wr, 62 op/s 2024-09-15T23:33:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:30 smithi155 ceph-mon[35631]: pgmap v408: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 127 MiB/s wr, 62 op/s 2024-09-15T23:33:31.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:30 smithi077 ceph-mon[30968]: pgmap v408: 129 pgs: 129 active+clean; 1.0 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 127 MiB/s wr, 62 op/s 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 7270522.00 kB/sec 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 7257385.06 kB/sec 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7270522.00 kB/sec 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7270522.00 kB/sec 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7270522.00 kB/sec 2024-09-15T23:33:32.040 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 1048576.00 kB 2024-09-15T23:33:32.933 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- 172.21.15.77:0/549937156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 msgr2=0x7f949c1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 --2- 172.21.15.77:0/549937156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c1020b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f948c009900 tx=0x7f948c02a410 comp rx=0 tx=0).stop 2024-09-15T23:33:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- 172.21.15.77:0/549937156 shutdown_connections 2024-09-15T23:33:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 --2- 172.21.15.77:0/549937156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c1025f0 0x7f949c108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 --2- 172.21.15.77:0/549937156 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c1020b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 --2- 172.21.15.77:0/549937156 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c100a40 0x7f949c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- 172.21.15.77:0/549937156 >> 172.21.15.77:0/549937156 conn(0x7f949c0fc1e0 msgr2=0x7f949c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- 172.21.15.77:0/549937156 shutdown_connections 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- 172.21.15.77:0/549937156 wait complete. 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 Processor -- start 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.929+0000 7f94a46eb640 1 -- start start 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c100a40 0x7f949c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 0x7f949c19e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f949c10c6c0 con 0x7f949c101c30 2024-09-15T23:33:33.237 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:32 smithi159 ceph-mon[35472]: pgmap v409: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 171 MiB/s wr, 72 op/s 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f949c10c540 con 0x7f949c100a40 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f949c10c840 con 0x7f949c1025f0 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56498/0 (socket says 172.21.15.77:56498) 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 -- 172.21.15.77:0/361579650 learned_addr learned my addr 172.21.15.77:0/361579650 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a2c88640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 0x7f949c19e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a2487640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c100a40 0x7f949c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 -- 172.21.15.77:0/361579650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 msgr2=0x7f949c19e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 0x7f949c19e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 -- 172.21.15.77:0/361579650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c100a40 msgr2=0x7f949c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c100a40 0x7f949c196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 -- 172.21.15.77:0/361579650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949c19e940 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a2c88640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 0x7f949c19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a1c86640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f948c009230 tx=0x7f948c004360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94937fe640 1 -- 172.21.15.77:0/361579650 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c03f030 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94937fe640 1 -- 172.21.15.77:0/361579650 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c003ce0 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949c19ebd0 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94937fe640 1 -- 172.21.15.77:0/361579650 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c035070 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.930+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f949c19f0c0 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94937fe640 1 -- 172.21.15.77:0/361579650 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f948c042030 con 0x7f949c101c30 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 Processor -- start 2024-09-15T23:33:33.252 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 -- start start 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x555855fb4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555855fb7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555855f112f0 con 0x555855fafbb0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555855eb9270 con 0x555855fb04f0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.933+0000 7f94a748a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555855f0d2b0 con 0x555855fb5580 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94937fe640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 0x7f94880a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56502/0 (socket says 172.21.15.77:56502) 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 -- 172.21.15.77:0/549132729 learned_addr learned my addr 172.21.15.77:0/549132729 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 0x7f94880a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a1c86640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555855fb7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2487640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x555855fb4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94937fe640 1 -- 172.21.15.77:0/361579650 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f948c0f07d0 con 0x7f949c101c30 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 -- 172.21.15.77:0/549132729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 msgr2=0x555855fb7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555855fb7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 -- 172.21.15.77:0/549132729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 msgr2=0x555855fb4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x555855fb4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 -- 172.21.15.77:0/549132729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555855eb8340 con 0x555855fafbb0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2487640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x555855fb4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f94940113b0 tx=0x7f9494011870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35844c36ab3ee718 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f94a2c88640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 0x7f94880a57b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9494011d70 tx=0x7f949401c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.934+0000 7f9490ff9640 1 -- 172.21.15.77:0/549132729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f949400fd10 con 0x555855fafbb0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f9490ff9640 1 -- 172.21.15.77:0/549132729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9494009dc0 con 0x555855fafbb0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f9490ff9640 1 -- 172.21.15.77:0/549132729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494005980 con 0x555855fafbb0 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 -- 172.21.15.77:0/549132729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 msgr2=0x555855faffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.254 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f94940113b0 tx=0x7f9494011870 comp rx=0 tx=0).stop 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 -- 172.21.15.77:0/549132729 shutdown_connections 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555855fb7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x555855fb4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 --2- 172.21.15.77:0/549132729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x555855faffb0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 -- 172.21.15.77:0/549132729 >> 172.21.15.77:0/549132729 conn(0x555855fab220 msgr2=0x555855fab620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 -- 172.21.15.77:0/549132729 shutdown_connections 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.935+0000 7f94a748a740 1 -- 172.21.15.77:0/549132729 wait complete. 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 -- start start 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 Processor -- start 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 0x555855fb9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 0x555855fba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555855fb84f0 con 0x555855fb5580 2024-09-15T23:33:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555855e9a290 con 0x555855fafbb0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555855fb8670 con 0x555855fb04f0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a748a740 10 client.0 _ll_register_callbacks cb 0x555855ecb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56514/0 (socket says 172.21.15.77:56514) 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 -- 172.21.15.77:0/2010905641 learned_addr learned my addr 172.21.15.77:0/2010905641 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2487640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 0x555855fb9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a1c86640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 0x555855fba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 -- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 msgr2=0x555855fba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 0x555855fba3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 -- 172.21.15.77:0/2010905641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 msgr2=0x555855fb9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 0x555855fb9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2c88640 1 -- 172.21.15.77:0/2010905641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555855c24210 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a2487640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 0x555855fb9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.936+0000 7f94a1c86640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 0x555855fba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a2c88640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9494009f70 tx=0x7f949400ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4b0a157ddba311 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9494005900 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9494014040 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9494009dc0 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9494039050 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 10 client.15690 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555855cf0620 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9494009dc0 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f949402d030 con 0x555855fb5580 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 10 client.15690 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 10 client.15690 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 20 client.15690 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555855fc5970 0x555855fc7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 4 client.15690 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.937+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555855f1ea20 con 0x555855fc5970 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.938+0000 7f94a2487640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555855fc5970 0x555855fc7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.938+0000 7f94a2487640 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555855fc5970 0x555855fc7d60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29557cc2b18e456b server_cookie=90cce9d336e4f010 in_seq=0 out_seq=0 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.938+0000 7f9485ffb640 10 client.15690 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f9485ffb640 1 -- 172.21.15.77:0/2010905641 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555855f1ea20 con 0x555855fc5970 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f9485ffb640 10 client.15690 handle_command_reply: tid=0 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 client.15690 shutdown 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 msgr2=0x555855fc13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9494009f70 tx=0x7f949400ffc0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 shutdown_connections 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555855fc5970 0x555855fc7d60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb5580 0x555855fc13a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb04f0 0x555855fba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f9485ffb640 0 client.15690 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 --2- 172.21.15.77:0/2010905641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fafbb0 0x555855fb9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 >> 172.21.15.77:0/2010905641 conn(0x555855fab220 msgr2=0x555855fa81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 shutdown_connections 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 1 -- 172.21.15.77:0/2010905641 wait complete. 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.939+0000 7f94a748a740 20 client.15690 trim_cache size 0 max 16384 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.953+0000 7f94a748a740 1 Processor -- start 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.953+0000 7f94a748a740 1 -- start start 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fafbb0 0x555855fa99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb5580 0x555855faa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a64d0 con 0x555855fb04f0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a8d50 con 0x555855fb5580 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a748a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a6b40 con 0x555855fafbb0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56524/0 (socket says 172.21.15.77:56524) 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 -- 172.21.15.77:0/1837202131 learned_addr learned my addr 172.21.15.77:0/1837202131 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a2487640 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fafbb0 0x555855fa99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 -- 172.21.15.77:0/1837202131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fafbb0 msgr2=0x555855fa99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fafbb0 0x555855fa99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 -- 172.21.15.77:0/1837202131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb5580 msgr2=0x555855faa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb5580 0x555855faa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 -- 172.21.15.77:0/1837202131 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555855fabeb0 con 0x555855fb04f0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f948c0edf40 tx=0x7f948c036e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39f4c5d50236580 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f9487fff640 1 -- 172.21.15.77:0/1837202131 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c049040 con 0x555855fb04f0 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f9487fff640 1 -- 172.21.15.77:0/1837202131 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c0bd160 con 0x555855fb04f0 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.954+0000 7f9487fff640 1 -- 172.21.15.77:0/1837202131 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c0badf0 con 0x555855fb04f0 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- 172.21.15.77:0/1837202131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 msgr2=0x555855fa9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f948c0edf40 tx=0x7f948c036e70 comp rx=0 tx=0).stop 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- 172.21.15.77:0/1837202131 shutdown_connections 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb5580 0x555855faa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fb04f0 0x555855fa9ef0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- 172.21.15.77:0/1837202131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fafbb0 0x555855fa99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- 172.21.15.77:0/1837202131 >> 172.21.15.77:0/1837202131 conn(0x555855fab220 msgr2=0x555855fb1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- 172.21.15.77:0/1837202131 shutdown_connections 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- 172.21.15.77:0/1837202131 wait complete. 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- start start 2024-09-15T23:33:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 Processor -- start 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x55585602eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555856031080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a7210 con 0x555855fafbb0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a8680 con 0x555855fb04f0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f949c1a78e0 con 0x555855fb5580 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.955+0000 7f94a748a740 10 client.0 _ll_register_callbacks cb 0x7f948c04af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56532/0 (socket says 172.21.15.77:56532) 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 -- 172.21.15.77:0/1187949585 learned_addr learned my addr 172.21.15.77:0/1187949585 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x55585602eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2c88640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555856031080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 -- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 msgr2=0x555856031080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555856031080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 -- 172.21.15.77:0/1187949585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 msgr2=0x55585602eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x55585602eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 -- 172.21.15.77:0/1187949585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558560316c0 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2c88640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555856031080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a2487640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x555855fb0f20 tx=0x7f9498012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68258f74d345c83f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f9485ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498004220 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f94980043c0 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f948c0bd160 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f949802b050 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a748a740 10 client.15696 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555856032a80 con 0x555855fafbb0 2024-09-15T23:33:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.956+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f948c0bd160 con 0x555855fafbb0 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f94980039c0 con 0x555855fafbb0 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 10 client.15696 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 10 client.15696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 20 client.15696 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555856033410 0x555856035830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 4 client.15696 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555855f18d70 con 0x555856033410 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.957+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555856033410 0x555856035830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.958+0000 7f94a1c86640 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555856033410 0x555856035830 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=376014502c2bccdf server_cookie=f08d4cabd717f69a in_seq=0 out_seq=0 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.958+0000 7f9485ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f9485ffb640 1 -- 172.21.15.77:0/1187949585 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555855f18d70 con 0x555856033410 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f9485ffb640 10 client.15696 handle_command_reply: tid=0 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 client.15696 shutdown 2024-09-15T23:33:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 msgr2=0x55585602c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x555855fb0f20 tx=0x7f9498012820 comp rx=0 tx=0).stop 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 shutdown_connections 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555856033410 0x555856035830 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555855fb5580 0x555856031080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f9485ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555855fb04f0 0x55585602eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 --2- 172.21.15.77:0/1187949585 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555855fafbb0 0x55585602c5e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 >> 172.21.15.77:0/1187949585 conn(0x555855fab220 msgr2=0x555855fac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 shutdown_connections 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.968+0000 7f94a748a740 1 -- 172.21.15.77:0/1187949585 wait complete. 2024-09-15T23:33:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a748a740 20 client.15696 trim_cache size 0 max 16384 2024-09-15T23:33:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:33:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:33:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:33:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 msgr2=0x7f94880a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 0x7f94880a57b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9494011d70 tx=0x7f949401c000 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 msgr2=0x7f949c197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f948c009230 tx=0x7f948c004360 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 shutdown_connections 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f94880a32f0 0x7f94880a57b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f949c1025f0 0x7f949c19e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f949c101c30 0x7f949c197270 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 --2- 172.21.15.77:0/361579650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f949c100a40 0x7f949c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 >> 172.21.15.77:0/361579650 conn(0x7f949c0fc1e0 msgr2=0x7f949c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 shutdown_connections 2024-09-15T23:33:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:32.969+0000 7f94a46eb640 1 -- 172.21.15.77:0/361579650 wait complete. 2024-09-15T23:33:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:32 smithi155 ceph-mon[35631]: pgmap v409: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 171 MiB/s wr, 72 op/s 2024-09-15T23:33:33.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:32 smithi077 ceph-mon[30968]: pgmap v409: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 171 MiB/s wr, 72 op/s 2024-09-15T23:33:35.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:34 smithi159 ceph-mon[35472]: pgmap v410: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 171 MiB/s wr, 71 op/s 2024-09-15T23:33:35.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:34 smithi155 ceph-mon[35631]: pgmap v410: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 171 MiB/s wr, 71 op/s 2024-09-15T23:33:35.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:34 smithi077 ceph-mon[30968]: pgmap v410: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 171 MiB/s wr, 71 op/s 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:33:36.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:33:36.367 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:33:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:33:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:33:36.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:33:37.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:36 smithi159 ceph-mon[35472]: pgmap v411: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 164 MiB/s wr, 72 op/s 2024-09-15T23:33:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:36 smithi155 ceph-mon[35631]: pgmap v411: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 164 MiB/s wr, 72 op/s 2024-09-15T23:33:37.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:36 smithi077 ceph-mon[30968]: pgmap v411: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 164 MiB/s wr, 72 op/s 2024-09-15T23:33:38.334 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.334 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.334 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.334 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-09-15T23:33:38.335 INFO:tasks.workunit.client.0.smithi077.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-15T23:33:38.424 INFO:tasks.workunit.client.0.smithi077.stdout: Iozone: Performance Test of File I/O 2024-09-15T23:33:38.424 INFO:tasks.workunit.client.0.smithi077.stdout: Version $Revision: 3.494 $ 2024-09-15T23:33:38.424 INFO:tasks.workunit.client.0.smithi077.stdout: Compiled for 64 bit mode. 2024-09-15T23:33:38.424 INFO:tasks.workunit.client.0.smithi077.stdout: Build: linux-AMD64 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-09-15T23:33:38.425 INFO:tasks.workunit.client.0.smithi077.stdout: Alexey Skidanov, Sudhir Kumar. 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Run began: Sun Sep 15 23:33:38 2024 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Include close in write timing 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Include fsync in write timing 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: File size set to 10485760 kB 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Record Size 1024 kB 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Output is in kBytes/sec 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Time Resolution = 0.000001 seconds. 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache size set to 1024 kBytes. 2024-09-15T23:33:38.426 INFO:tasks.workunit.client.0.smithi077.stdout: Processor cache line size set to 32 bytes. 2024-09-15T23:33:38.427 INFO:tasks.workunit.client.0.smithi077.stdout: File stride size set to 17 * record size. 2024-09-15T23:33:38.427 INFO:tasks.workunit.client.0.smithi077.stdout: Throughput test with 1 process 2024-09-15T23:33:38.427 INFO:tasks.workunit.client.0.smithi077.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-09-15T23:33:39.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:38 smithi159 ceph-mon[35472]: pgmap v412: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 114 MiB/s wr, 50 op/s 2024-09-15T23:33:39.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:38 smithi155 ceph-mon[35631]: pgmap v412: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 114 MiB/s wr, 50 op/s 2024-09-15T23:33:39.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:38 smithi077 ceph-mon[30968]: pgmap v412: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 114 MiB/s wr, 50 op/s 2024-09-15T23:33:41.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:40 smithi159 ceph-mon[35472]: pgmap v413: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 77 MiB/s wr, 35 op/s 2024-09-15T23:33:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:40 smithi155 ceph-mon[35631]: pgmap v413: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 77 MiB/s wr, 35 op/s 2024-09-15T23:33:41.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:40 smithi077 ceph-mon[30968]: pgmap v413: 129 pgs: 129 active+clean; 1.0 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 77 MiB/s wr, 35 op/s 2024-09-15T23:33:43.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:42 smithi159 ceph-mon[35472]: pgmap v414: 129 pgs: 129 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 MiB/s wr, 39 op/s 2024-09-15T23:33:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:42 smithi155 ceph-mon[35631]: pgmap v414: 129 pgs: 129 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 MiB/s wr, 39 op/s 2024-09-15T23:33:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:42 smithi077 ceph-mon[30968]: pgmap v414: 129 pgs: 129 active+clean; 2.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 126 MiB/s wr, 39 op/s 2024-09-15T23:33:45.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:44 smithi159 ceph-mon[35472]: pgmap v415: 129 pgs: 129 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 114 MiB/s wr, 37 op/s 2024-09-15T23:33:45.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:44 smithi155 ceph-mon[35631]: pgmap v415: 129 pgs: 129 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 114 MiB/s wr, 37 op/s 2024-09-15T23:33:45.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:44 smithi077 ceph-mon[30968]: pgmap v415: 129 pgs: 129 active+clean; 2.3 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 114 MiB/s wr, 37 op/s 2024-09-15T23:33:46.161 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.158+0000 7f9f66f8d640 1 -- 172.21.15.77:0/947660516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60100a40 msgr2=0x7f9f60100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.162 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.158+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/947660516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60100a40 0x7f9f60100e40 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9f5801acb0 tx=0x7f9f5803b920 comp rx=0 tx=0).stop 2024-09-15T23:33:46.166 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.162+0000 7f9f66f8d640 1 -- 172.21.15.77:0/947660516 shutdown_connections 2024-09-15T23:33:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.162+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/947660516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f601025f0 0x7f9f60108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.162+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/947660516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f60101c30 0x7f9f601020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.163+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/947660516 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60100a40 0x7f9f60100e40 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.167 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.163+0000 7f9f66f8d640 1 -- 172.21.15.77:0/947660516 >> 172.21.15.77:0/947660516 conn(0x7f9f600fc1e0 msgr2=0x7f9f600fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:46.177 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.171+0000 7f9f66f8d640 1 -- 172.21.15.77:0/947660516 shutdown_connections 2024-09-15T23:33:46.179 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.177+0000 7f9f66f8d640 1 -- 172.21.15.77:0/947660516 wait complete. 2024-09-15T23:33:46.181 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.177+0000 7f9f66f8d640 1 Processor -- start 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 -- start start 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60100a40 0x7f9f60107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60101c30 0x7f9f60108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006d870 con 0x7f9f60101c30 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006d6f0 con 0x7f9f60100a40 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.178+0000 7f9f66f8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f6006d9f0 con 0x7f9f601025f0 2024-09-15T23:33:46.182 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.179+0000 7f9f6552a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.180+0000 7f9f6552a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:57842/0 (socket says 172.21.15.77:57842) 2024-09-15T23:33:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.180+0000 7f9f6552a640 1 -- 172.21.15.77:0/4177321558 learned_addr learned my addr 172.21.15.77:0/4177321558 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.182+0000 7f9f64d29640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60100a40 0x7f9f60107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.187 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.182+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60101c30 0x7f9f60108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.186+0000 7f9f6552a640 1 -- 172.21.15.77:0/4177321558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60100a40 msgr2=0x7f9f60107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.186+0000 7f9f6552a640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60100a40 0x7f9f60107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.186+0000 7f9f6552a640 1 -- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60101c30 msgr2=0x7f9f60108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.186+0000 7f9f6552a640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60101c30 0x7f9f60108530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.188 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.186+0000 7f9f6552a640 1 -- 172.21.15.77:0/4177321558 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f60110390 con 0x7f9f601025f0 2024-09-15T23:33:46.194 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.190+0000 7f9f6552a640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400b3f0 tx=0x7f9f5400b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.197+0000 7f9f5dffb640 1 -- 172.21.15.77:0/4177321558 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f54015020 con 0x7f9f601025f0 2024-09-15T23:33:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.197+0000 7f9f5dffb640 1 -- 172.21.15.77:0/4177321558 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f54011d10 con 0x7f9f601025f0 2024-09-15T23:33:46.199 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.197+0000 7f9f5dffb640 1 -- 172.21.15.77:0/4177321558 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5400f2e0 con 0x7f9f601025f0 2024-09-15T23:33:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.199+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f60110680 con 0x7f9f601025f0 2024-09-15T23:33:46.202 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.200+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f60110b80 con 0x7f9f601025f0 2024-09-15T23:33:46.215 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.213+0000 7f9f69e02740 1 Processor -- start 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 -- start start 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 0x5607776cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776ce2e0 0x5607776d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776d5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5607776312f0 con 0x5607776cd9a0 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5607775d9270 con 0x5607776ce2e0 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f69e02740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56077762d2b0 con 0x5607776d3370 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.219+0000 7f9f5dffb640 1 -- 172.21.15.77:0/4177321558 <== mon.1 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9f54018020 con 0x7f9f601025f0 2024-09-15T23:33:46.222 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.220+0000 7f9f5dffb640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 0x7f9f480a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.221+0000 7f9f5dffb640 1 -- 172.21.15.77:0/4177321558 <== mon.1 v2:172.21.15.159:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9f540cf430 con 0x7f9f601025f0 2024-09-15T23:33:46.223 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.222+0000 7f9f6552a640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 0x7f9f480a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.223+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776d5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.225 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.223+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776d5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:57846/0 (socket says 172.21.15.77:57846) 2024-09-15T23:33:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.223+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2628128887 learned_addr learned my addr 172.21.15.77:0/2628128887 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.223+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 0x5607776cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2628128887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 msgr2=0x5607776d5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776d5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2628128887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776ce2e0 msgr2=0x5607776d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f64d29640 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776ce2e0 0x5607776d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776ce2e0 0x5607776d2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.227+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2628128887 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607775d8340 con 0x5607776cd9a0 2024-09-15T23:33:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.228+0000 7f9f6552a640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 0x7f9f480a59f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f54098030 tx=0x7f9f54011ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.233+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 0x5607776cdda0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9f50006fd0 tx=0x7f9f500069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfeae1f3eba3d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.237+0000 7f9f46ffd640 1 -- 172.21.15.77:0/2628128887 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f50018430 con 0x5607776cd9a0 2024-09-15T23:33:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.237+0000 7f9f46ffd640 1 -- 172.21.15.77:0/2628128887 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f5000ae50 con 0x5607776cd9a0 2024-09-15T23:33:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.238+0000 7f9f69e02740 1 -- 172.21.15.77:0/2628128887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 msgr2=0x5607776cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.238+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 0x5607776cdda0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9f50006fd0 tx=0x7f9f500069e0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.245+0000 7f9f69e02740 1 -- 172.21.15.77:0/2628128887 shutdown_connections 2024-09-15T23:33:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.245+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776d5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.245+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776ce2e0 0x5607776d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.245+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2628128887 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776cd9a0 0x5607776cdda0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.247 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.245+0000 7f9f69e02740 1 -- 172.21.15.77:0/2628128887 >> 172.21.15.77:0/2628128887 conn(0x5607776c9010 msgr2=0x5607776c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:46.251 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.249+0000 7f9f69e02740 1 -- 172.21.15.77:0/2628128887 shutdown_connections 2024-09-15T23:33:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.254+0000 7f9f69e02740 1 -- 172.21.15.77:0/2628128887 wait complete. 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.254+0000 7f9f69e02740 1 -- start start 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.254+0000 7f9f69e02740 1 Processor -- start 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.255+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776d7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.255+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.255+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776df0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.255+0000 7f9f69e02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5607776d6330 con 0x5607776ce2e0 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.255+0000 7f9f69e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5607775ba290 con 0x5607776cd9a0 2024-09-15T23:33:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.256+0000 7f9f69e02740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5607776d64b0 con 0x5607776d3370 2024-09-15T23:33:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.256+0000 7f9f69e02740 10 client.0 _ll_register_callbacks cb 0x5607775eb140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.260+0000 7f9f64d29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.260+0000 7f9f64d29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33036/0 (socket says 172.21.15.77:33036) 2024-09-15T23:33:46.266 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.260+0000 7f9f64d29640 1 -- 172.21.15.77:0/1500233137 learned_addr learned my addr 172.21.15.77:0/1500233137 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.260+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776df0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.260+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776d7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.264+0000 7f9f64d29640 1 -- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 msgr2=0x5607776df0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.264+0000 7f9f64d29640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776df0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.267 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.264+0000 7f9f64d29640 1 -- 172.21.15.77:0/1500233137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 msgr2=0x5607776d7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.264+0000 7f9f64d29640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776d7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.264+0000 7f9f64d29640 1 -- 172.21.15.77:0/1500233137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560777344210 con 0x5607776ce2e0 2024-09-15T23:33:46.268 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.265+0000 7f9f64d29640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9f5801acb0 tx=0x7f9f58003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e11992f12ab22e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.266+0000 7f9f3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.266+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58045070 con 0x5607776ce2e0 2024-09-15T23:33:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.266+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f5000ae50 con 0x5607776ce2e0 2024-09-15T23:33:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.266+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9f58019040 con 0x5607776ce2e0 2024-09-15T23:33:46.270 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.268+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f580409b0 con 0x5607776ce2e0 2024-09-15T23:33:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.269+0000 7f9f69e02740 10 client.15708 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:46.271 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.269+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x560777410620 con 0x5607776ce2e0 2024-09-15T23:33:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.270+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f5000ae50 con 0x5607776ce2e0 2024-09-15T23:33:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f58041620 con 0x5607776ce2e0 2024-09-15T23:33:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 10 client.15708 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:46.272 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 20 client.15708 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607776e3c40 0x5607776e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 4 client.15708 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:46.273 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.271+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56077763ea20 con 0x5607776e3c40 2024-09-15T23:33:46.280 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.278+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607776e3c40 0x5607776e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.290+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607776e3c40 0x5607776e60a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=436241aac2028680 server_cookie=2ff2ecd42b69a5c3 in_seq=0 out_seq=0 2024-09-15T23:33:46.291 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.290+0000 7f9f3ffff640 10 client.15708 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.292+0000 7f9f3ffff640 1 -- 172.21.15.77:0/1500233137 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56077763ea20 con 0x5607776e3c40 2024-09-15T23:33:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.292+0000 7f9f3ffff640 10 client.15708 handle_command_reply: tid=0 2024-09-15T23:33:46.293 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.292+0000 7f9f69e02740 1 client.15708 shutdown 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.294+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 msgr2=0x5607776d8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.294+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9f5801acb0 tx=0x7f9f58003ba0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 shutdown_connections 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607776e3c40 0x5607776e60a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776df0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776d8090 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 --2- 172.21.15.77:0/1500233137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776d7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.296 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 >> 172.21.15.77:0/1500233137 conn(0x5607776c9010 msgr2=0x5607776ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:46.297 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.295+0000 7f9f3ffff640 0 client.15708 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.297+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 shutdown_connections 2024-09-15T23:33:46.298 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.297+0000 7f9f69e02740 1 -- 172.21.15.77:0/1500233137 wait complete. 2024-09-15T23:33:46.299 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.298+0000 7f9f69e02740 20 client.15708 trim_cache size 0 max 16384 2024-09-15T23:33:46.337 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.335+0000 7f9f69e02740 1 Processor -- start 2024-09-15T23:33:46.337 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.336+0000 7f9f69e02740 1 -- start start 2024-09-15T23:33:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.336+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.336+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.337+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776ca630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.338 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.337+0000 7f9f69e02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c00dc80 con 0x5607776ce2e0 2024-09-15T23:33:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.337+0000 7f9f69e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c010500 con 0x5607776cd9a0 2024-09-15T23:33:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.337+0000 7f9f69e02740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c00e2f0 con 0x5607776d3370 2024-09-15T23:33:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33050/0 (socket says 172.21.15.77:33050) 2024-09-15T23:33:46.339 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 -- 172.21.15.77:0/3401043864 learned_addr learned my addr 172.21.15.77:0/3401043864 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 -- 172.21.15.77:0/3401043864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 msgr2=0x5607776ca630 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:33:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776ca630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 -- 172.21.15.77:0/3401043864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 msgr2=0x5607776c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.340 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.338+0000 7f9f64d29640 1 -- 172.21.15.77:0/3401043864 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607776d7690 con 0x5607776ce2e0 2024-09-15T23:33:46.341 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.339+0000 7f9f64d29640 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f5803b960 tx=0x7f9f580021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56f932a0a91cf70 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.340+0000 7f9f467fc640 1 -- 172.21.15.77:0/3401043864 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f58065070 con 0x5607776ce2e0 2024-09-15T23:33:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.340+0000 7f9f467fc640 1 -- 172.21.15.77:0/3401043864 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f5804f030 con 0x5607776ce2e0 2024-09-15T23:33:46.342 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 -- 172.21.15.77:0/3401043864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 msgr2=0x5607776df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f5803b960 tx=0x7f9f580021d0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 -- 172.21.15.77:0/3401043864 shutdown_connections 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776d3370 0x5607776ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776ce2e0 0x5607776df090 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 --2- 172.21.15.77:0/3401043864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776cd9a0 0x5607776c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.343 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.341+0000 7f9f69e02740 1 -- 172.21.15.77:0/3401043864 >> 172.21.15.77:0/3401043864 conn(0x5607776c9010 msgr2=0x5607776c9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:46.345 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.344+0000 7f9f69e02740 1 -- 172.21.15.77:0/3401043864 shutdown_connections 2024-09-15T23:33:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.344+0000 7f9f69e02740 1 -- 172.21.15.77:0/3401043864 wait complete. 2024-09-15T23:33:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.345+0000 7f9f69e02740 1 -- start start 2024-09-15T23:33:46.346 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.345+0000 7f9f69e02740 1 Processor -- start 2024-09-15T23:33:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776cd9a0 0x5607776dc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776d3370 0x5607776dc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.348 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c00e9c0 con 0x5607776dd630 2024-09-15T23:33:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c00fe30 con 0x5607776d3370 2024-09-15T23:33:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f4c00f090 con 0x5607776cd9a0 2024-09-15T23:33:46.349 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.346+0000 7f9f69e02740 10 client.0 _ll_register_callbacks cb 0x7f9f58005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:46.353 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.351+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.351+0000 7f9f5ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33054/0 (socket says 172.21.15.77:33054) 2024-09-15T23:33:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.351+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2841294688 learned_addr learned my addr 172.21.15.77:0/2841294688 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.351+0000 7f9f64d29640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776d3370 0x5607776dc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.354 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.352+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776cd9a0 0x5607776dc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.354+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776cd9a0 msgr2=0x5607776dc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.354+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776cd9a0 0x5607776dc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.354+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2841294688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776d3370 msgr2=0x5607776dc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.354+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776d3370 0x5607776dc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:46.357 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.354+0000 7f9f5ffff640 1 -- 172.21.15.77:0/2841294688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607776de020 con 0x5607776dd630 2024-09-15T23:33:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.359+0000 7f9f5ffff640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000a2f0 tx=0x7f9f500069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd950cc092d8721 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:46.362 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.359+0000 7f9f3ffff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:46.366 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.364+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f500173e0 con 0x5607776dd630 2024-09-15T23:33:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.364+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9f50017b40 con 0x5607776dd630 2024-09-15T23:33:46.367 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.365+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x560777638d70 con 0x5607776dd630 2024-09-15T23:33:46.370 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.368+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9f50017d60 con 0x5607776dd630 2024-09-15T23:33:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.369+0000 7f9f69e02740 10 client.15714 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:46.371 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.369+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607776df3c0 con 0x5607776dd630 2024-09-15T23:33:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.376+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x560777638d70 con 0x5607776dd630 2024-09-15T23:33:46.377 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.376+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9f5002f030 con 0x5607776dd630 2024-09-15T23:33:46.384 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 10 client.15714 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 20 client.15714 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56077774edd0 0x5607777511c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 4 client.15714 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:33:46.385 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.379+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5607775b5900 con 0x56077774edd0 2024-09-15T23:33:46.390 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.388+0000 7f9f64d29640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56077774edd0 0x5607777511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.405+0000 7f9f64d29640 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56077774edd0 0x5607777511c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e54e4773d7347f3b server_cookie=2f934b7e203683e in_seq=0 out_seq=0 2024-09-15T23:33:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:46.405+0000 7f9f3ffff640 10 client.15714 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:47.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:47 smithi159 ceph-mon[35472]: pgmap v416: 129 pgs: 129 active+clean; 4.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 334 MiB/s wr, 307 op/s 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f3ffff640 1 -- 172.21.15.77:0/2841294688 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5607775b5900 con 0x56077774edd0 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f3ffff640 10 client.15714 handle_command_reply: tid=0 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 client.15714 shutdown 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 msgr2=0x5607776dda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f5000a2f0 tx=0x7f9f500069e0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.597 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 shutdown_connections 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56077774edd0 0x5607777511c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607776dd630 0x5607776dda90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607776d3370 0x5607776dc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 --2- 172.21.15.77:0/2841294688 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607776cd9a0 0x5607776dc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.594+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 >> 172.21.15.77:0/2841294688 conn(0x5607776c9010 msgr2=0x5607776ca740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.595+0000 7f9f3ffff640 0 client.15714 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.595+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 shutdown_connections 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.595+0000 7f9f69e02740 1 -- 172.21.15.77:0/2841294688 wait complete. 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.595+0000 7f9f69e02740 20 client.15714 trim_cache size 0 max 16384 2024-09-15T23:33:47.598 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 msgr2=0x7f9f480a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 0x7f9f480a59f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9f54098030 tx=0x7f9f54011ec0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 msgr2=0x7f9f6010fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9f5400b3f0 tx=0x7f9f5400b8b0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.599 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 shutdown_connections 2024-09-15T23:33:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9f480a3530 0x7f9f480a59f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9f601025f0 0x7f9f6010fcf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9f60101c30 0x7f9f60108530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 --2- 172.21.15.77:0/4177321558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f60100a40 0x7f9f60107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:47.600 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 >> 172.21.15.77:0/4177321558 conn(0x7f9f600fc1e0 msgr2=0x7f9f60070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 shutdown_connections 2024-09-15T23:33:47.601 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:33:47.597+0000 7f9f66f8d640 1 -- 172.21.15.77:0/4177321558 wait complete. 2024-09-15T23:33:47.613 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:47 smithi155 ceph-mon[35631]: pgmap v416: 129 pgs: 129 active+clean; 4.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 334 MiB/s wr, 307 op/s 2024-09-15T23:33:47.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:47 smithi077 ceph-mon[30968]: pgmap v416: 129 pgs: 129 active+clean; 4.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 415 KiB/s rd, 334 MiB/s wr, 307 op/s 2024-09-15T23:33:48.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:48 smithi159 ceph-mon[35472]: pgmap v417: 129 pgs: 129 active+clean; 5.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 482 MiB/s wr, 348 op/s 2024-09-15T23:33:48.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:48 smithi155 ceph-mon[35631]: pgmap v417: 129 pgs: 129 active+clean; 5.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 482 MiB/s wr, 348 op/s 2024-09-15T23:33:48.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:48 smithi077 ceph-mon[30968]: pgmap v417: 129 pgs: 129 active+clean; 5.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 482 MiB/s wr, 348 op/s 2024-09-15T23:33:48.937 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-15T23:33:48.937 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T23:33:48.937 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:33:49.303 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 initial writers = 949257.19 kB/sec 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 initial writers = 949238.23 kB/sec 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 949257.19 kB/sec 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 949257.19 kB/sec 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 949257.19 kB/sec 2024-09-15T23:33:49.500 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-09-15T23:33:50.823 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:33:51.180 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:50 smithi077 ceph-mon[30968]: pgmap v418: 129 pgs: 129 active+clean; 7.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 631 MiB/s wr, 388 op/s 2024-09-15T23:33:51.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 -- 172.21.15.77:0/2992979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102570 msgr2=0x7ff45c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:51.195 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 --2- 172.21.15.77:0/2992979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102570 0x7ff45c1029b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff450009900 tx=0x7ff45002a480 comp rx=0 tx=0).stop 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 -- 172.21.15.77:0/2992979399 shutdown_connections 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 --2- 172.21.15.77:0/2992979399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102ef0 0x7ff45c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 --2- 172.21.15.77:0/2992979399 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102570 0x7ff45c1029b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 --2- 172.21.15.77:0/2992979399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 0x7ff45c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 -- 172.21.15.77:0/2992979399 >> 172.21.15.77:0/2992979399 conn(0x7ff45c0fc7d0 msgr2=0x7ff45c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 -- 172.21.15.77:0/2992979399 shutdown_connections 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.178+0000 7ff460871640 1 -- 172.21.15.77:0/2992979399 wait complete. 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 Processor -- start 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 -- start start 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 0x7ff45c199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:51.196 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102570 0x7ff45c1998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c110f80 con 0x7ff45c102ef0 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c110e00 con 0x7ff45c102570 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff460871640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c111100 con 0x7ff45c100e20 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff45ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff45ad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47044/0 (socket says 172.21.15.77:47044) 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff45ad9d640 1 -- 172.21.15.77:0/3801930990 learned_addr learned my addr 172.21.15.77:0/3801930990 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:51.197 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.179+0000 7ff45a59c640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 0x7ff45c199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff459d9b640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102570 0x7ff45c1998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 -- 172.21.15.77:0/3801930990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 msgr2=0x7ff45c199390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 0x7ff45c199390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 -- 172.21.15.77:0/3801930990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102570 msgr2=0x7ff45c1998d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102570 0x7ff45c1998d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 -- 172.21.15.77:0/3801930990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45c1a4950 con 0x7ff45c102ef0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff45ad9d640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff45400cad0 tx=0x7ff45400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45400ae20 con 0x7ff45c102ef0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff45c1a4b20 con 0x7ff45c102ef0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff454005020 con 0x7ff45c102ef0 2024-09-15T23:33:51.198 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff45400f6f0 con 0x7ff45c102ef0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.180+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45c1a4fe0 con 0x7ff45c102ef0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.181+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff45c101200 con 0x7ff45c102ef0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.182+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff4540051d0 con 0x7ff45c102ef0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.183+0000 7ff44b7fe640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.183+0000 7ff45a59c640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.183+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff4540cfca0 con 0x7ff45c102ef0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.184+0000 7ff45a59c640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 0x7ff4440a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00bbe0 tx=0x7ff44c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:51.199 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.188+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff454014030 con 0x7ff45c102ef0 2024-09-15T23:33:51.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:50 smithi159 ceph-mon[35472]: pgmap v418: 129 pgs: 129 active+clean; 7.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 631 MiB/s wr, 388 op/s 2024-09-15T23:33:51.317 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:51.317 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:50 smithi155 ceph-mon[35631]: pgmap v418: 129 pgs: 129 active+clean; 7.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 631 MiB/s wr, 388 op/s 2024-09-15T23:33:51.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.411+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff45c109090 con 0x7ff45c102ef0 2024-09-15T23:33:51.413 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.412+0000 7ff44b7fe640 1 -- 172.21.15.77:0/3801930990 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7ff45409c630 con 0x7ff45c102ef0 2024-09-15T23:33:51.414 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:33:51.414 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:33:51.414 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:33:51.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 msgr2=0x7ff4440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:51.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 0x7ff4440a5700 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00bbe0 tx=0x7ff44c00b390 comp rx=0 tx=0).stop 2024-09-15T23:33:51.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 msgr2=0x7ff45c1a4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff45400cad0 tx=0x7ff45400cf90 comp rx=0 tx=0).stop 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 shutdown_connections 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff4440a3240 0x7ff4440a5700 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff45c102ef0 0x7ff45c1a4410 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff45c102570 0x7ff45c1998d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 --2- 172.21.15.77:0/3801930990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff45c100e20 0x7ff45c199390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 >> 172.21.15.77:0/3801930990 conn(0x7ff45c0fc7d0 msgr2=0x7ff45c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 shutdown_connections 2024-09-15T23:33:51.417 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:51.415+0000 7ff460871640 1 -- 172.21.15.77:0/3801930990 wait complete. 2024-09-15T23:33:52.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:51 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3801930990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:52.296 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:51 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3801930990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:52.323 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T23:33:52.324 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T23:33:52.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:51 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3801930990' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1050804475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102ef0 msgr2=0x7f5f9810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1050804475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102ef0 0x7f5f9810da40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009ca0 tx=0x7f5f9002a950 comp rx=0 tx=0).stop 2024-09-15T23:33:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1050804475 shutdown_connections 2024-09-15T23:33:52.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1050804475 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102ef0 0x7f5f9810da40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1050804475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98102570 0x7f5f981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1050804475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98100e20 0x7f5f98101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1050804475 >> 172.21.15.77:0/1050804475 conn(0x7f5f980fc7d0 msgr2=0x7f5f980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1050804475 shutdown_connections 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1050804475 wait complete. 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.548+0000 7f5f9e3d3640 1 Processor -- start 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 -- start start 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98100e20 0x7f5f98198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98102ef0 0x7f5f9819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98110fc0 con 0x7f5f98102570 2024-09-15T23:33:52.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98110e40 con 0x7f5f98102ef0 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9e3d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f98111140 con 0x7f5f98100e20 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47052/0 (socket says 172.21.15.77:47052) 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 -- 172.21.15.77:0/1207482611 learned_addr learned my addr 172.21.15.77:0/1207482611 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f9c970640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98102ef0 0x7f5f9819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f97fff640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98100e20 0x7f5f98198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 -- 172.21.15.77:0/1207482611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98100e20 msgr2=0x7f5f98198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98100e20 0x7f5f98198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 -- 172.21.15.77:0/1207482611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98102ef0 msgr2=0x7f5f9819ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98102ef0 0x7f5f9819ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 -- 172.21.15.77:0/1207482611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9819d520 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.549+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b4a0 tx=0x7f5f8000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.550+0000 7f5f95ffb640 1 -- 172.21.15.77:0/1207482611 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80014070 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.550+0000 7f5f95ffb640 1 -- 172.21.15.77:0/1207482611 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f80010af0 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.550+0000 7f5f95ffb640 1 -- 172.21.15.77:0/1207482611 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80017d10 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.550+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9819d810 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.550+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f980fcbb0 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.552+0000 7f5f95ffb640 1 -- 172.21.15.77:0/1207482611 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5f80017070 con 0x7f5f98102570 2024-09-15T23:33:52.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.552+0000 7f5fa07ac740 1 Processor -- start 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 -- start start 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 0x5593f6db2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 0x5593f6dbd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dbfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5593f6d182e0 con 0x5593f6db24a0 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593f6cbfce0 con 0x5593f6db2dc0 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5593f6d142a0 con 0x5593f6dbd680 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 0x5593f6db2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f95ffb640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 0x7f5f840a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 0x5593f6dbd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 0x5593f6dbd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:54384/0 (socket says 172.21.15.77:54384) 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f97fff640 1 -- 172.21.15.77:0/2736218968 learned_addr learned my addr 172.21.15.77:0/2736218968 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dbfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 0x7f5f840a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f95ffb640 1 -- 172.21.15.77:0/1207482611 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f5f800cef50 con 0x7f5f98102570 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 -- 172.21.15.77:0/2736218968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 msgr2=0x5593f6dbfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dbfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 -- 172.21.15.77:0/2736218968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 msgr2=0x5593f6dbd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 0x5593f6dbd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.553+0000 7f5f9c970640 1 -- 172.21.15.77:0/2736218968 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f6ca4440 con 0x5593f6db24a0 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.554+0000 7f5f9c970640 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 0x5593f6db2880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f90005cc0 tx=0x7f5f9002fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ed962634847a65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.554+0000 7f5f9c970640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 0x7f5f840a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f9003c000 tx=0x7f5f90048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.556+0000 7f5f8e7fc640 1 -- 172.21.15.77:0/2736218968 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9004d070 con 0x5593f6db24a0 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.556+0000 7f5f8e7fc640 1 -- 172.21.15.77:0/2736218968 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f9002f740 con 0x5593f6db24a0 2024-09-15T23:33:52.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.556+0000 7f5f8e7fc640 1 -- 172.21.15.77:0/2736218968 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f90034040 con 0x5593f6db24a0 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2736218968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 msgr2=0x5593f6db2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 0x5593f6db2880 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f90005cc0 tx=0x7f5f9002fc90 comp rx=0 tx=0).stop 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2736218968 shutdown_connections 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dbfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db2dc0 0x5593f6dbd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2736218968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db24a0 0x5593f6db2880 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2736218968 >> 172.21.15.77:0/2736218968 conn(0x5593f6daea30 msgr2=0x5593f6daee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2736218968 shutdown_connections 2024-09-15T23:33:52.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2736218968 wait complete. 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 -- start start 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.557+0000 7f5fa07ac740 1 Processor -- start 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dbd030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47076/0 (socket says 172.21.15.77:47076) 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 -- 172.21.15.77:0/3436280430 learned_addr learned my addr 172.21.15.77:0/3436280430 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5593f6dc0250 con 0x5593f6db2dc0 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593f6cd3050 con 0x5593f6db24a0 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5593f6dc03d0 con 0x5593f6dbd680 2024-09-15T23:33:52.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f97fff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dbd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5fa07ac740 10 client.0 _ll_register_callbacks cb 0x5593f6d13160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 -- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 msgr2=0x5593f6dba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 -- 172.21.15.77:0/3436280430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 msgr2=0x5593f6dbd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dbd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f6a893c0 con 0x5593f6db2dc0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f8009b220 tx=0x7f5f8000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7892c6c3f7b75c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f777fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.558+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8001e070 con 0x5593f6db2dc0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5593f6d25850 con 0x5593f6db2dc0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f5f80017360 con 0x5593f6db2dc0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5f800a3e50 con 0x5593f6db2dc0 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 10 client.15732 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:52.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5593f6dcbcb0 con 0x5593f6db2dc0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5593f6d25850 con 0x5593f6db2dc0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5f8009f150 con 0x5593f6db2dc0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 10 client.15732 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 20 client.15732 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6dcf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 4 client.15732 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593f6d1fd60 con 0x5593f6dcd0c0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.559+0000 7f5f97fff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6dcf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.560+0000 7f5f97fff640 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6dcf530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28813ee5d88c4baf server_cookie=66707bcc2bdede4a in_seq=0 out_seq=0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.560+0000 7f5f777fe640 10 client.15732 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.560+0000 7f5f777fe640 1 -- 172.21.15.77:0/3436280430 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593f6d1fd60 con 0x5593f6dcd0c0 2024-09-15T23:33:52.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.560+0000 7f5f777fe640 10 client.15732 handle_command_reply: tid=0 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.560+0000 7f5fa07ac740 1 client.15732 shutdown 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 msgr2=0x5593f6dba2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f8009b220 tx=0x7f5f8000bf90 comp rx=0 tx=0).stop 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 shutdown_connections 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6dcf530 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5f777fe640 0 client.15732 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6dba2e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/3436280430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dbd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 >> 172.21.15.77:0/3436280430 conn(0x5593f6daea30 msgr2=0x5593f6db4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 shutdown_connections 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 1 -- 172.21.15.77:0/3436280430 wait complete. 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.561+0000 7f5fa07ac740 20 client.15732 trim_cache size 0 max 16384 2024-09-15T23:33:52.596 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 Processor -- start 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 -- start start 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dd4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981aedf0 con 0x5593f6db2dc0 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981b1670 con 0x5593f6db24a0 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981af460 con 0x5593f6dbd680 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47080/0 (socket says 172.21.15.77:47080) 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 -- 172.21.15.77:0/945356734 learned_addr learned my addr 172.21.15.77:0/945356734 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f97fff640 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f9c970640 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dd4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 -- 172.21.15.77:0/945356734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 msgr2=0x5593f6dd4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dd4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 -- 172.21.15.77:0/945356734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 msgr2=0x5593f6dc94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 -- 172.21.15.77:0/945356734 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593f6db9290 con 0x5593f6db2dc0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.578+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f80099540 tx=0x7f5f800997a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8d05206066f10f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5f8dffb640 1 -- 172.21.15.77:0/945356734 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8001e050 con 0x5593f6db2dc0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5f8dffb640 1 -- 172.21.15.77:0/945356734 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f80017360 con 0x5593f6db2dc0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5f8dffb640 1 -- 172.21.15.77:0/945356734 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f800a39c0 con 0x5593f6db2dc0 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 -- 172.21.15.77:0/945356734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 msgr2=0x5593f6db8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f80099540 tx=0x7f5f800997a0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 -- 172.21.15.77:0/945356734 shutdown_connections 2024-09-15T23:33:52.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6dbd680 0x5593f6dd4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6db2dc0 0x5593f6db8bb0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/945356734 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 -- 172.21.15.77:0/945356734 >> 172.21.15.77:0/945356734 conn(0x5593f6daea30 msgr2=0x5593f6db5900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 -- 172.21.15.77:0/945356734 shutdown_connections 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.579+0000 7f5fa07ac740 1 -- 172.21.15.77:0/945356734 wait complete. 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 -- start start 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 Processor -- start 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 0x5593f6dc1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981afb30 con 0x5593f6dbd680 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981b0fa0 con 0x5593f6db24a0 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f981b0200 con 0x5593f6db2dc0 2024-09-15T23:33:52.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5fa07ac740 10 client.0 _ll_register_callbacks cb 0x7f5f800092b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.580+0000 7f5f9c970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 0x5593f6dc1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f8ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 0x5593f6dc1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49036/0 (socket says 172.21.15.77:49036) 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f9c970640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47082/0 (socket says 172.21.15.77:47082) 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:54394/0 (socket says 172.21.15.77:54394) 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f8ffff640 1 -- 172.21.15.77:0/2302325123 learned_addr learned my addr 172.21.15.77:0/2302325123 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 -- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 msgr2=0x5593f6dc1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 0x5593f6dc1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 -- 172.21.15.77:0/2302325123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 msgr2=0x5593f6dc2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:52.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 -- 172.21.15.77:0/2302325123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593f6db2bf0 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f9c970640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f97fff640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5593f6dc0520 tx=0x7f5f88010b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13af1267c706dfe8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f777fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f88004220 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f80017360 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.581+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f5f880043c0 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f5f8801e850 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 10 client.25157 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5593f6e38150 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f80017360 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f5f88026400 con 0x5593f6db24a0 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 10 client.25157 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:52.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 10 client.25157 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 20 client.25157 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6e3a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 4 client.25157 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5593f6c9c210 con 0x5593f6dcd0c0 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.582+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6e3a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5f8ffff640 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6e3a890 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da86b35b18bb1b98 server_cookie=a68c8c06904a8568 in_seq=0 out_seq=0 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5f777fe640 10 client.25157 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5f777fe640 1 -- 172.21.15.77:0/2302325123 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5593f6c9c210 con 0x5593f6dcd0c0 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5f777fe640 10 client.25157 handle_command_reply: tid=0 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 client.25157 shutdown 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 msgr2=0x5593f6dc1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x5593f6dc0520 tx=0x7f5f88010b40 comp rx=0 tx=0).stop 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 shutdown_connections 2024-09-15T23:33:52.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5593f6dcd0c0 0x5593f6e3a890 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5593f6dbd680 0x5593f6dc2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5593f6db2dc0 0x5593f6dc1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 --2- 172.21.15.77:0/2302325123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593f6db24a0 0x5593f6dc1580 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 >> 172.21.15.77:0/2302325123 conn(0x5593f6daea30 msgr2=0x5593f6dbc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5f777fe640 0 client.25157 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 shutdown_connections 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 1 -- 172.21.15.77:0/2302325123 wait complete. 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.583+0000 7f5fa07ac740 20 client.25157 trim_cache size 0 max 16384 2024-09-15T23:33:52.603 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:33:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:33:52.604 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:33:52.604 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:33:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 msgr2=0x7f5f840a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 0x7f5f840a5780 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5f9003c000 tx=0x7f5f90048000 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 msgr2=0x7f5f98198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000b4a0 tx=0x7f5f8000b960 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 shutdown_connections 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f5f840a32c0 0x7f5f840a5780 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f98102ef0 0x7f5f9819ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f5f98102570 0x7f5f98198ab0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 --2- 172.21.15.77:0/1207482611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f98100e20 0x7f5f98198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 >> 172.21.15.77:0/1207482611 conn(0x7f5f980fc7d0 msgr2=0x7f5f9806a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 shutdown_connections 2024-09-15T23:33:52.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:52.584+0000 7f5f9e3d3640 1 -- 172.21.15.77:0/1207482611 wait complete. 2024-09-15T23:33:53.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:52 smithi159 ceph-mon[35472]: pgmap v419: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 826 MiB/s wr, 435 op/s 2024-09-15T23:33:53.266 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:52 smithi077 ceph-mon[30968]: pgmap v419: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 826 MiB/s wr, 435 op/s 2024-09-15T23:33:53.302 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:33:53.302 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:33:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:52 smithi155 ceph-mon[35631]: pgmap v419: 129 pgs: 129 active+clean; 9.7 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 826 MiB/s wr, 435 op/s 2024-09-15T23:33:53.375 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:55.122 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:54 smithi077 ceph-mon[30968]: pgmap v420: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 769 MiB/s wr, 420 op/s 2024-09-15T23:33:55.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:54 smithi159 ceph-mon[35472]: pgmap v420: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 769 MiB/s wr, 420 op/s 2024-09-15T23:33:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:54 smithi155 ceph-mon[35631]: pgmap v420: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 416 KiB/s rd, 769 MiB/s wr, 420 op/s 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.057+0000 7fceb1aae640 1 -- 172.21.15.77:0/3144089647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac105560 msgr2=0x7fceac10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.057+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3144089647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac105560 0x7fceac10d0e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea002a410 comp rx=0 tx=0).stop 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 -- 172.21.15.77:0/3144089647 shutdown_connections 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3144089647 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac105560 0x7fceac10d0e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3144089647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 0x7fceac104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3144089647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac100430 0x7fceac100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 -- 172.21.15.77:0/3144089647 >> 172.21.15.77:0/3144089647 conn(0x7fceac077230 msgr2=0x7fceac0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.059+0000 7fceb1aae640 1 -- 172.21.15.77:0/3144089647 shutdown_connections 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.060+0000 7fceb1aae640 1 -- 172.21.15.77:0/3144089647 wait complete. 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.061+0000 7fceb1aae640 1 Processor -- start 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.063+0000 7fceb1aae640 1 -- start start 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 0x7fceac19e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac105560 0x7fceac1964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fceac110f50 con 0x7fceac100430 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fceac110dd0 con 0x7fceac105560 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.064+0000 7fceb1aae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fceac1110d0 con 0x7fceac100de0 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.069+0000 7fceab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.069+0000 7fceabfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac105560 0x7fceac1964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.069+0000 7fceaaffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 0x7fceac19e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.070+0000 7fceab7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47100/0 (socket says 172.21.15.77:47100) 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.070+0000 7fceab7fe640 1 -- 172.21.15.77:0/3887139988 learned_addr learned my addr 172.21.15.77:0/3887139988 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.071+0000 7fceab7fe640 1 -- 172.21.15.77:0/3887139988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 msgr2=0x7fceac19e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.071+0000 7fceab7fe640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 0x7fceac19e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.072+0000 7fceab7fe640 1 -- 172.21.15.77:0/3887139988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac105560 msgr2=0x7fceac1964a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.072+0000 7fceab7fe640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac105560 0x7fceac1964a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.072+0000 7fceab7fe640 1 -- 172.21.15.77:0/3887139988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fceac196d60 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.073+0000 7fceab7fe640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcea400ba50 tx=0x7fcea400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.074+0000 7fcea8ff9640 1 -- 172.21.15.77:0/3887139988 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea4019070 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.074+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fceac197050 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.074+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fceac1b3e30 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.074+0000 7fcea8ff9640 1 -- 172.21.15.77:0/3887139988 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea400cbe0 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.074+0000 7fcea8ff9640 1 -- 172.21.15.77:0/3887139988 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea40076e0 con 0x7fceac100430 2024-09-15T23:33:55.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.088+0000 7fcea8ff9640 1 -- 172.21.15.77:0/3887139988 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcea401c070 con 0x7fceac100430 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.088+0000 7fceb3e87740 1 Processor -- start 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 -- start start 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c9004f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c902e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55579c85a160 con 0x55579c900a30 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55579c801720 con 0x55579c8f6170 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fceb3e87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55579c856120 con 0x55579c8f5850 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.089+0000 7fcea8ff9640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 0x7fce940a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceabfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceabfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49068/0 (socket says 172.21.15.77:49068) 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceabfff640 1 -- 172.21.15.77:0/2019772610 learned_addr learned my addr 172.21.15.77:0/2019772610 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:55.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fcea8ff9640 1 -- 172.21.15.77:0/3887139988 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fcea40cf090 con 0x7fceac100430 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceaaffd640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c902e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceabfff640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 0x7fce940a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.090+0000 7fceab7fe640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c9004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.092+0000 7fceaaffd640 1 -- 172.21.15.77:0/2019772610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 msgr2=0x55579c8f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.092+0000 7fceaaffd640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.092+0000 7fceaaffd640 1 -- 172.21.15.77:0/2019772610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 msgr2=0x55579c9004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.092+0000 7fceaaffd640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c9004f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.092+0000 7fceaaffd640 1 -- 172.21.15.77:0/2019772610 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579c5cbba0 con 0x55579c900a30 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.094+0000 7fceab7fe640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c9004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.094+0000 7fceabfff640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.095+0000 7fceaaffd640 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c902e20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fceac10d440 tx=0x7fce9c009e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60deb189753a1835 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.097+0000 7fce91ffb640 1 -- 172.21.15.77:0/2019772610 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c017070 con 0x55579c900a30 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.097+0000 7fce91ffb640 1 -- 172.21.15.77:0/2019772610 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9c013470 con 0x55579c900a30 2024-09-15T23:33:55.741 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.098+0000 7fceb3e87740 1 -- 172.21.15.77:0/2019772610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 msgr2=0x55579c902e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.098+0000 7fceb3e87740 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c902e20 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fceac10d440 tx=0x7fce9c009e10 comp rx=0 tx=0).stop 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.099+0000 7fceabfff640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 0x7fce940a5850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005ab0 tx=0x7fcea0005a00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.101+0000 7fceb3e87740 1 -- 172.21.15.77:0/2019772610 shutdown_connections 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.101+0000 7fceb3e87740 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c902e20 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.101+0000 7fceb3e87740 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c9004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.101+0000 7fceb3e87740 1 --2- 172.21.15.77:0/2019772610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c8f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.101+0000 7fceb3e87740 1 -- 172.21.15.77:0/2019772610 >> 172.21.15.77:0/2019772610 conn(0x55579c8f1de0 msgr2=0x55579c8f21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.102+0000 7fceb3e87740 1 -- 172.21.15.77:0/2019772610 shutdown_connections 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.102+0000 7fceb3e87740 1 -- 172.21.15.77:0/2019772610 wait complete. 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.102+0000 7fceb3e87740 1 -- start start 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.102+0000 7fceb3e87740 1 Processor -- start 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c9004d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c8fd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.742 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8fdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55579c903650 con 0x55579c900a30 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55579c7e2900 con 0x55579c8f6170 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55579c9037d0 con 0x55579c8f5850 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.103+0000 7fceb3e87740 10 client.0 _ll_register_callbacks cb 0x55579c7e0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.105+0000 7fceab7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c9004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.105+0000 7fceab7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c9004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:49072/0 (socket says 172.21.15.77:49072) 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.105+0000 7fceab7fe640 1 -- 172.21.15.77:0/919326266 learned_addr learned my addr 172.21.15.77:0/919326266 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.106+0000 7fceabfff640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8fdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.106+0000 7fceaaffd640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c8fd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.107+0000 7fceabfff640 1 -- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 msgr2=0x55579c9004d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.107+0000 7fceabfff640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c9004d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.107+0000 7fceabfff640 1 -- 172.21.15.77:0/919326266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 msgr2=0x55579c8fd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.107+0000 7fceabfff640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c8fd780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.743 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.107+0000 7fceabfff640 1 -- 172.21.15.77:0/919326266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579c822c50 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.109+0000 7fceabfff640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8fdf10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a4b7dab3b5a60b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.109+0000 7fce8affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.111+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea004c070 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.111+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fcea0005220 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.112+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce9c013470 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.116+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcea0041040 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.116+0000 7fceb3e87740 10 client.15750 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.116+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55579c90f240 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9c013470 con 0x55579c900a30 2024-09-15T23:33:55.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fcea0047040 con 0x55579c900a30 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 10 client.15750 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 10 client.15750 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 20 client.15750 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c9106f0 0x55579c912b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 4 client.15750 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.117+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55579c867890 con 0x55579c9106f0 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.118+0000 7fceab7fe640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c9106f0 0x55579c912b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.120+0000 7fce8affd640 10 client.15750 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.120+0000 7fceab7fe640 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c9106f0 0x55579c912b00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7de47a274e8f4f4c server_cookie=e493a9bfa28fcc74 in_seq=0 out_seq=0 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.123+0000 7fce8affd640 1 -- 172.21.15.77:0/919326266 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55579c867890 con 0x55579c9106f0 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.123+0000 7fce8affd640 10 client.15750 handle_command_reply: tid=0 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.123+0000 7fceb3e87740 1 client.15750 shutdown 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 msgr2=0x55579c8fdf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8fdf10 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009230 tx=0x7fcea0009260 comp rx=0 tx=0).stop 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 shutdown_connections 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c9106f0 0x55579c912b00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8fdf10 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f6170 0x55579c8fd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 --2- 172.21.15.77:0/919326266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f5850 0x55579c9004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 >> 172.21.15.77:0/919326266 conn(0x55579c8f1de0 msgr2=0x55579c8f7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fce8affd640 0 client.15750 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.124+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 shutdown_connections 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.125+0000 7fceb3e87740 1 -- 172.21.15.77:0/919326266 wait complete. 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.125+0000 7fceb3e87740 20 client.15750 trim_cache size 0 max 16384 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.163+0000 7fceb3e87740 1 Processor -- start 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.164+0000 7fceb3e87740 1 -- start start 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.164+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c918410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.746 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.164+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f6170 0x55579c918950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceb3e87740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800dce0 con 0x55579c900a30 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceb3e87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce98010560 con 0x55579c8f5850 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceabfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47138/0 (socket says 172.21.15.77:47138) 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceabfff640 1 -- 172.21.15.77:0/3346904185 learned_addr learned my addr 172.21.15.77:0/3346904185 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceaaffd640 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f6170 0x55579c918950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.165+0000 7fceb3e87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800e350 con 0x55579c8f6170 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.166+0000 7fceabfff640 1 -- 172.21.15.77:0/3346904185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f6170 msgr2=0x55579c918950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.166+0000 7fceabfff640 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f6170 0x55579c918950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.166+0000 7fceabfff640 1 -- 172.21.15.77:0/3346904185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 msgr2=0x55579c918410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.166+0000 7fceabfff640 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c918410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.166+0000 7fceabfff640 1 -- 172.21.15.77:0/3346904185 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579c900840 con 0x55579c900a30 2024-09-15T23:33:55.747 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.167+0000 7fceabfff640 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea002abc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2c16ec147cc623 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.167+0000 7fce917fa640 1 -- 172.21.15.77:0/3346904185 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea005d020 con 0x55579c900a30 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.167+0000 7fce917fa640 1 -- 172.21.15.77:0/3346904185 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcea00054e0 con 0x55579c900a30 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.167+0000 7fce917fa640 1 -- 172.21.15.77:0/3346904185 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcea004c040 con 0x55579c900a30 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.168+0000 7fceb3e87740 1 -- 172.21.15.77:0/3346904185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 msgr2=0x55579c8faa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.168+0000 7fceb3e87740 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009900 tx=0x7fcea002abc0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.168+0000 7fceb3e87740 1 -- 172.21.15.77:0/3346904185 shutdown_connections 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.168+0000 7fceb3e87740 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c900a30 0x55579c8faa00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.169+0000 7fceb3e87740 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c8f6170 0x55579c918950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.169+0000 7fceb3e87740 1 --2- 172.21.15.77:0/3346904185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c918410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.169+0000 7fceb3e87740 1 -- 172.21.15.77:0/3346904185 >> 172.21.15.77:0/3346904185 conn(0x55579c8f1de0 msgr2=0x55579c8fc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.169+0000 7fceb3e87740 1 -- 172.21.15.77:0/3346904185 shutdown_connections 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.169+0000 7fceb3e87740 1 -- 172.21.15.77:0/3346904185 wait complete. 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.170+0000 7fceb3e87740 1 -- start start 2024-09-15T23:33:55.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.171+0000 7fceb3e87740 1 Processor -- start 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.171+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c908cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c900a30 0x55579c8f99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800ea20 con 0x55579c8f6170 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800fe90 con 0x55579c8f5850 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fce9800f0f0 con 0x55579c900a30 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceb3e87740 10 client.0 _ll_register_callbacks cb 0x7fcea0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceaaffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:47142/0 (socket says 172.21.15.77:47142) 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.172+0000 7fceaaffd640 1 -- 172.21.15.77:0/1661277982 learned_addr learned my addr 172.21.15.77:0/1661277982 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 -- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c900a30 msgr2=0x55579c8f99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c900a30 0x55579c8f99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 -- 172.21.15.77:0/1661277982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 msgr2=0x55579c908cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:55.749 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c908cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 -- 172.21.15.77:0/1661277982 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579c8fa0b0 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fceaaffd640 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009450 tx=0x7fce9c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a666d0c0b90c5c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.173+0000 7fce8affd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.174+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce9c017040 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.174+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fce9c004590 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.174+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcea00054e0 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.174+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fce9c0127d0 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.175+0000 7fceb3e87740 10 client.15756 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.175+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55579c8fb420 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce9c012e50 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fce9c013470 con 0x55579c8f6170 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 10 client.15756 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 10 client.15756 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:33:55.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 20 client.15756 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c97c3f0 0x55579c97e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 4 client.15756 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.176+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x7fcea00054e0 con 0x55579c97c3f0 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.178+0000 7fceab7fe640 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c97c3f0 0x55579c97e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.180+0000 7fce8affd640 10 client.15756 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.180+0000 7fceab7fe640 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c97c3f0 0x55579c97e7e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be5c7de45b41717 server_cookie=3e5c5d05ca4db900 in_seq=0 out_seq=0 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.220+0000 7fce8affd640 1 -- 172.21.15.77:0/1661277982 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7fcea00054e0 con 0x55579c97c3f0 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.220+0000 7fce8affd640 10 client.15756 handle_command_reply: tid=0 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.220+0000 7fceb3e87740 1 client.15756 shutdown 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.221+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 msgr2=0x55579c9091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.221+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fce9c009450 tx=0x7fce9c00ef70 comp rx=0 tx=0).stop 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.222+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 shutdown_connections 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55579c97c3f0 0x55579c97e7e0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55579c900a30 0x55579c8f99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fce8affd640 0 client.15756 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55579c8f6170 0x55579c9091f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 --2- 172.21.15.77:0/1661277982 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55579c8f5850 0x55579c908cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 6, 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:33:55.752 INFO:teuthology.orchestra.run.smithi077.stdout: "5f350efb": { 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 6, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 139.6, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:33:55.753 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 >> 172.21.15.77:0/1661277982 conn(0x55579c8f1de0 msgr2=0x55579c8fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 shutdown_connections 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 1 -- 172.21.15.77:0/1661277982 wait complete. 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.223+0000 7fceb3e87740 20 client.15756 trim_cache size 0 max 16384 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 msgr2=0x7fce940a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.754 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 0x7fce940a5850 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcea0005ab0 tx=0x7fcea0005a00 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 msgr2=0x7fceac19e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcea400ba50 tx=0x7fcea400bf10 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 shutdown_connections 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fce940a3390 0x7fce940a5850 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fceac105560 0x7fceac1964a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fceac100de0 0x7fceac19e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 --2- 172.21.15.77:0/3887139988 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fceac100430 0x7fceac19e150 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 >> 172.21.15.77:0/3887139988 conn(0x7fceac077230 msgr2=0x7fceac10d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 shutdown_connections 2024-09-15T23:33:55.755 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:55.224+0000 7fceb1aae640 1 -- 172.21.15.77:0/3887139988 wait complete. 2024-09-15T23:33:56.526 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '5f350efb', quiesce took 7.6 seconds. Will release after: 11.950000000000001 2024-09-15T23:33:56.605 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:57.002 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:56 smithi077 ceph-mon[30968]: pgmap v421: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 827 MiB/s wr, 480 op/s 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 -- 172.21.15.77:0/2954849968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 msgr2=0x7ff2181021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 --2- 172.21.15.77:0/2954849968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2181021c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff208009900 tx=0x7ff20802a410 comp rx=0 tx=0).stop 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 -- 172.21.15.77:0/2954849968 shutdown_connections 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 --2- 172.21.15.77:0/2954849968 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff21810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 --2- 172.21.15.77:0/2954849968 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff2181067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 --2- 172.21.15.77:0/2954849968 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2181021c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 -- 172.21.15.77:0/2954849968 >> 172.21.15.77:0/2954849968 conn(0x7ff2180fd8c0 msgr2=0x7ff2180ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 -- 172.21.15.77:0/2954849968 shutdown_connections 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.081+0000 7ff21d36e640 1 -- 172.21.15.77:0/2954849968 wait complete. 2024-09-15T23:33:57.103 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 Processor -- start 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 -- start start 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff218074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff218074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111f90 con 0x7ff218101de0 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff218111e10 con 0x7ff218106f10 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff21d36e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff218112110 con 0x7ff218102790 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42200/0 (socket says 172.21.15.77:42200) 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 -- 172.21.15.77:0/3810803777 learned_addr learned my addr 172.21.15.77:0/3810803777 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff2177fe640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff218074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff20ffff640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff218074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:57.104 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 -- 172.21.15.77:0/3810803777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 msgr2=0x7ff218074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff218074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 -- 172.21.15.77:0/3810803777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 msgr2=0x7ff218074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff218074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff216ffd640 1 -- 172.21.15.77:0/3810803777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2181a6950 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff2177fe640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff218074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.082+0000 7ff20ffff640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff218074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff216ffd640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff208006010 tx=0x7ff2080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20803f030 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff208003ce0 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2181a6be0 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208035070 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.083+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2181a70c0 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.084+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2181021c0 con 0x7ff218101de0 2024-09-15T23:33:57.105 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.085+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff208042030 con 0x7ff218101de0 2024-09-15T23:33:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.085+0000 7ff214ff9640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 0x7ff2040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.086+0000 7ff20ffff640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 0x7ff2040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.086+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7ff2080f0260 con 0x7ff218101de0 2024-09-15T23:33:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.086+0000 7ff20ffff640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 0x7ff2040a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff200006fd0 tx=0x7ff200008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:57.106 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.090+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7ff2080bccb0 con 0x7ff218101de0 2024-09-15T23:33:57.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:56 smithi159 ceph-mon[35472]: pgmap v421: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 827 MiB/s wr, 480 op/s 2024-09-15T23:33:57.292 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.291+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff218109b60 con 0x7ff218101de0 2024-09-15T23:33:57.293 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.291+0000 7ff214ff9640 1 -- 172.21.15.77:0/3810803777 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7ff2080bc5b0 con 0x7ff218101de0 2024-09-15T23:33:57.293 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:33:57.294 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:33:57.294 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:33:57.295 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 msgr2=0x7ff2040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 0x7ff2040a5700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff200006fd0 tx=0x7ff200008040 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 msgr2=0x7ff2180744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff208006010 tx=0x7ff2080042f0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 shutdown_connections 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7ff2040a3240 0x7ff2040a5700 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff218106f10 0x7ff218074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff218102790 0x7ff218074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 --2- 172.21.15.77:0/3810803777 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7ff218101de0 0x7ff2180744f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:57.296 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 >> 172.21.15.77:0/3810803777 conn(0x7ff2180fd8c0 msgr2=0x7ff2180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:57.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 shutdown_connections 2024-09-15T23:33:57.297 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:57.294+0000 7ff21d36e640 1 -- 172.21.15.77:0/3810803777 wait complete. 2024-09-15T23:33:57.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:56 smithi155 ceph-mon[35631]: pgmap v421: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 493 KiB/s rd, 827 MiB/s wr, 480 op/s 2024-09-15T23:33:57.991 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:33:58.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:57 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3810803777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:58.241 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:33:58.363 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:57 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3810803777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:58.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:57 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3810803777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:33:58.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- 172.21.15.77:0/2373734903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 msgr2=0x7f01f8104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 --2- 172.21.15.77:0/2373734903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f8104e80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009ca0 tx=0x7f01ec02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- 172.21.15.77:0/2373734903 shutdown_connections 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 --2- 172.21.15.77:0/2373734903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f81055b0 0x7f01f810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 --2- 172.21.15.77:0/2373734903 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f8104e80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 --2- 172.21.15.77:0/2373734903 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f8100480 0x7f01f8100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- 172.21.15.77:0/2373734903 >> 172.21.15.77:0/2373734903 conn(0x7f01f8077210 msgr2=0x7f01f80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- 172.21.15.77:0/2373734903 shutdown_connections 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- 172.21.15.77:0/2373734903 wait complete. 2024-09-15T23:33:58.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 Processor -- start 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.826+0000 7f01fcd35640 1 -- start start 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 0x7f01f8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f81055b0 0x7f01f819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01f810fd90 con 0x7f01f8100e30 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01f810fc10 con 0x7f01f8100480 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01fcd35640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01f810ff10 con 0x7f01f81055b0 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42214/0 (socket says 172.21.15.77:42214) 2024-09-15T23:33:58.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 -- 172.21.15.77:0/3598539008 learned_addr learned my addr 172.21.15.77:0/3598539008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f659c640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 0x7f01f8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f81055b0 0x7f01f819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 -- 172.21.15.77:0/3598539008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f81055b0 msgr2=0x7f01f819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f81055b0 0x7f01f819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 -- 172.21.15.77:0/3598539008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 msgr2=0x7f01f8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 0x7f01f8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 -- 172.21.15.77:0/3598539008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f819d430 con 0x7f01f8100e30 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f659c640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 0x7f01f8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:33:58.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02ade0 tx=0x7f01ec0319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.827+0000 7f01e77fe640 1 -- 172.21.15.77:0/3598539008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec02fa20 con 0x7f01f8100e30 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.828+0000 7f01e77fe640 1 -- 172.21.15.77:0/3598539008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec02fbc0 con 0x7f01f8100e30 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.828+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f819d6c0 con 0x7f01f8100e30 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.828+0000 7f01e77fe640 1 -- 172.21.15.77:0/3598539008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0467b0 con 0x7f01f8100e30 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.828+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f81a5000 con 0x7f01f8100e30 2024-09-15T23:33:58.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.830+0000 7f01e77fe640 1 -- 172.21.15.77:0/3598539008 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f01ec046950 con 0x7f01f8100e30 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.830+0000 7f01ff10e740 1 Processor -- start 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.830+0000 7f01ff10e740 1 -- start start 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad670090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad670a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55acad5d62f0 con 0x55acad67b370 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55acad57dcf0 con 0x55acad671b40 2024-09-15T23:33:58.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01ff10e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55acad5d22b0 con 0x55acad6705d0 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01e77fe640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42224/0 (socket says 172.21.15.77:42224) 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1542273914 learned_addr learned my addr 172.21.15.77:0/1542273914 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f659c640 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad670a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad670090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01e77fe640 1 -- 172.21.15.77:0/3598539008 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f01ec0f1100 con 0x7f01f8100e30 2024-09-15T23:33:58.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1542273914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 msgr2=0x55acad670a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad670a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1542273914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 msgr2=0x55acad670090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad670090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1542273914 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acad5623a0 con 0x55acad67b370 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ee870 tx=0x7f01ec04a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7aabc6775e01c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.831+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 0x7f01e00a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b690 tx=0x7f01f000bb10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01e4ff9640 1 -- 172.21.15.77:0/1542273914 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0bd420 con 0x55acad67b370 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01e4ff9640 1 -- 172.21.15.77:0/1542273914 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec036070 con 0x55acad67b370 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01e4ff9640 1 -- 172.21.15.77:0/1542273914 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0be3f0 con 0x55acad67b370 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 -- 172.21.15.77:0/1542273914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 msgr2=0x55acad67d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0ee870 tx=0x7f01ec04a000 comp rx=0 tx=0).stop 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 -- 172.21.15.77:0/1542273914 shutdown_connections 2024-09-15T23:33:58.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad67d760 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad670a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1542273914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad670090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 -- 172.21.15.77:0/1542273914 >> 172.21.15.77:0/1542273914 conn(0x55acad639310 msgr2=0x55acad66cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 -- 172.21.15.77:0/1542273914 shutdown_connections 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.832+0000 7f01ff10e740 1 -- 172.21.15.77:0/1542273914 wait complete. 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 -- start start 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 Processor -- start 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad6705d0 0x55acad678140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad671b40 0x55acad678680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55acad5d62f0 con 0x55acad67b370 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55acad591060 con 0x55acad6705d0 2024-09-15T23:33:58.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55acad67de30 con 0x55acad671b40 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01ff10e740 10 client.0 _ll_register_callbacks cb 0x55acad2e48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42236/0 (socket says 172.21.15.77:42236) 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 -- 172.21.15.77:0/2983512830 learned_addr learned my addr 172.21.15.77:0/2983512830 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f659c640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad6705d0 0x55acad678140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad671b40 0x55acad678680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 -- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad671b40 msgr2=0x55acad678680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad671b40 0x55acad678680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 -- 172.21.15.77:0/2983512830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad6705d0 msgr2=0x55acad678140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.833+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad6705d0 0x55acad678140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01f6d9d640 1 -- 172.21.15.77:0/2983512830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acad3473c0 con 0x55acad67b370 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f01f000bdf0 tx=0x7f01f000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be023a5d9085c944 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:58.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01f000f930 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f01f000fad0 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01ec036070 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01f000fcd0 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 10 client.15774 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55acad6897c0 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec036070 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01f000b040 con 0x55acad67b370 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 10 client.15774 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 10 client.15774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 20 client.15774 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad68acd0 0x55acad68d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 4 client.15774 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.834+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acad5e3860 con 0x55acad68acd0 2024-09-15T23:33:58.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.835+0000 7f01f659c640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad68acd0 0x55acad68d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.835+0000 7f01f659c640 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad68acd0 0x55acad68d0e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843457d78016fdf2 server_cookie=b9eb50f1a87407da in_seq=0 out_seq=0 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.835+0000 7f01ddffb640 10 client.15774 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ddffb640 1 -- 172.21.15.77:0/2983512830 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55acad5e3860 con 0x55acad68acd0 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ddffb640 10 client.15774 handle_command_reply: tid=0 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 client.15774 shutdown 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 msgr2=0x55acad678bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f01f000bdf0 tx=0x7f01f000b3e0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 shutdown_connections 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad68acd0 0x55acad68d0e0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad67b370 0x55acad678bc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.856 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad671b40 0x55acad678680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ddffb640 0 client.15774 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 --2- 172.21.15.77:0/2983512830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad6705d0 0x55acad678140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 >> 172.21.15.77:0/2983512830 conn(0x55acad639310 msgr2=0x55acad672990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 shutdown_connections 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 1 -- 172.21.15.77:0/2983512830 wait complete. 2024-09-15T23:33:58.857 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.836+0000 7f01ff10e740 20 client.15774 trim_cache size 0 max 16384 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 Processor -- start 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 -- start start 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad66b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad67b370 0x55acad6736c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81acc20 con 0x55acad671b40 2024-09-15T23:33:58.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81af4a0 con 0x55acad67b370 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01ff10e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81ad290 con 0x55acad6705d0 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.849+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42250/0 (socket says 172.21.15.77:42250) 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1923991045 learned_addr learned my addr 172.21.15.77:0/1923991045 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1923991045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 msgr2=0x55acad66b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad66b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1923991045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad67b370 msgr2=0x55acad6736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad67b370 0x55acad6736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 -- 172.21.15.77:0/1923991045 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acad66c390 con 0x55acad671b40 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0bd3b0 tx=0x7f01ec0f1460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbded1637391d2df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01dffff640 1 -- 172.21.15.77:0/1923991045 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0bd420 con 0x55acad671b40 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01dffff640 1 -- 172.21.15.77:0/1923991045 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec036040 con 0x55acad671b40 2024-09-15T23:33:58.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.850+0000 7f01dffff640 1 -- 172.21.15.77:0/1923991045 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec0be340 con 0x55acad671b40 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- 172.21.15.77:0/1923991045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 msgr2=0x55acad673180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0bd3b0 tx=0x7f01ec0f1460 comp rx=0 tx=0).stop 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- 172.21.15.77:0/1923991045 shutdown_connections 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad67b370 0x55acad6736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad671b40 0x55acad673180 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- 172.21.15.77:0/1923991045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad6705d0 0x55acad66b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- 172.21.15.77:0/1923991045 >> 172.21.15.77:0/1923991045 conn(0x55acad639310 msgr2=0x55acad67a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- 172.21.15.77:0/1923991045 shutdown_connections 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- 172.21.15.77:0/1923991045 wait complete. 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 -- start start 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 Processor -- start 2024-09-15T23:33:58.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad67e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.851+0000 7f01ff10e740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad67b370 0x55acad67ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81ad960 con 0x55acad6705d0 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81aedd0 con 0x55acad671b40 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01f81ae030 con 0x55acad67b370 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 10 client.0 _ll_register_callbacks cb 0x7f01f000bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42264/0 (socket says 172.21.15.77:42264) 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 -- 172.21.15.77:0/265222478 learned_addr learned my addr 172.21.15.77:0/265222478 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f6d9d640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad67b370 0x55acad67ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 -- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad67b370 msgr2=0x55acad67ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad67b370 0x55acad67ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad67e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 -- 172.21.15.77:0/265222478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 msgr2=0x55acad67e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad67e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 -- 172.21.15.77:0/265222478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acad67f350 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01f659c640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e8013b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc9a8b879a2f60d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01e8004020 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f01e80041c0 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f01ec036040 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f01e802d050 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 10 client.15780 fetch_fsmap learned FSMap version 21 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.852+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55acad6f5770 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f01ec036040 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f01e80106b0 con 0x55acad6705d0 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 10 client.15780 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:33:58.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 20 client.15780 populate_metadata read hostname 'smithi077' 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad6f5ec0 0x55acad6f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 4 client.15780 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55acad5ddd70 con 0x55acad6f5ec0 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad6f5ec0 0x55acad6f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01ddffb640 10 client.15780 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.853+0000 7f01f5d9b640 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad6f5ec0 0x55acad6f82e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4050e07e7a42a6fd server_cookie=5a82308cc87b9332 in_seq=0 out_seq=0 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ddffb640 1 -- 172.21.15.77:0/265222478 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55acad5ddd70 con 0x55acad6f5ec0 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ddffb640 10 client.15780 handle_command_reply: tid=0 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 client.15780 shutdown 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 msgr2=0x55acad6834d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f01e8005940 tx=0x7f01e8013b00 comp rx=0 tx=0).stop 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 shutdown_connections 2024-09-15T23:33:58.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55acad6f5ec0 0x55acad6f82e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55acad67b370 0x55acad67ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55acad671b40 0x55acad67e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ddffb640 0 client.15780 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 --2- 172.21.15.77:0/265222478 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55acad6705d0 0x55acad6834d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 >> 172.21.15.77:0/265222478 conn(0x55acad639310 msgr2=0x55acad6799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 shutdown_connections 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 1 -- 172.21.15.77:0/265222478 wait complete. 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.854+0000 7f01ff10e740 20 client.15780 trim_cache size 0 max 16384 2024-09-15T23:33:58.868 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 msgr2=0x7f01e00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 0x7f01e00a5780 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f01f000b690 tx=0x7f01f000bb10 comp rx=0 tx=0).stop 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 msgr2=0x7f01f81989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f01ec02ade0 tx=0x7f01ec0319f0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 shutdown_connections 2024-09-15T23:33:58.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f01e00a32c0 0x7f01e00a5780 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f81055b0 0x7f01f819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f01f8100e30 0x7f01f81989c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 --2- 172.21.15.77:0/3598539008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f01f8100480 0x7f01f8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 >> 172.21.15.77:0/3598539008 conn(0x7f01f8077210 msgr2=0x7f01f8103e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 shutdown_connections 2024-09-15T23:33:58.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:33:58.855+0000 7f01fcd35640 1 -- 172.21.15.77:0/3598539008 wait complete. 2024-09-15T23:33:59.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:33:58 smithi159 ceph-mon[35472]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 621 MiB/s wr, 215 op/s 2024-09-15T23:33:59.317 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:33:58 smithi077 ceph-mon[30968]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 621 MiB/s wr, 215 op/s 2024-09-15T23:33:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:33:58 smithi155 ceph-mon[35631]: pgmap v422: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 621 MiB/s wr, 215 op/s 2024-09-15T23:34:00.717 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:34:00.717 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.723+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1567752828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f64100a40 msgr2=0x7f7f64100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.723+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1567752828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f64100a40 0x7f7f64100e40 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009900 tx=0x7f7f5402a410 comp rx=0 tx=0).stop 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.723+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1567752828 shutdown_connections 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.723+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1567752828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f641025f0 0x7f7f64108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.724+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1567752828 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f64101c30 0x7f7f641020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.724+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1567752828 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f64100a40 0x7f7f64100e40 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.724+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1567752828 >> 172.21.15.77:0/1567752828 conn(0x7f7f640fc1e0 msgr2=0x7f7f640fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.724+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1567752828 shutdown_connections 2024-09-15T23:34:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.724+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1567752828 wait complete. 2024-09-15T23:34:00.726 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.725+0000 7f7f69eb7640 1 Processor -- start 2024-09-15T23:34:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.725+0000 7f7f69eb7640 1 -- start start 2024-09-15T23:34:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.725+0000 7f7f69eb7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64100a40 0x7f7f641a0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.725+0000 7f7f69eb7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f64101c30 0x7f7f641a3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.727 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.725+0000 7f7f69eb7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f69eb7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6410c6c0 con 0x7f7f641025f0 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f69eb7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6410c540 con 0x7f7f64101c30 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f69eb7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6410c840 con 0x7f7f64100a40 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42288/0 (socket says 172.21.15.77:42288) 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 -- 172.21.15.77:0/1980135128 learned_addr learned my addr 172.21.15.77:0/1980135128 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f637fe640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64100a40 0x7f7f641a0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 -- 172.21.15.77:0/1980135128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64100a40 msgr2=0x7f7f641a0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64100a40 0x7f7f641a0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 -- 172.21.15.77:0/1980135128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f64101c30 msgr2=0x7f7f641a3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f64101c30 0x7f7f641a3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.728 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 -- 172.21.15.77:0/1980135128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f641a5ec0 con 0x7f7f641025f0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.726+0000 7f7f63fff640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00eb10 tx=0x7f7f5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.727+0000 7f7f60ff9640 1 -- 172.21.15.77:0/1980135128 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c004b20 con 0x7f7f641025f0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.727+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f641a61b0 con 0x7f7f641025f0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.727+0000 7f7f60ff9640 1 -- 172.21.15.77:0/1980135128 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c004cc0 con 0x7f7f641025f0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.728+0000 7f7f60ff9640 1 -- 172.21.15.77:0/1980135128 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c010760 con 0x7f7f641025f0 2024-09-15T23:34:00.729 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.728+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f641a66d0 con 0x7f7f641025f0 2024-09-15T23:34:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.731+0000 7f7f6cc52740 1 Processor -- start 2024-09-15T23:34:00.732 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.731+0000 7f7f60ff9640 1 -- 172.21.15.77:0/1980135128 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f7f5c005020 con 0x7f7f641025f0 2024-09-15T23:34:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 -- start start 2024-09-15T23:34:00.733 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400f2e0 0x55c3e4013da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e4014370 0x55c3e4016830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3e3f722f0 con 0x55c3e400f2e0 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c3e3f1a270 con 0x55c3e4014370 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c3e3f6e2b0 con 0x55c3e400e9a0 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:42506/0 (socket says 172.21.15.77:42506) 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 -- 172.21.15.77:0/2398962975 learned_addr learned my addr 172.21.15.77:0/2398962975 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f637fe640 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400f2e0 0x55c3e4013da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e4014370 0x55c3e4016830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 -- 172.21.15.77:0/2398962975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e4014370 msgr2=0x55c3e4016830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e4014370 0x55c3e4016830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.734 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 -- 172.21.15.77:0/2398962975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400f2e0 msgr2=0x55c3e4013da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400f2e0 0x55c3e4013da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.732+0000 7f7f62ffd640 1 -- 172.21.15.77:0/2398962975 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e3f19340 con 0x55c3e400e9a0 2024-09-15T23:34:00.735 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f58005d00 tx=0x7f7f5800d3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2d2909e50e26278 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f49ffb640 1 -- 172.21.15.77:0/2398962975 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58011470 con 0x55c3e400e9a0 2024-09-15T23:34:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f49ffb640 1 -- 172.21.15.77:0/2398962975 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f58011af0 con 0x55c3e400e9a0 2024-09-15T23:34:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f49ffb640 1 -- 172.21.15.77:0/2398962975 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58012a90 con 0x55c3e400e9a0 2024-09-15T23:34:00.736 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f60ff9640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 0x7f7f4c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.733+0000 7f7f637fe640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 0x7f7f4c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f60ff9640 1 -- 172.21.15.77:0/1980135128 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7f5c0d0450 con 0x7f7f641025f0 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 -- 172.21.15.77:0/2398962975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 msgr2=0x55c3e400eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f637fe640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 0x7f7f4c0a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f54004770 tx=0x7f7f5400b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7f58005d00 tx=0x7f7f5800d3c0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 -- 172.21.15.77:0/2398962975 shutdown_connections 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e4014370 0x55c3e4016830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400f2e0 0x55c3e4013da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/2398962975 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e400eda0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 -- 172.21.15.77:0/2398962975 >> 172.21.15.77:0/2398962975 conn(0x55c3e400a010 msgr2=0x55c3e400a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.737 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 -- 172.21.15.77:0/2398962975 shutdown_connections 2024-09-15T23:34:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.734+0000 7f7f6cc52740 1 -- 172.21.15.77:0/2398962975 wait complete. 2024-09-15T23:34:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.735+0000 7f7f6cc52740 1 -- start start 2024-09-15T23:34:00.738 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.735+0000 7f7f6cc52740 1 Processor -- start 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.735+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400e9a0 0x55c3e4029c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.735+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 0x55c3e4031150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c3e4028350 con 0x55c3e400e9a0 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c3e3efb290 con 0x55c3e400f2e0 2024-09-15T23:34:00.741 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c3e40284d0 con 0x55c3e4014370 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f6cc52740 10 client.0 _ll_register_callbacks cb 0x55c3e3f2c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f62ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f62ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:38064/0 (socket says 172.21.15.77:38064) 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f62ffd640 1 -- 172.21.15.77:0/268861761 learned_addr learned my addr 172.21.15.77:0/268861761 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 0x55c3e4031150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f637fe640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400e9a0 0x55c3e4029c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 -- 172.21.15.77:0/268861761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 msgr2=0x55c3e402a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 -- 172.21.15.77:0/268861761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400e9a0 msgr2=0x55c3e4029c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400e9a0 0x55c3e4029c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.742 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.736+0000 7f7f63fff640 1 -- 172.21.15.77:0/268861761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e3c85210 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f63fff640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 0x55c3e4031150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0049d0 tx=0x7f7f5c09c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=effbd3e13c3b2a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c09c680 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7f5c005310 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f58011af0 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c0a0a30 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 10 client.25243 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3e3d51620 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f58011af0 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f5c09bad0 con 0x55c3e4014370 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 10 client.25243 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:00.743 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 10 client.25243 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.737+0000 7f7f6cc52740 20 client.25243 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40358d0 0x55c3e4037cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f6cc52740 4 client.25243 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3e3f7fa20 con 0x55c3e40358d0 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f637fe640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40358d0 0x55c3e4037cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f637fe640 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40358d0 0x55c3e4037cc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=461e9f68f06e1de0 server_cookie=b97c1fc02225463 in_seq=0 out_seq=0 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.738+0000 7f7f42ffd640 10 client.25243 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f42ffd640 1 -- 172.21.15.77:0/268861761 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c3e3f7fa20 con 0x55c3e40358d0 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f42ffd640 10 client.25243 handle_command_reply: tid=0 2024-09-15T23:34:00.744 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 client.25243 shutdown 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 msgr2=0x55c3e4031150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 0x55c3e4031150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0049d0 tx=0x7f7f5c09c1c0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 shutdown_connections 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40358d0 0x55c3e4037cc0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e4014370 0x55c3e4031150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/268861761 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e400e9a0 0x55c3e4029c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 >> 172.21.15.77:0/268861761 conn(0x55c3e400a010 msgr2=0x55c3e400b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f42ffd640 0 client.25243 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:00.745 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 shutdown_connections 2024-09-15T23:34:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 1 -- 172.21.15.77:0/268861761 wait complete. 2024-09-15T23:34:00.746 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.739+0000 7f7f6cc52740 20 client.25243 trim_cache size 0 max 16384 2024-09-15T23:34:00.758 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 Processor -- start 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 -- start start 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e40090b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e4031110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6419e5b0 con 0x55c3e4014370 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641a8e00 con 0x55c3e400f2e0 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641a6bf0 con 0x55c3e400e9a0 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.759 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42324/0 (socket says 172.21.15.77:42324) 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.755+0000 7f7f63fff640 1 -- 172.21.15.77:0/3701101818 learned_addr learned my addr 172.21.15.77:0/3701101818 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f637fe640 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e40090b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e4031110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 -- 172.21.15.77:0/3701101818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 msgr2=0x55c3e40090b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e40090b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 -- 172.21.15.77:0/3701101818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 msgr2=0x55c3e4031110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e4031110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 -- 172.21.15.77:0/3701101818 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3e4009e30 con 0x55c3e4014370 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c09a930 tx=0x7f7f5c09ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d122c565bf13a87f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f497fa640 1 -- 172.21.15.77:0/3701101818 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c09bfe0 con 0x55c3e4014370 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f497fa640 1 -- 172.21.15.77:0/3701101818 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c065070 con 0x55c3e4014370 2024-09-15T23:34:00.760 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.756+0000 7f7f497fa640 1 -- 172.21.15.77:0/3701101818 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c09b700 con 0x55c3e4014370 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3701101818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 msgr2=0x55c3e403c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c09a930 tx=0x7f7f5c09ab90 comp rx=0 tx=0).stop 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3701101818 shutdown_connections 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e403c5c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e4031110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3701101818 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e40090b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3701101818 >> 172.21.15.77:0/3701101818 conn(0x55c3e400a010 msgr2=0x55c3e40089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3701101818 shutdown_connections 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3701101818 wait complete. 2024-09-15T23:34:00.761 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.757+0000 7f7f6cc52740 1 -- start start 2024-09-15T23:34:00.764 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 Processor -- start 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e402ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641a72c0 con 0x55c3e4014370 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641a8730 con 0x55c3e400f2e0 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7f641a7990 con 0x55c3e400e9a0 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f6cc52740 10 client.0 _ll_register_callbacks cb 0x7f7f5c0057d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f63fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42332/0 (socket says 172.21.15.77:42332) 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f63fff640 1 -- 172.21.15.77:0/3386212504 learned_addr learned my addr 172.21.15.77:0/3386212504 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:00.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.758+0000 7f7f637fe640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e402ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 -- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 msgr2=0x55c3e402ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e402ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 -- 172.21.15.77:0/3386212504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 msgr2=0x55c3e402f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 -- 172.21.15.77:0/3386212504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3e4030760 con 0x55c3e4014370 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f62ffd640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f63fff640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c09c610 tx=0x7f7f5c005b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92213852bd6f226e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c082020 con 0x55c3e4014370 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f7f5c09b810 con 0x55c3e4014370 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f5c065070 con 0x55c3e4014370 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f7f5c09bfe0 con 0x55c3e4014370 2024-09-15T23:34:00.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f6cc52740 10 client.15798 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c3e40a0970 con 0x55c3e4014370 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f5c065070 con 0x55c3e4014370 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f7f5c085020 con 0x55c3e4014370 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.759+0000 7f7f6cc52740 10 client.15798 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f6cc52740 10 client.15798 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f6cc52740 20 client.15798 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40a11a0 0x55c3e40a35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f6cc52740 4 client.15798 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3e3f79d70 con 0x55c3e40a11a0 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f637fe640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40a11a0 0x55c3e40a35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:00.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f637fe640 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40a11a0 0x55c3e40a35c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b8a1dbda326376b server_cookie=983da1798b744153 in_seq=0 out_seq=0 2024-09-15T23:34:00.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.760+0000 7f7f42ffd640 10 client.15798 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:00.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f42ffd640 1 -- 172.21.15.77:0/3386212504 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3e3f79d70 con 0x55c3e40a11a0 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f42ffd640 10 client.15798 handle_command_reply: tid=0 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 client.15798 shutdown 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 msgr2=0x55c3e4030150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c09c610 tx=0x7f7f5c005b60 comp rx=0 tx=0).stop 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 shutdown_connections 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c3e40a11a0 0x55c3e40a35c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c3e4014370 0x55c3e4030150 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f42ffd640 0 client.15798 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c3e400f2e0 0x55c3e402f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 --2- 172.21.15.77:0/3386212504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c3e400e9a0 0x55c3e402ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 >> 172.21.15.77:0/3386212504 conn(0x55c3e400a010 msgr2=0x55c3e40089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 shutdown_connections 2024-09-15T23:34:00.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 1 -- 172.21.15.77:0/3386212504 wait complete. 2024-09-15T23:34:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.769+0000 7f7f6cc52740 20 client.15798 trim_cache size 0 max 16384 2024-09-15T23:34:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:34:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:34:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:34:00.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 msgr2=0x7f7f4c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 0x7f7f4c0a57b0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7f54004770 tx=0x7f7f5400b040 comp rx=0 tx=0).stop 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 msgr2=0x7f7f641a5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00eb10 tx=0x7f7f5c00c2d0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 shutdown_connections 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f7f4c0a32f0 0x7f7f4c0a57b0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f7f641025f0 0x7f7f641a5650 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f64101c30 0x7f7f641a3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 --2- 172.21.15.77:0/1980135128 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7f64100a40 0x7f7f641a0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 >> 172.21.15.77:0/1980135128 conn(0x7f7f640fc1e0 msgr2=0x7f7f6406a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 shutdown_connections 2024-09-15T23:34:00.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:00.770+0000 7f7f69eb7640 1 -- 172.21.15.77:0/1980135128 wait complete. 2024-09-15T23:34:00.982 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:01.103 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:00 smithi077 ceph-mon[30968]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 512 MiB/s wr, 180 op/s 2024-09-15T23:34:01.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:00 smithi159 ceph-mon[35472]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 512 MiB/s wr, 180 op/s 2024-09-15T23:34:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:00 smithi155 ceph-mon[35631]: pgmap v423: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 512 MiB/s wr, 180 op/s 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 -- 172.21.15.77:0/771904045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c10c160 msgr2=0x7f044c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 --2- 172.21.15.77:0/771904045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c10c160 0x7f044c10e600 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f0444009900 tx=0x7f044402a480 comp rx=0 tx=0).stop 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 -- 172.21.15.77:0/771904045 shutdown_connections 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 --2- 172.21.15.77:0/771904045 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c10c160 0x7f044c10e600 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 --2- 172.21.15.77:0/771904045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c103650 0x7f044c10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 --2- 172.21.15.77:0/771904045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c102d30 0x7f044c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.549+0000 7f04514d8640 1 -- 172.21.15.77:0/771904045 >> 172.21.15.77:0/771904045 conn(0x7f044c0fc790 msgr2=0x7f044c0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.550+0000 7f04514d8640 1 -- 172.21.15.77:0/771904045 shutdown_connections 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.550+0000 7f04514d8640 1 -- 172.21.15.77:0/771904045 wait complete. 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.550+0000 7f04514d8640 1 Processor -- start 2024-09-15T23:34:01.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.550+0000 7f04514d8640 1 -- start start 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 0x7f044c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 0x7f044c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f044c111f60 con 0x7f044c102d30 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f044c111de0 con 0x7f044c10c160 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1120e0 con 0x7f044c103650 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42338/0 (socket says 172.21.15.77:42338) 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 -- 172.21.15.77:0/246238608 learned_addr learned my addr 172.21.15.77:0/246238608 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044a7fc640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 0x7f044c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044b7fe640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 0x7f044c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 -- 172.21.15.77:0/246238608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 msgr2=0x7f044c100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 0x7f044c100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 -- 172.21.15.77:0/246238608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 msgr2=0x7f044c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 0x7f044c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 -- 172.21.15.77:0/246238608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044c1a68a0 con 0x7f044c102d30 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044a7fc640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 0x7f044c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044b7fe640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 0x7f044c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f044affd640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f043c00eab0 tx=0x7f043c00ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f0433fff640 1 -- 172.21.15.77:0/246238608 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c00ce40 con 0x7f044c102d30 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c1a6b90 con 0x7f044c102d30 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f0433fff640 1 -- 172.21.15.77:0/246238608 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c011950 con 0x7f044c102d30 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.551+0000 7f0433fff640 1 -- 172.21.15.77:0/246238608 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c010ae0 con 0x7f044c102d30 2024-09-15T23:34:01.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.552+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044c1a7120 con 0x7f044c102d30 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 Processor -- start 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f0433fff640 1 -- 172.21.15.77:0/246238608 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f043c011b00 con 0x7f044c102d30 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 -- start start 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x555808581f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x55580858f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5558084e7280 con 0x555808582480 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55580848eb10 con 0x555808581b60 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.554+0000 7f04538b1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5558084e3240 con 0x55580858cd40 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42340/0 (socket says 172.21.15.77:42340) 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 -- 172.21.15.77:0/2835511050 learned_addr learned my addr 172.21.15.77:0/2835511050 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044a7fc640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x55580858f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044b7fe640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x555808581f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 -- 172.21.15.77:0/2835511050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 msgr2=0x55580858f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x55580858f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 -- 172.21.15.77:0/2835511050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 msgr2=0x555808581f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x555808581f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 -- 172.21.15.77:0/2835511050 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55580849b1f0 con 0x555808582480 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044b7fe640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x555808581f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f0433fff640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 0x7f04340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044b7fe640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 0x7f04340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f044affd640 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdb30 tx=0x7f043c0d66e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf84093f6ce8fc7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.555+0000 7f0433fff640 1 -- 172.21.15.77:0/246238608 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f043c0d0480 con 0x7f044c102d30 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04317fa640 1 -- 172.21.15.77:0/2835511050 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c0989b0 con 0x555808582480 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04317fa640 1 -- 172.21.15.77:0/2835511050 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c09ce10 con 0x555808582480 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04317fa640 1 -- 172.21.15.77:0/2835511050 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c09c070 con 0x555808582480 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 -- 172.21.15.77:0/2835511050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 msgr2=0x55580858c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f044b7fe640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 0x7f04340a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0444005940 tx=0x7f04440058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdb30 tx=0x7f043c0d66e0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 -- 172.21.15.77:0/2835511050 shutdown_connections 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x55580858f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808582480 0x55580858c800 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.560 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 --2- 172.21.15.77:0/2835511050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x555808581f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 -- 172.21.15.77:0/2835511050 >> 172.21.15.77:0/2835511050 conn(0x55580857e0f0 msgr2=0x55580857e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 -- 172.21.15.77:0/2835511050 shutdown_connections 2024-09-15T23:34:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.556+0000 7f04538b1740 1 -- 172.21.15.77:0/2835511050 wait complete. 2024-09-15T23:34:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 -- start start 2024-09-15T23:34:01.561 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 Processor -- start 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x55580858a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 0x55580858a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55580858f910 con 0x555808581b60 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5558084a1f10 con 0x55580858cd40 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55580858fa90 con 0x555808582480 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f04538b1740 10 client.0 _ll_register_callbacks cb 0x55580846aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42346/0 (socket says 172.21.15.77:42346) 2024-09-15T23:34:01.564 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f044affd640 1 -- 172.21.15.77:0/549779460 learned_addr learned my addr 172.21.15.77:0/549779460 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f044b7fe640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 0x55580858a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.557+0000 7f044a7fc640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x55580858a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 -- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 msgr2=0x55580858a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x55580858a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 -- 172.21.15.77:0/549779460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 msgr2=0x55580858a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 0x55580858a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 -- 172.21.15.77:0/549779460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558082586a0 con 0x555808581b60 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044b7fe640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 0x55580858a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f044affd640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdf60 tx=0x7f043c009280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b977da27f3e618 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c0b5060 con 0x555808581b60 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f043c0d01b0 con 0x555808581b60 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f043c09ce10 con 0x555808581b60 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f043c09c250 con 0x555808581b60 2024-09-15T23:34:01.565 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 10 client.15810 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55580858f910 con 0x555808581b60 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f043c09ce10 con 0x555808581b60 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f043c0b7ce0 con 0x555808581b60 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 10 client.15810 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 10 client.15810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 20 client.15810 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x55580859ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 4 client.15810 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.558+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558084f47f0 con 0x55580859c630 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.559+0000 7f044a7fc640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x55580859ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.559+0000 7f042eff5640 10 client.15810 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.559+0000 7f044a7fc640 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x55580859ea20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd35b29b2bef0951 server_cookie=f8218dbde53f0394 in_seq=0 out_seq=0 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f042eff5640 1 -- 172.21.15.77:0/549779460 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5558084f47f0 con 0x55580859c630 2024-09-15T23:34:01.566 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f042eff5640 10 client.15810 handle_command_reply: tid=0 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 client.15810 shutdown 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 msgr2=0x555808589b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdf60 tx=0x7f043c009280 comp rx=0 tx=0).stop 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 shutdown_connections 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x55580859ea20 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55580858cd40 0x55580858a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f042eff5640 0 client.15810 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x55580858a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 --2- 172.21.15.77:0/549779460 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808589b80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 >> 172.21.15.77:0/549779460 conn(0x55580857e0f0 msgr2=0x555808583e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 shutdown_connections 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 1 -- 172.21.15.77:0/549779460 wait complete. 2024-09-15T23:34:01.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.560+0000 7f04538b1740 20 client.15810 trim_cache size 0 max 16384 2024-09-15T23:34:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 Processor -- start 2024-09-15T23:34:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 -- start start 2024-09-15T23:34:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x55580858a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x5558085a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1aeed0 con 0x55580858cd40 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1b1750 con 0x555808581b60 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f04538b1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1af540 con 0x555808582480 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f044b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42354/0 (socket says 172.21.15.77:42354) 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.577+0000 7f044b7fe640 1 -- 172.21.15.77:0/3597961857 learned_addr learned my addr 172.21.15.77:0/3597961857 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044a7fc640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x5558085a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044affd640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x55580858a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 -- 172.21.15.77:0/3597961857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 msgr2=0x5558085a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x5558085a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 -- 172.21.15.77:0/3597961857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 msgr2=0x55580858a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x55580858a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 -- 172.21.15.77:0/3597961857 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558085822b0 con 0x55580858cd40 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044affd640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x55580858a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044a7fc640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x5558085a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f044b7fe640 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f04440318c0 tx=0x7f044403d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4221805ec260c13f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f0430ff9640 1 -- 172.21.15.77:0/3597961857 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444035050 con 0x55580858cd40 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f0430ff9640 1 -- 172.21.15.77:0/3597961857 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0444005520 con 0x55580858cd40 2024-09-15T23:34:01.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.578+0000 7f0430ff9640 1 -- 172.21.15.77:0/3597961857 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0444003850 con 0x55580858cd40 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- 172.21.15.77:0/3597961857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 msgr2=0x5558085a46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f04440318c0 tx=0x7f044403d000 comp rx=0 tx=0).stop 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- 172.21.15.77:0/3597961857 shutdown_connections 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55580858cd40 0x5558085a46a0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555808582480 0x5558085a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- 172.21.15.77:0/3597961857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808581b60 0x55580858a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- 172.21.15.77:0/3597961857 >> 172.21.15.77:0/3597961857 conn(0x55580857e0f0 msgr2=0x55580857d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- 172.21.15.77:0/3597961857 shutdown_connections 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- 172.21.15.77:0/3597961857 wait complete. 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- start start 2024-09-15T23:34:01.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 Processor -- start 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808582480 0x5558085911d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x555808591710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1afc10 con 0x555808581b60 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1b1080 con 0x555808582480 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f044c1b02e0 con 0x55580858cd40 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f04538b1740 10 client.0 _ll_register_callbacks cb 0x7f044c06b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.579+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42356/0 (socket says 172.21.15.77:42356) 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 -- 172.21.15.77:0/2012426469 learned_addr learned my addr 172.21.15.77:0/2012426469 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044a7fc640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808582480 0x5558085911d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044b7fe640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x555808591710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 -- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 msgr2=0x555808591710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x555808591710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 -- 172.21.15.77:0/2012426469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808582480 msgr2=0x5558085911d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808582480 0x5558085911d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 -- 172.21.15.77:0/2012426469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555808606380 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044b7fe640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x555808591710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f044affd640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f043c00c700 tx=0x7f043c09ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69bbb36f9d511fe server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f042eff5640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f043c09c4e0 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f043c010c80 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0444005520 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f043c010ec0 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f04538b1740 10 client.15816 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5558086075f0 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.580+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0444005520 con 0x555808581b60 2024-09-15T23:34:01.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f043c00f040 con 0x555808581b60 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 10 client.15816 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 20 client.15816 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x555808609ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 4 client.15816 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5558084eed00 con 0x55580859c630 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f044a7fc640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x555808609ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f044a7fc640 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x555808609ae0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c19fc7c0bf52f5 server_cookie=1ee3e1578a33659 in_seq=0 out_seq=0 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.581+0000 7f042eff5640 10 client.15816 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.582+0000 7f042eff5640 1 -- 172.21.15.77:0/2012426469 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5558084eed00 con 0x55580859c630 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.582+0000 7f042eff5640 10 client.15816 handle_command_reply: tid=0 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.582+0000 7f04538b1740 1 client.15816 shutdown 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.582+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 msgr2=0x555808590c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.582+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f043c00c700 tx=0x7f043c09ac20 comp rx=0 tx=0).stop 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 shutdown_connections 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55580859c630 0x555808609ae0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55580858cd40 0x555808591710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555808582480 0x5558085911d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f042eff5640 0 client.15816 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 --2- 172.21.15.77:0/2012426469 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555808581b60 0x555808590c90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 >> 172.21.15.77:0/2012426469 conn(0x55580857e0f0 msgr2=0x55580857ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 shutdown_connections 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 1 -- 172.21.15.77:0/2012426469 wait complete. 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04538b1740 20 client.15816 trim_cache size 0 max 16384 2024-09-15T23:34:01.589 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:34:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "e75c9233-ee26-4fb3-9b93-5de342afcd27", 2024-09-15T23:34:01.590 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:34:01.590 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:01.590 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 msgr2=0x7f04340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 0x7f04340a5700 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0444005940 tx=0x7f04440058b0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 msgr2=0x7f044c100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f043c00eab0 tx=0x7f043c00ef70 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 shutdown_connections 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f04340a3240 0x7f04340a5700 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f044c10c160 0x7f044c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044c103650 0x7f044c100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 --2- 172.21.15.77:0/246238608 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f044c102d30 0x7f044c100990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 >> 172.21.15.77:0/246238608 conn(0x7f044c0fc790 msgr2=0x7f044c0fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.583+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 shutdown_connections 2024-09-15T23:34:01.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:01.584+0000 7f04514d8640 1 -- 172.21.15.77:0/246238608 wait complete. 2024-09-15T23:34:02.291 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:34:02.578 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 379 MiB/s wr, 145 op/s 2024-09-15T23:34:03.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:02 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:34:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 -- 172.21.15.77:0/2616550717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 msgr2=0x7f72b810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 --2- 172.21.15.77:0/2616550717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b810da40 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009ca0 tx=0x7f72b002a950 comp rx=0 tx=0).stop 2024-09-15T23:34:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 -- 172.21.15.77:0/2616550717 shutdown_connections 2024-09-15T23:34:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 --2- 172.21.15.77:0/2616550717 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b810da40 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 --2- 172.21.15.77:0/2616550717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 0x7f72b81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 --2- 172.21.15.77:0/2616550717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 -- 172.21.15.77:0/2616550717 >> 172.21.15.77:0/2616550717 conn(0x7f72b80fc7d0 msgr2=0x7f72b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 -- 172.21.15.77:0/2616550717 shutdown_connections 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.155+0000 7f72bf346640 1 -- 172.21.15.77:0/2616550717 wait complete. 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 Processor -- start 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 -- start start 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b81984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 0x7f72b81989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.219 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.219 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:34:03.220 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.220 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:34:03.220 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.220 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 379 MiB/s wr, 145 op/s 2024-09-15T23:34:03.220 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:02 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:34:03.220 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81120a0 con 0x7f72b8102ef0 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8111f20 con 0x7f72b8100e20 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bf346640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72b8112220 con 0x7f72b8102570 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bd8e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bd8e3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42370/0 (socket says 172.21.15.77:42370) 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bd8e3640 1 -- 172.21.15.77:0/101403238 learned_addr learned my addr 172.21.15.77:0/101403238 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.156+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 0x7f72b81989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b81984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 -- 172.21.15.77:0/101403238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 msgr2=0x7f72b81989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 0x7f72b81989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 -- 172.21.15.77:0/101403238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 msgr2=0x7f72b81984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b81984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 -- 172.21.15.77:0/101403238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b819d450 con 0x7f72b8102ef0 2024-09-15T23:34:03.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bd8e3640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006010 tx=0x7f72b002f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72ae7fc640 1 -- 172.21.15.77:0/101403238 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0034040 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72ae7fc640 1 -- 172.21.15.77:0/101403238 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b0003e00 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b819d6e0 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72ae7fc640 1 -- 172.21.15.77:0/101403238 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0045480 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.157+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b81a5020 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.160+0000 7f72ae7fc640 1 -- 172.21.15.77:0/101403238 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f72b0037020 con 0x7f72b8102ef0 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.160+0000 7f72c171f740 1 Processor -- start 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.160+0000 7f72c171f740 1 -- start start 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.160+0000 7f72c171f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba601034a0 0x55ba60103880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.160+0000 7f72c171f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba6010e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72c171f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72c171f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba600692e0 con 0x55ba6010e680 2024-09-15T23:34:03.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72c171f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ba60010ce0 con 0x55ba601034a0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72c171f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ba600652a0 con 0x55ba60103dc0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42384/0 (socket says 172.21.15.77:42384) 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1869504832 learned_addr learned my addr 172.21.15.77:0/1869504832 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba6010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba601034a0 0x55ba60103880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72ae7fc640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 0x7f72a40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1869504832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 msgr2=0x55ba6010e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba6010e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1869504832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba601034a0 msgr2=0x55ba60103880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba601034a0 0x55ba60103880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1869504832 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba5fff5440 con 0x55ba6010e680 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bd8e3640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 0x7f72a40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f72a80114f0 tx=0x7f72a800a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8fcaca5456f21f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72ae7fc640 1 -- 172.21.15.77:0/101403238 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f72b00f0e20 con 0x7f72b8102ef0 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72a37fe640 1 -- 172.21.15.77:0/1869504832 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8004220 con 0x55ba6010e680 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72a37fe640 1 -- 172.21.15.77:0/1869504832 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a80043c0 con 0x55ba6010e680 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.161+0000 7f72a37fe640 1 -- 172.21.15.77:0/1869504832 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800f690 con 0x55ba6010e680 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 -- 172.21.15.77:0/1869504832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 msgr2=0x55ba60110a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72bd8e3640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 0x7f72a40a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ee900 tx=0x7f72b008ff30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f72a80114f0 tx=0x7f72a800a6d0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 -- 172.21.15.77:0/1869504832 shutdown_connections 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba6010e680 0x55ba60110a70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba6010e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 --2- 172.21.15.77:0/1869504832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba601034a0 0x55ba60103880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 -- 172.21.15.77:0/1869504832 >> 172.21.15.77:0/1869504832 conn(0x55ba600ffa30 msgr2=0x55ba600ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 -- 172.21.15.77:0/1869504832 shutdown_connections 2024-09-15T23:34:03.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.162+0000 7f72c171f740 1 -- 172.21.15.77:0/1869504832 wait complete. 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 -- start start 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 Processor -- start 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba60103dc0 0x55ba6010b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba6010e680 0x55ba6010b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55ba60111250 con 0x55ba601034a0 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ba60024050 con 0x55ba60103dc0 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55ba601113d0 con 0x55ba6010e680 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72c171f740 10 client.0 _ll_register_callbacks cb 0x55ba60064160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42388/0 (socket says 172.21.15.77:42388) 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1464225169 learned_addr learned my addr 172.21.15.77:0/1464225169 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba60103dc0 0x55ba6010b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.225 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba6010e680 msgr2=0x55ba6010b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba6010e680 0x55ba6010b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1464225169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba60103dc0 msgr2=0x55ba6010b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba60103dc0 0x55ba6010b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.163+0000 7f72bc8e1640 1 -- 172.21.15.77:0/1464225169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5fdda3c0 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f72a800a4d0 tx=0x7f72a80045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836ba5a2131ac58 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800f690 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f72a800f830 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a80043c0 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f72a8031050 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 10 client.15828 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ba6011cc40 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a80043c0 con 0x55ba601034a0 2024-09-15T23:34:03.226 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f72a801b030 con 0x55ba601034a0 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 10 client.15828 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 20 client.15828 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba6011e0a0 0x55ba60120490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 4 client.15828 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.164+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba60076850 con 0x55ba6011e0a0 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.165+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba6011e0a0 0x55ba60120490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.165+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba6011e0a0 0x55ba60120490 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9abd9e09c2b13729 server_cookie=57d8dc6bdd7c5bed in_seq=0 out_seq=0 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.165+0000 7f72a0ff9640 10 client.15828 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72a0ff9640 1 -- 172.21.15.77:0/1464225169 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba60076850 con 0x55ba6011e0a0 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72a0ff9640 10 client.15828 handle_command_reply: tid=0 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 client.15828 shutdown 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 msgr2=0x55ba6010e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f72a800a4d0 tx=0x7f72a80045d0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 shutdown_connections 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba6011e0a0 0x55ba60120490 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba6010e680 0x55ba6010b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba60103dc0 0x55ba6010b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 --2- 172.21.15.77:0/1464225169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba601034a0 0x55ba6010e010 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72a0ff9640 0 client.15828 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 >> 172.21.15.77:0/1464225169 conn(0x55ba600ffa30 msgr2=0x55ba60105710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 shutdown_connections 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 1 -- 172.21.15.77:0/1464225169 wait complete. 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.166+0000 7f72c171f740 20 client.15828 trim_cache size 0 max 16384 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 Processor -- start 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 -- start start 2024-09-15T23:34:03.229 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:03.230 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:34:03.230 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:34:03.230 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba6010ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60125c00 0x55ba60126060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81acbf0 con 0x55ba60103dc0 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81af470 con 0x55ba6010e680 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72c171f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81ad260 con 0x55ba60125c00 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42392/0 (socket says 172.21.15.77:42392) 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 -- 172.21.15.77:0/594130202 learned_addr learned my addr 172.21.15.77:0/594130202 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:03.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 -- 172.21.15.77:0/594130202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60125c00 msgr2=0x55ba60126060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60125c00 0x55ba60126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 -- 172.21.15.77:0/594130202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 msgr2=0x55ba6010ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba6010ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.183+0000 7f72bc8e1640 1 -- 172.21.15.77:0/594130202 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6010bbb0 con 0x55ba60103dc0 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8028ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488c55d7c87f67ce server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72a2ffd640 1 -- 172.21.15.77:0/594130202 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a803a070 con 0x55ba60103dc0 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72a2ffd640 1 -- 172.21.15.77:0/594130202 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8023070 con 0x55ba60103dc0 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72a2ffd640 1 -- 172.21.15.77:0/594130202 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a800a570 con 0x55ba60103dc0 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 -- 172.21.15.77:0/594130202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 msgr2=0x55ba6011a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f72a80058c0 tx=0x7f72a8028ca0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 -- 172.21.15.77:0/594130202 shutdown_connections 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60125c00 0x55ba60126060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba6010ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 --2- 172.21.15.77:0/594130202 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60103dc0 0x55ba6011a4b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 -- 172.21.15.77:0/594130202 >> 172.21.15.77:0/594130202 conn(0x55ba600ffa30 msgr2=0x55ba6010a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 -- 172.21.15.77:0/594130202 shutdown_connections 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.184+0000 7f72c171f740 1 -- 172.21.15.77:0/594130202 wait complete. 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 -- start start 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 Processor -- start 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba60116800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba60116d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81ad930 con 0x55ba60125c00 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81aeda0 con 0x55ba6010e680 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f72b81ae000 con 0x55ba60103dc0 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72c171f740 10 client.0 _ll_register_callbacks cb 0x7f72a800aea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72bc8e1640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42396/0 (socket says 172.21.15.77:42396) 2024-09-15T23:34:03.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72bc8e1640 1 -- 172.21.15.77:0/2570107435 learned_addr learned my addr 172.21.15.77:0/2570107435 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.185+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba60116800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba60116d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 -- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 msgr2=0x55ba60116800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba60116800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 -- 172.21.15.77:0/2570107435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 msgr2=0x55ba60116d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba60116d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 -- 172.21.15.77:0/2570107435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba601082d0 con 0x55ba60125c00 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72bc8e1640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f72a8028b20 tx=0x7f72a8011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78116db3202e53cb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:03.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a803a040 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a8023070 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f72a8028670 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f72a804a050 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 10 client.15834 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55ba60188660 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a8023070 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f72a8040040 con 0x55ba60125c00 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 10 client.15834 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.186+0000 7f72c171f740 20 client.15834 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba60188c40 0x55ba6018b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72c171f740 4 client.15834 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba60070d60 con 0x55ba60188c40 2024-09-15T23:34:03.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba60188c40 0x55ba6018b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:03.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72a0ff9640 10 client.15834 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:03.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.187+0000 7f72bd0e2640 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba60188c40 0x55ba6018b060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d17ece02f2167d3f server_cookie=3fef753a8435d8f0 in_seq=0 out_seq=0 2024-09-15T23:34:03.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72a0ff9640 1 -- 172.21.15.77:0/2570107435 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ba60070d60 con 0x55ba60188c40 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72a0ff9640 10 client.15834 handle_command_reply: tid=0 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 client.15834 shutdown 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 msgr2=0x55ba60107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f72a8028b20 tx=0x7f72a8011e40 comp rx=0 tx=0).stop 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 shutdown_connections 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55ba60188c40 0x55ba6018b060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55ba60125c00 0x55ba60107ad0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba6010e680 0x55ba60116d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72a0ff9640 0 client.15834 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:03.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 --2- 172.21.15.77:0/2570107435 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55ba60103dc0 0x55ba60116800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 >> 172.21.15.77:0/2570107435 conn(0x55ba600ffa30 msgr2=0x55ba6010a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 shutdown_connections 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 1 -- 172.21.15.77:0/2570107435 wait complete. 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72c171f740 20 client.15834 trim_cache size 0 max 16384 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 msgr2=0x7f72a40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 0x7f72a40a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f72b00ee900 tx=0x7f72b008ff30 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 msgr2=0x7f72b819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f72b0006010 tx=0x7f72b002f6f0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 shutdown_connections 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f72a40a3240 0x7f72a40a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f72b8102ef0 0x7f72b819cd70 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72b8102570 0x7f72b81989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 --2- 172.21.15.77:0/101403238 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72b8100e20 0x7f72b81984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.188+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 >> 172.21.15.77:0/101403238 conn(0x7f72b80fc7d0 msgr2=0x7f72b8106810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.189+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 shutdown_connections 2024-09-15T23:34:03.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:03.189+0000 7f72bf346640 1 -- 172.21.15.77:0/101403238 wait complete. 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: pgmap v424: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 379 MiB/s wr, 145 op/s 2024-09-15T23:34:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:02 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:34:04.084 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:34:04.084 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:04.333 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:04.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.839+0000 7f9e27f17640 1 -- 172.21.15.77:0/862020193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 msgr2=0x7f9e20103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.839+0000 7f9e27f17640 1 --2- 172.21.15.77:0/862020193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20103110 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009930 tx=0x7f9e1c02a420 comp rx=0 tx=0).stop 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- 172.21.15.77:0/862020193 shutdown_connections 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- 172.21.15.77:0/862020193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e2010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- 172.21.15.77:0/862020193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 0x7f9e20107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- 172.21.15.77:0/862020193 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20103110 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- 172.21.15.77:0/862020193 >> 172.21.15.77:0/862020193 conn(0x7f9e200fc7d0 msgr2=0x7f9e200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- 172.21.15.77:0/862020193 shutdown_connections 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- 172.21.15.77:0/862020193 wait complete. 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 Processor -- start 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- start start 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:04.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 0x7f9e20100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e20101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9e201120a0 con 0x7f9e20102d30 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e20111f20 con 0x7f9e201082a0 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.840+0000 7f9e27f17640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9e20112220 con 0x7f9e201036e0 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42422/0 (socket says 172.21.15.77:42422) 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 -- 172.21.15.77:0/2919232601 learned_addr learned my addr 172.21.15.77:0/2919232601 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e254b2640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 0x7f9e20100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e264b4640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e20101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 -- 172.21.15.77:0/2919232601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 msgr2=0x7f9e20100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:04.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 0x7f9e20100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 -- 172.21.15.77:0/2919232601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 msgr2=0x7f9e20101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e20101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 -- 172.21.15.77:0/2919232601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e201a6a60 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e264b4640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e20101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e25cb3640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009230 tx=0x7f9e1c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c03f030 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e201a6cf0 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e1c003ad0 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1c035070 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.841+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e201a71c0 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.842+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e20103110 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.844+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9e1c042030 con 0x7f9e20102d30 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.845+0000 7f9e16ffd640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 0x7f9e0c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:04.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.845+0000 7f9e254b2640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 0x7f9e0c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:04.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.845+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9e1c0f0660 con 0x7f9e20102d30 2024-09-15T23:34:04.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.845+0000 7f9e254b2640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 0x7f9e0c0a5780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e20102420 tx=0x7f9e1000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:04.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:04.848+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9e1c0bcff0 con 0x7f9e20102d30 2024-09-15T23:34:05.053 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.052+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e2010a2b0 con 0x7f9e20102d30 2024-09-15T23:34:05.053 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:04 smithi077 ceph-mon[30968]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 188 MiB/s wr, 96 op/s 2024-09-15T23:34:05.054 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.053+0000 7f9e16ffd640 1 -- 172.21.15.77:0/2919232601 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f9e1c0bc8f0 con 0x7f9e20102d30 2024-09-15T23:34:05.054 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:05.054 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:05.055 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 msgr2=0x7f9e0c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 0x7f9e0c0a5780 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e20102420 tx=0x7f9e1000b410 comp rx=0 tx=0).stop 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 msgr2=0x7f9e20100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c009230 tx=0x7f9e1c004270 comp rx=0 tx=0).stop 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 shutdown_connections 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9e0c0a32c0 0x7f9e0c0a5780 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e201082a0 0x7f9e20101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e201036e0 0x7f9e20100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:05.056 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 --2- 172.21.15.77:0/2919232601 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9e20102d30 0x7f9e20100990 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:05.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 >> 172.21.15.77:0/2919232601 conn(0x7f9e200fc7d0 msgr2=0x7f9e20105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:05.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 shutdown_connections 2024-09-15T23:34:05.057 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:05.055+0000 7f9e27f17640 1 -- 172.21.15.77:0/2919232601 wait complete. 2024-09-15T23:34:05.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:04 smithi159 ceph-mon[35472]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 188 MiB/s wr, 96 op/s 2024-09-15T23:34:05.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:04 smithi155 ceph-mon[35631]: pgmap v425: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 188 MiB/s wr, 96 op/s 2024-09-15T23:34:06.137 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:34:06.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:05 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2919232601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:06.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:05 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2919232601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:06.383 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:06.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:05 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2919232601' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 -- 172.21.15.77:0/2103472267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e410c150 msgr2=0x7f91e410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 --2- 172.21.15.77:0/2103472267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e410c150 0x7f91e410e5f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009900 tx=0x7f91dc02a480 comp rx=0 tx=0).stop 2024-09-15T23:34:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 -- 172.21.15.77:0/2103472267 shutdown_connections 2024-09-15T23:34:06.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 --2- 172.21.15.77:0/2103472267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e410c150 0x7f91e410e5f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 --2- 172.21.15.77:0/2103472267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e4103640 0x7f91e410bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 --2- 172.21.15.77:0/2103472267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4102d20 0x7f91e4103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.844+0000 7f91eb43c640 1 -- 172.21.15.77:0/2103472267 >> 172.21.15.77:0/2103472267 conn(0x7f91e40fc780 msgr2=0x7f91e40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- 172.21.15.77:0/2103472267 shutdown_connections 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- 172.21.15.77:0/2103472267 wait complete. 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 Processor -- start 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- start start 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4103640 0x7f91e4198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e410c150 0x7f91e419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4111f50 con 0x7f91e4102d20 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e4111dd0 con 0x7f91e4103640 2024-09-15T23:34:06.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91eb43c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41120d0 con 0x7f91e410c150 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.845+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42446/0 (socket says 172.21.15.77:42446) 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 -- 172.21.15.77:0/980063111 learned_addr learned my addr 172.21.15.77:0/980063111 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e99d9640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e410c150 0x7f91e419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e89d7640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4103640 0x7f91e4198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 -- 172.21.15.77:0/980063111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e410c150 msgr2=0x7f91e419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e410c150 0x7f91e419cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 -- 172.21.15.77:0/980063111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4103640 msgr2=0x7f91e4198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4103640 0x7f91e4198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 -- 172.21.15.77:0/980063111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e419d2c0 con 0x7f91e4102d20 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e91d8640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f91d400cce0 tx=0x7f91d400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e27fc640 1 -- 172.21.15.77:0/980063111 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d4004b20 con 0x7f91e4102d20 2024-09-15T23:34:06.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e419d5b0 con 0x7f91e4102d20 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e27fc640 1 -- 172.21.15.77:0/980063111 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d4004cc0 con 0x7f91e4102d20 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91e27fc640 1 -- 172.21.15.77:0/980063111 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d400f7d0 con 0x7f91e4102d20 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.846+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e41a4e90 con 0x7f91e4102d20 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.848+0000 7f91e27fc640 1 -- 172.21.15.77:0/980063111 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f91d400f970 con 0x7f91e4102d20 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 Processor -- start 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 -- start start 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91e27fc640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 0x7f91cc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 0x5647302a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 0x5647302b6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56473020b2f0 con 0x5647302b4780 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5647301b2cf0 con 0x5647302a55d0 2024-09-15T23:34:06.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91ed815740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5647302072b0 con 0x5647302a6b40 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91e99d9640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 0x7f91cc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.849+0000 7f91e27fc640 1 -- 172.21.15.77:0/980063111 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f91d40cfcc0 con 0x7f91e4102d20 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e99d9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 0x5647302b6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:42670/0 (socket says 172.21.15.77:42670) 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 -- 172.21.15.77:0/3514700169 learned_addr learned my addr 172.21.15.77:0/3514700169 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e89d7640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 0x5647302a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 -- 172.21.15.77:0/3514700169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 msgr2=0x5647302a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.868 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 0x5647302a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 -- 172.21.15.77:0/3514700169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 msgr2=0x5647302b6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 0x5647302b6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 -- 172.21.15.77:0/3514700169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647301973a0 con 0x5647302a6b40 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e89d7640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 0x5647302a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e99d9640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 0x5647302b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:06.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e99d9640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 0x7f91cc0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f91dc031550 tx=0x7f91dc032cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d409bf90 tx=0x7f91d409b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8b841670ebfe79 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91cb7fe640 1 -- 172.21.15.77:0/3514700169 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d401d040 con 0x5647302a6b40 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91cb7fe640 1 -- 172.21.15.77:0/3514700169 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d409c000 con 0x5647302a6b40 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.850+0000 7f91cb7fe640 1 -- 172.21.15.77:0/3514700169 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d40b5510 con 0x5647302a6b40 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- 172.21.15.77:0/3514700169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 msgr2=0x5647302a5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91d409bf90 tx=0x7f91d409b960 comp rx=0 tx=0).stop 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- 172.21.15.77:0/3514700169 shutdown_connections 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302b4780 0x5647302b6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a55d0 0x5647302a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 --2- 172.21.15.77:0/3514700169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a6b40 0x5647302a5090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- 172.21.15.77:0/3514700169 >> 172.21.15.77:0/3514700169 conn(0x56473026e310 msgr2=0x5647302a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- 172.21.15.77:0/3514700169 shutdown_connections 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- 172.21.15.77:0/3514700169 wait complete. 2024-09-15T23:34:06.870 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.851+0000 7f91ed815740 1 -- start start 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 Processor -- start 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a55d0 0x5647302b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302b4780 0x5647302b1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5647302b7480 con 0x5647302a6b40 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5647301c6060 con 0x5647302b4780 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5647302b7600 con 0x5647302a55d0 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91ed815740 10 client.0 _ll_register_callbacks cb 0x56472ff198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42470/0 (socket says 172.21.15.77:42470) 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 -- 172.21.15.77:0/3374427299 learned_addr learned my addr 172.21.15.77:0/3374427299 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a55d0 0x5647302b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e99d9640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302b4780 0x5647302b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 -- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a55d0 msgr2=0x5647302b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a55d0 0x5647302b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 -- 172.21.15.77:0/3374427299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302b4780 msgr2=0x5647302b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302b4780 0x5647302b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.852+0000 7f91e89d7640 1 -- 172.21.15.77:0/3374427299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56472ff7c3c0 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91e89d7640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f91d8010820 tx=0x7f91d8010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a487da3a93f3ba5e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d800fc10 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d409c000 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f91d800fdb0 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f91d8024050 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 10 client.15852 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5647302c2f10 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d409c000 con 0x5647302a6b40 2024-09-15T23:34:06.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f91d800e5e0 con 0x5647302a6b40 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 10 client.15852 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 20 client.15852 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5647302c4470 0x5647302c6890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 4 client.15852 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.853+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564730218860 con 0x5647302c4470 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.854+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5647302c4470 0x5647302c6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.854+0000 7f91e91d8640 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5647302c4470 0x5647302c6890 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a53dd6c268cf3ef server_cookie=66f3781158d319c2 in_seq=0 out_seq=0 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.854+0000 7f91c8ff9640 10 client.15852 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91c8ff9640 1 -- 172.21.15.77:0/3374427299 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564730218860 con 0x5647302c4470 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91c8ff9640 10 client.15852 handle_command_reply: tid=0 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 client.15852 shutdown 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 msgr2=0x5647302b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f91d8010820 tx=0x7f91d8010c20 comp rx=0 tx=0).stop 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 shutdown_connections 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5647302c4470 0x5647302c6890 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302b4780 0x5647302b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a6b40 0x5647302b13b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91c8ff9640 0 client.15852 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 --2- 172.21.15.77:0/3374427299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302a55d0 0x5647302b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 >> 172.21.15.77:0/3374427299 conn(0x56473026e310 msgr2=0x5647302a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 shutdown_connections 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 1 -- 172.21.15.77:0/3374427299 wait complete. 2024-09-15T23:34:06.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.855+0000 7f91ed815740 20 client.15852 trim_cache size 0 max 16384 2024-09-15T23:34:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 Processor -- start 2024-09-15T23:34:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 -- start start 2024-09-15T23:34:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302c0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x56473029cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41aaa80 con 0x5647302a55d0 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41ad300 con 0x5647302a6b40 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91ed815740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41ab0f0 con 0x5647302b4780 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42486/0 (socket says 172.21.15.77:42486) 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 -- 172.21.15.77:0/944394904 learned_addr learned my addr 172.21.15.77:0/944394904 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e89d7640 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302c0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 -- 172.21.15.77:0/944394904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 msgr2=0x56473029cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x56473029cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 -- 172.21.15.77:0/944394904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 msgr2=0x5647302c0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302c0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.868+0000 7f91e91d8640 1 -- 172.21.15.77:0/944394904 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5647302a8120 con 0x5647302a55d0 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91e91d8640 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91d40989d0 tx=0x7f91d40b7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e66bda35ce6e46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91caffd640 1 -- 172.21.15.77:0/944394904 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d407f070 con 0x5647302a55d0 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91caffd640 1 -- 172.21.15.77:0/944394904 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d40b4070 con 0x5647302a55d0 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91caffd640 1 -- 172.21.15.77:0/944394904 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d401d040 con 0x5647302a55d0 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91ed815740 1 -- 172.21.15.77:0/944394904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 msgr2=0x5647302b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91ed815740 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f91d40989d0 tx=0x7f91d40b7040 comp rx=0 tx=0).stop 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91ed815740 1 -- 172.21.15.77:0/944394904 shutdown_connections 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91ed815740 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x56473029cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.869+0000 7f91ed815740 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302c0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 --2- 172.21.15.77:0/944394904 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b1380 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 -- 172.21.15.77:0/944394904 >> 172.21.15.77:0/944394904 conn(0x56473026e310 msgr2=0x5647302b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 -- 172.21.15.77:0/944394904 shutdown_connections 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 -- 172.21.15.77:0/944394904 wait complete. 2024-09-15T23:34:06.882 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 -- start start 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 Processor -- start 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.870+0000 7f91ed815740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x5647302b9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41ab7c0 con 0x5647302a55d0 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41acc30 con 0x5647302a6b40 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f91e41abe90 con 0x5647302b4780 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 10 client.0 _ll_register_callbacks cb 0x7f91d800ac10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:42490/0 (socket says 172.21.15.77:42490) 2024-09-15T23:34:06.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 -- 172.21.15.77:0/2063006264 learned_addr learned my addr 172.21.15.77:0/2063006264 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e99d9640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x5647302b9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e89d7640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 -- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 msgr2=0x5647302b9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x5647302b9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 -- 172.21.15.77:0/2063006264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 msgr2=0x5647302b8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302b8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 -- 172.21.15.77:0/2063006264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473032e310 con 0x5647302a55d0 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e89d7640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:06.884 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91e91d8640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f91d409b9a0 tx=0x7f91d40bc110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8996b725e6f08d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91c8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91d407f070 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91d40b4070 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f91d409a0a0 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f91d401d040 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 10 client.15858 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.871+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56473032f5b0 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91d40b4070 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f91d40bacb0 con 0x5647302a55d0 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 10 client.15858 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 10 client.15858 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 20 client.15858 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56473032f7e0 0x564730331bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:06.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 4 client.15858 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564730212d70 con 0x56473032f7e0 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.872+0000 7f91e89d7640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56473032f7e0 0x564730331bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91c8ff9640 10 client.15858 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91e89d7640 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56473032f7e0 0x564730331bd0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc9790e8b312186 server_cookie=730dbefacab563d1 in_seq=0 out_seq=0 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91c8ff9640 1 -- 172.21.15.77:0/2063006264 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564730212d70 con 0x56473032f7e0 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91c8ff9640 10 client.15858 handle_command_reply: tid=0 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 client.15858 shutdown 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 msgr2=0x5647302b87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f91d409b9a0 tx=0x7f91d40bc110 comp rx=0 tx=0).stop 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 shutdown_connections 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56473032f7e0 0x564730331bd0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5647302b4780 0x5647302b9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5647302a6b40 0x5647302b8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 --2- 172.21.15.77:0/2063006264 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5647302a55d0 0x5647302b87b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 >> 172.21.15.77:0/2063006264 conn(0x56473026e310 msgr2=0x5647302b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91c8ff9640 0 client.15858 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 shutdown_connections 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 1 -- 172.21.15.77:0/2063006264 wait complete. 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.873+0000 7f91ed815740 20 client.15858 trim_cache size 0 max 16384 2024-09-15T23:34:06.887 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:34:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 msgr2=0x7f91cc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 0x7f91cc0a5700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f91dc031550 tx=0x7f91dc032cc0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 msgr2=0x7f91e4198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:06.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f91d400cce0 tx=0x7f91d400a620 comp rx=0 tx=0).stop 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 shutdown_connections 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f91cc0a3240 0x7f91cc0a5700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f91e410c150 0x7f91e419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91e4103640 0x7f91e4198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 --2- 172.21.15.77:0/980063111 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f91e4102d20 0x7f91e4198310 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 >> 172.21.15.77:0/980063111 conn(0x7f91e40fc780 msgr2=0x7f91e40fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 shutdown_connections 2024-09-15T23:34:06.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:06.874+0000 7f91eb43c640 1 -- 172.21.15.77:0/980063111 wait complete. 2024-09-15T23:34:07.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:06 smithi077 ceph-mon[30968]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 183 MiB/s wr, 98 op/s 2024-09-15T23:34:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:06 smithi155 ceph-mon[35631]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 183 MiB/s wr, 98 op/s 2024-09-15T23:34:07.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:06 smithi159 ceph-mon[35472]: pgmap v426: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 183 MiB/s wr, 98 op/s 2024-09-15T23:34:08.478 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:08.663 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:34:08.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:34:08.739 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:09.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:08 smithi077 ceph-mon[30968]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 97 MiB/s wr, 29 op/s 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 -- 172.21.15.77:0/2358119039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260100a80 msgr2=0x7f9260100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 --2- 172.21.15.77:0/2358119039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260100a80 0x7f9260100ee0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9250009930 tx=0x7f925002a420 comp rx=0 tx=0).stop 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 -- 172.21.15.77:0/2358119039 shutdown_connections 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 --2- 172.21.15.77:0/2358119039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260101420 0x7f926010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 --2- 172.21.15.77:0/2358119039 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260100a80 0x7f9260100ee0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 --2- 172.21.15.77:0/2358119039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260106a80 0x7f9260106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 -- 172.21.15.77:0/2358119039 >> 172.21.15.77:0/2358119039 conn(0x7f92600fc7a0 msgr2=0x7f92600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 -- 172.21.15.77:0/2358119039 shutdown_connections 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.261+0000 7f92687aa640 1 -- 172.21.15.77:0/2358119039 wait complete. 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 Processor -- start 2024-09-15T23:34:09.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 -- start start 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 0x7f92601992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260101420 0x7f92601997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9260110e80 con 0x7f9260106a80 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9260110d00 con 0x7f9260101420 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f92687aa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9260111000 con 0x7f9260100a80 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33598/0 (socket says 172.21.15.77:33598) 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 -- 172.21.15.77:0/1464119790 learned_addr learned my addr 172.21.15.77:0/1464119790 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9265d45640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260101420 0x7f92601997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:09.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266546640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 0x7f92601992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 -- 172.21.15.77:0/1464119790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 msgr2=0x7f92601992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 0x7f92601992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 -- 172.21.15.77:0/1464119790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260101420 msgr2=0x7f92601997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.262+0000 7f9266d47640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260101420 0x7f92601997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f9266d47640 1 -- 172.21.15.77:0/1464119790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92601a4870 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f9266546640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 0x7f92601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f9266d47640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f925800cce0 tx=0x7f925800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925800f450 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f925800fad0 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92601a4a40 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258018c10 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.263+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92601a4f00 con 0x7f9260106a80 2024-09-15T23:34:09.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.264+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9260100ee0 con 0x7f9260106a80 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.265+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f925800f5f0 con 0x7f9260106a80 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.266+0000 7f92577fe640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 0x7f924c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.266+0000 7f9266546640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 0x7f924c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.266+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f92580d0330 con 0x7f9260106a80 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.266+0000 7f9266546640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 0x7f924c0a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f925c005fd0 tx=0x7f925c0094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:09.278 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.269+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9258014030 con 0x7f9260106a80 2024-09-15T23:34:09.340 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:09.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:08 smithi155 ceph-mon[35631]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 97 MiB/s wr, 29 op/s 2024-09-15T23:34:09.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:08 smithi159 ceph-mon[35472]: pgmap v427: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 97 MiB/s wr, 29 op/s 2024-09-15T23:34:09.479 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.478+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926002d7c0 con 0x7f9260106a80 2024-09-15T23:34:09.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.479+0000 7f92577fe640 1 -- 172.21.15.77:0/1464119790 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f925809cdf0 con 0x7f9260106a80 2024-09-15T23:34:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:09.481 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:09.481 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:09.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 msgr2=0x7f924c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:09.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 0x7f924c0a5700 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f925c005fd0 tx=0x7f925c0094d0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 msgr2=0x7f92601a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:09.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f925800cce0 tx=0x7f925800a620 comp rx=0 tx=0).stop 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 shutdown_connections 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f924c0a3240 0x7f924c0a5700 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9260106a80 0x7f92601a4330 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9260101420 0x7f92601997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 --2- 172.21.15.77:0/1464119790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9260100a80 0x7f92601992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 >> 172.21.15.77:0/1464119790 conn(0x7f92600fc7a0 msgr2=0x7f92600fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 shutdown_connections 2024-09-15T23:34:09.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:09.481+0000 7f92687aa640 1 -- 172.21.15.77:0/1464119790 wait complete. 2024-09-15T23:34:10.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:09 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1464119790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:10.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:09 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1464119790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:10.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:09 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1464119790' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:10.503 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db --set-id 5f350efb --release --await' 2024-09-15T23:34:10.503 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db --set-id 5f350efb --release --await 2024-09-15T23:34:11.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:10 smithi077 ceph-mon[30968]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 92 MiB/s wr, 28 op/s 2024-09-15T23:34:11.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.884+0000 7f8f67dd9640 1 -- 172.21.15.77:0/3770630190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f60109450 msgr2=0x7f8f60110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.884+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/3770630190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f60109450 0x7f8f60110250 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009900 tx=0x7f8f5c02a440 comp rx=0 tx=0).stop 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 -- 172.21.15.77:0/3770630190 shutdown_connections 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/3770630190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f6011b140 0x7f8f6011d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/3770630190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f60109830 0x7f8f60109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/3770630190 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f60109450 0x7f8f60110250 secure :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c009900 tx=0x7f8f5c02a440 comp rx=0 tx=0).stop 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 -- 172.21.15.77:0/3770630190 >> 172.21.15.77:0/3770630190 conn(0x7f8f6006e140 msgr2=0x7f8f6006e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 -- 172.21.15.77:0/3770630190 shutdown_connections 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.885+0000 7f8f67dd9640 1 -- 172.21.15.77:0/3770630190 wait complete. 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.886+0000 7f8f67dd9640 1 Processor -- start 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.886+0000 7f8f67dd9640 1 -- start start 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f60109830 0x7f8f601a7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.233 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6011b140 0x7f8f601a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f60120e30 con 0x7f8f601abdf0 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f60120cb0 con 0x7f8f6011b140 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f67dd9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8f60120fb0 con 0x7f8f60109830 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f66376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f66376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33610/0 (socket says 172.21.15.77:33610) 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.887+0000 7f8f66376640 1 -- 172.21.15.77:0/2275554036 learned_addr learned my addr 172.21.15.77:0/2275554036 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f65374640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6011b140 0x7f8f601a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f65b75640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f60109830 0x7f8f601a7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f66376640 1 -- 172.21.15.77:0/2275554036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f60109830 msgr2=0x7f8f601a7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f66376640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f60109830 0x7f8f601a7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.234 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f66376640 1 -- 172.21.15.77:0/2275554036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6011b140 msgr2=0x7f8f601a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f66376640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6011b140 0x7f8f601a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.888+0000 7f8f66376640 1 -- 172.21.15.77:0/2275554036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f601ac8b0 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.889+0000 7f8f66376640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.892+0000 7f8f56ffd640 1 -- 172.21.15.77:0/2275554036 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800cd80 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.892+0000 7f8f56ffd640 1 -- 172.21.15.77:0/2275554036 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f58005020 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.894+0000 7f8f56ffd640 1 -- 172.21.15.77:0/2275554036 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f580116d0 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.894+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f601acba0 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.894+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f601b4330 con 0x7f8f601abdf0 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.897+0000 7f8f6a1b2740 1 Processor -- start 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 -- start start 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd5ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.235 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd6ad60 0x563c6dd6d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563c6dcc5280 con 0x563c6dd604a0 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c6dc6cb10 con 0x563c6dd6ad60 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563c6dcc1240 con 0x563c6dd5fb80 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f65b75640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f65b75640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33622/0 (socket says 172.21.15.77:33622) 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f65b75640 1 -- 172.21.15.77:0/1631606346 learned_addr learned my addr 172.21.15.77:0/1631606346 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.899+0000 7f8f65374640 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd5ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65374640 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd6ad60 0x563c6dd6d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65b75640 1 -- 172.21.15.77:0/1631606346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 msgr2=0x563c6dd5ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd5ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65b75640 1 -- 172.21.15.77:0/1631606346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd6ad60 msgr2=0x563c6dd6d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.236 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd6ad60 0x563c6dd6d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.900+0000 7f8f65b75640 1 -- 172.21.15.77:0/1631606346 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6dc791f0 con 0x563c6dd604a0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.901+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c006010 tx=0x7f8f5c004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdce5f4e1883dac server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.904+0000 7f8f56ffd640 1 -- 172.21.15.77:0/2275554036 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8f58005560 con 0x7f8f601abdf0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.905+0000 7f8f4bfff640 1 -- 172.21.15.77:0/1631606346 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c040070 con 0x563c6dd604a0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.905+0000 7f8f4bfff640 1 -- 172.21.15.77:0/1631606346 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f5c004940 con 0x563c6dd604a0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.905+0000 7f8f4bfff640 1 -- 172.21.15.77:0/1631606346 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c003850 con 0x563c6dd604a0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.905+0000 7f8f56ffd640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 0x7f8f4c0a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.905+0000 7f8f56ffd640 1 -- 172.21.15.77:0/2275554036 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f8f580d0170 con 0x7f8f601abdf0 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1631606346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 msgr2=0x563c6dd6a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c006010 tx=0x7f8f5c004df0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.237 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1631606346 shutdown_connections 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd6ad60 0x563c6dd6d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd6a820 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1631606346 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd5ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.907+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1631606346 >> 172.21.15.77:0/1631606346 conn(0x563c6dd5c110 msgr2=0x563c6dd5c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.908+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1631606346 shutdown_connections 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.908+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1631606346 wait complete. 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.908+0000 7f8f65374640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 0x7f8f4c0a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.908+0000 7f8f6a1b2740 1 -- start start 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.908+0000 7f8f6a1b2740 1 Processor -- start 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd67c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dd68680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x563c6dd6d930 con 0x563c6dd6ad60 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c6dc7ff10 con 0x563c6dd5fb80 2024-09-15T23:34:11.238 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x563c6dd6dab0 con 0x563c6dd604a0 2024-09-15T23:34:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f6a1b2740 10 client.0 _ll_register_callbacks cb 0x563c6dc48a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.909+0000 7f8f65374640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 0x7f8f4c0a5720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x563c6dd5d490 tx=0x7f8f50006d50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.239 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:53516/0 (socket says 172.21.15.77:53516) 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 -- 172.21.15.77:0/2022761400 learned_addr learned my addr 172.21.15.77:0/2022761400 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f66376640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dd68680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65b75640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd67c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 -- 172.21.15.77:0/2022761400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 msgr2=0x563c6dd67c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd67c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 -- 172.21.15.77:0/2022761400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 msgr2=0x563c6dd68680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dd68680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.241 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.910+0000 7f8f65374640 1 -- 172.21.15.77:0/2022761400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6da366a0 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.911+0000 7f8f65374640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000d5c0 tx=0x7f8f5000d240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16daa9d2801c2771 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.911+0000 7f8f497fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.911+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f500155f0 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.911+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f5c004940 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.911+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f8f50015790 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8f5002f050 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 10 client.25306 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c6dd79610 con 0x563c6dd604a0 2024-09-15T23:34:11.242 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f5c004940 con 0x563c6dd604a0 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8f50016050 con 0x563c6dd604a0 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 10 client.25306 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 10 client.25306 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 20 client.25306 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dd7af30 0x563c6dd7d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 4 client.25306 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.912+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c6dcd27f0 con 0x563c6dd7af30 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.913+0000 7f8f65b75640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dd7af30 0x563c6dd7d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.913+0000 7f8f497fa640 10 client.25306 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.913+0000 7f8f65b75640 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dd7af30 0x563c6dd7d390 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb7cd008708c3fa5 server_cookie=e253b0e0bfb7bcaf in_seq=0 out_seq=0 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f497fa640 1 -- 172.21.15.77:0/2022761400 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c6dcd27f0 con 0x563c6dd7af30 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f497fa640 10 client.25306 handle_command_reply: tid=0 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 client.25306 shutdown 2024-09-15T23:34:11.243 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 msgr2=0x563c6dd68140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8f5000d5c0 tx=0x7f8f5000d240 comp rx=0 tx=0).stop 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 shutdown_connections 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dd7af30 0x563c6dd7d390 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dd68680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd604a0 0x563c6dd68140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f497fa640 0 client.25306 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/2022761400 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd67c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.914+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 >> 172.21.15.77:0/2022761400 conn(0x563c6dd5c110 msgr2=0x563c6dd5b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.915+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 shutdown_connections 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.915+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/2022761400 wait complete. 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.915+0000 7f8f6a1b2740 20 client.25306 trim_cache size 0 max 16384 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 Processor -- start 2024-09-15T23:34:11.244 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 -- start start 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd6ad60 0x563c6dd82ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601bbdd0 con 0x563c6dd604a0 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601be650 con 0x563c6dd5fb80 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f6a1b2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601bc440 con 0x563c6dd6ad60 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f65374640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f65374640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33642/0 (socket says 172.21.15.77:33642) 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.945+0000 7f8f65374640 1 -- 172.21.15.77:0/174889416 learned_addr learned my addr 172.21.15.77:0/174889416 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 -- 172.21.15.77:0/174889416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd6ad60 msgr2=0x563c6dd82ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65b75640 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd6ad60 0x563c6dd82ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 -- 172.21.15.77:0/174889416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 msgr2=0x563c6dd684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.245 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 -- 172.21.15.77:0/174889416 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c6dd5bf40 con 0x563c6dd604a0 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65b75640 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f65374640 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8f50021d10 tx=0x7f8f5000d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=782fb96ca9b02409 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.946+0000 7f8f4b7fe640 1 -- 172.21.15.77:0/174889416 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50038070 con 0x563c6dd604a0 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.947+0000 7f8f4b7fe640 1 -- 172.21.15.77:0/174889416 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f50026070 con 0x563c6dd604a0 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.947+0000 7f8f4b7fe640 1 -- 172.21.15.77:0/174889416 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f50004400 con 0x563c6dd604a0 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/174889416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 msgr2=0x563c6dd69a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f8f50021d10 tx=0x7f8f5000d770 comp rx=0 tx=0).stop 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/174889416 shutdown_connections 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd6ad60 0x563c6dd82ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd604a0 0x563c6dd69a60 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/174889416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd5fb80 0x563c6dd684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/174889416 >> 172.21.15.77:0/174889416 conn(0x563c6dd5c110 msgr2=0x563c6dd69350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/174889416 shutdown_connections 2024-09-15T23:34:11.246 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.948+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/174889416 wait complete. 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f6a1b2740 1 -- start start 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f6a1b2740 1 Processor -- start 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd6f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd604a0 0x563c6dd6f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f6a1b2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dde4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.949+0000 7f8f66376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dde4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f66376640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dde4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33648/0 (socket says 172.21.15.77:33648) 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f66376640 1 -- 172.21.15.77:0/1604502267 learned_addr learned my addr 172.21.15.77:0/1604502267 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd6f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601bcb10 con 0x563c6dd6ad60 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601bdf80 con 0x563c6dd604a0 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8f601bd1e0 con 0x563c6dd5fb80 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f6a1b2740 10 client.0 _ll_register_callbacks cb 0x7f8f50012eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:11.247 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65374640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd604a0 0x563c6dd6f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 -- 172.21.15.77:0/1604502267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd604a0 msgr2=0x563c6dd6f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd604a0 0x563c6dd6f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 -- 172.21.15.77:0/1604502267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 msgr2=0x563c6dde4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dde4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c6dde52b0 con 0x563c6dd5fb80 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f65b75640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd6f2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c02aa30 tx=0x7f8f5c02a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e9260cabdd94349 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.950+0000 7f8f497fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c040040 con 0x563c6dd5fb80 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f8f5c0052c0 con 0x563c6dd5fb80 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f50026070 con 0x563c6dd5fb80 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f8f5c05e050 con 0x563c6dd5fb80 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 10 client.25309 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:11.248 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x563c6dde6560 con 0x563c6dd5fb80 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8f5c004740 con 0x563c6dd5fb80 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f8f5c0037f0 con 0x563c6dd5fb80 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 10 client.25309 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 10 client.25309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 20 client.25309 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dde68c0 0x563c6dde8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 4 client.25309 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f8f50026070 con 0x563c6dde68c0 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.951+0000 7f8f65374640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dde68c0 0x563c6dde8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.952+0000 7f8f497fa640 10 client.25309 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.952+0000 7f8f65374640 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dde68c0 0x563c6dde8cb0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22a6835d395c3d6 server_cookie=b33904e57bff9fde in_seq=0 out_seq=0 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f497fa640 1 -- 172.21.15.77:0/1604502267 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f8f50026070 con 0x563c6dde68c0 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f497fa640 10 client.25309 handle_command_reply: tid=0 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 client.25309 shutdown 2024-09-15T23:34:11.249 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 msgr2=0x563c6dd6f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd6f2b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c02aa30 tx=0x7f8f5c02a440 comp rx=0 tx=0).stop 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 shutdown_connections 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x563c6dde68c0 0x563c6dde8cb0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "eff59480-0bda-4438-9653-83d239b22b67", 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:34:11.250 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x563c6dd6ad60 0x563c6dde4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f497fa640 0 client.25309 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c6dd604a0 0x563c6dd6f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 --2- 172.21.15.77:0/1604502267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x563c6dd5fb80 0x563c6dd6f2b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 >> 172.21.15.77:0/1604502267 conn(0x563c6dd5c110 msgr2=0x563c6dd76400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 shutdown_connections 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 1 -- 172.21.15.77:0/1604502267 wait complete. 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.953+0000 7f8f6a1b2740 20 client.25309 trim_cache size 0 max 16384 2024-09-15T23:34:11.251 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 msgr2=0x7f8f4c0a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 0x7f8f4c0a5720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x563c6dd5d490 tx=0x7f8f50006d50 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 msgr2=0x7f8f601ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9f0 tx=0x7f8f5800eeb0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 shutdown_connections 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f8f4c0a3260 0x7f8f4c0a5720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8f601abdf0 0x7f8f601ac2a0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8f6011b140 0x7f8f601a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 --2- 172.21.15.77:0/2275554036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f60109830 0x7f8f601a7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.954+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 >> 172.21.15.77:0/2275554036 conn(0x7f8f6006e140 msgr2=0x7f8f6011c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.955+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 shutdown_connections 2024-09-15T23:34:11.252 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:10.955+0000 7f8f67dd9640 1 -- 172.21.15.77:0/2275554036 wait complete. 2024-09-15T23:34:11.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:10 smithi155 ceph-mon[35631]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 92 MiB/s wr, 28 op/s 2024-09-15T23:34:11.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:10 smithi159 ceph-mon[35472]: pgmap v428: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 92 MiB/s wr, 28 op/s 2024-09-15T23:34:11.974 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:34:12.059 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:12.244 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:11 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:34:12.244 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:11 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.244 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:11 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:34:12.244 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:11 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.245 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:11 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:34:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:11 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:34:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:11 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:11 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:34:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:11 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:11 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:34:12.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:11 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:34:12.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:11 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:11 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:34:12.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:11 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:12.466 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:11 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:34:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 -- 172.21.15.77:0/3814048024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 msgr2=0x7efe58106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 --2- 172.21.15.77:0/3814048024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe58106e60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009930 tx=0x7efe4c02a420 comp rx=0 tx=0).stop 2024-09-15T23:34:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 -- 172.21.15.77:0/3814048024 shutdown_connections 2024-09-15T23:34:12.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 --2- 172.21.15.77:0/3814048024 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58101420 0x7efe5810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 --2- 172.21.15.77:0/3814048024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58100a80 0x7efe58100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 --2- 172.21.15.77:0/3814048024 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe58106e60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 -- 172.21.15.77:0/3814048024 >> 172.21.15.77:0/3814048024 conn(0x7efe580fc7a0 msgr2=0x7efe580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 -- 172.21.15.77:0/3814048024 shutdown_connections 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.581+0000 7efe5ed20640 1 -- 172.21.15.77:0/3814048024 wait complete. 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 Processor -- start 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 -- start start 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58100a80 0x7efe581973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58101420 0x7efe581978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe58110ed0 con 0x7efe58106a80 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe58110d50 con 0x7efe58101420 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.582+0000 7efe5ed20640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efe58111050 con 0x7efe58100a80 2024-09-15T23:34:12.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5cabc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58100a80 0x7efe581973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33660/0 (socket says 172.21.15.77:33660) 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 -- 172.21.15.77:0/4288540414 learned_addr learned my addr 172.21.15.77:0/4288540414 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe57fff640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58101420 0x7efe581978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 -- 172.21.15.77:0/4288540414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58100a80 msgr2=0x7efe581973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58100a80 0x7efe581973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 -- 172.21.15.77:0/4288540414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58101420 msgr2=0x7efe581978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58101420 0x7efe581978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 -- 172.21.15.77:0/4288540414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5819c360 con 0x7efe58106a80 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efe5000cad0 tx=0x7efe5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe55ffb640 1 -- 172.21.15.77:0/4288540414 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000ae20 con 0x7efe58106a80 2024-09-15T23:34:12.599 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5819c650 con 0x7efe58106a80 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe55ffb640 1 -- 172.21.15.77:0/4288540414 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe50005020 con 0x7efe58106a80 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe55ffb640 1 -- 172.21.15.77:0/4288540414 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000f6b0 con 0x7efe58106a80 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.583+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581a3f30 con 0x7efe58106a80 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.586+0000 7efe610f9740 1 Processor -- start 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.586+0000 7efe55ffb640 1 -- 172.21.15.77:0/4288540414 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efe500051d0 con 0x7efe58106a80 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.586+0000 7efe610f9740 1 -- start start 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660164f00 0x55f6601652e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f660171f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.600 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f6600ca620 con 0x55f660172450 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f660071e50 con 0x55f660164f00 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe610f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f6600c65e0 con 0x55f660165820 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33674/0 (socket says 172.21.15.77:33674) 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 -- 172.21.15.77:0/2577512327 learned_addr learned my addr 172.21.15.77:0/2577512327 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f660171f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660164f00 0x55f6601652e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 -- 172.21.15.77:0/2577512327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 msgr2=0x55f660171f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f660171f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 -- 172.21.15.77:0/2577512327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660164f00 msgr2=0x55f6601652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660164f00 0x55f6601652e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 -- 172.21.15.77:0/2577512327 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f660062d40 con 0x55f660172450 2024-09-15T23:34:12.601 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe57fff640 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe44011510 tx=0x7efe4400a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1939a89dcf4506 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe55ffb640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 0x7efe480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe42ffd640 1 -- 172.21.15.77:0/2577512327 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44005220 con 0x55f660172450 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.587+0000 7efe5cabc640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 0x7efe480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe42ffd640 1 -- 172.21.15.77:0/2577512327 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe44004c80 con 0x55f660172450 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe42ffd640 1 -- 172.21.15.77:0/2577512327 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4400fbc0 con 0x55f660172450 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe55ffb640 1 -- 172.21.15.77:0/4288540414 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7efe500cfed0 con 0x7efe58106a80 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 -- 172.21.15.77:0/2577512327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 msgr2=0x55f660174840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe5cabc640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 0x7efe480a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe4c006010 tx=0x7efe4c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe44011510 tx=0x7efe4400a750 comp rx=0 tx=0).stop 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 -- 172.21.15.77:0/2577512327 shutdown_connections 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660172450 0x55f660174840 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f660171f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 --2- 172.21.15.77:0/2577512327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660164f00 0x55f6601652e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.602 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 -- 172.21.15.77:0/2577512327 >> 172.21.15.77:0/2577512327 conn(0x55f6601615f0 msgr2=0x55f6601619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 -- 172.21.15.77:0/2577512327 shutdown_connections 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.588+0000 7efe610f9740 1 -- 172.21.15.77:0/2577512327 wait complete. 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 -- start start 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 Processor -- start 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f66016f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 0x55f66016fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f660175020 con 0x55f660164f00 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f660052f10 con 0x55f660172450 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f6601751a0 con 0x55f660165820 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe610f9740 10 client.0 _ll_register_callbacks cb 0x55f660076db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe5cabc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe5cabc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33690/0 (socket says 172.21.15.77:33690) 2024-09-15T23:34:12.603 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe5cabc640 1 -- 172.21.15.77:0/2850410769 learned_addr learned my addr 172.21.15.77:0/2850410769 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 0x55f66016fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe57fff640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f66016f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.589+0000 7efe5cabc640 1 -- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 msgr2=0x55f66016f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f66016f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5cabc640 1 -- 172.21.15.77:0/2850410769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 msgr2=0x55f66016fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 0x55f66016fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5cabc640 1 -- 172.21.15.77:0/2850410769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65fdd9580 con 0x55f660164f00 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 0x55f66016fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe57fff640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f66016f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009930 tx=0x7efe4c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f8aab897407d58 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4c04d070 con 0x55f660164f00 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7efe4c003a00 con 0x55f660164f00 2024-09-15T23:34:12.604 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe44004c80 con 0x55f660164f00 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efe4c059050 con 0x55f660164f00 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 10 client.15894 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f65fea3960 con 0x55f660164f00 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe44004c80 con 0x55f660164f00 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efe4c03c440 con 0x55f660164f00 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 10 client.15894 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 10 client.15894 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 20 client.15894 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660182060 0x55f660184520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.605 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 4 client.15894 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.590+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f6600d7b90 con 0x55f660182060 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.591+0000 7efe57fff640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660182060 0x55f660184520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.591+0000 7efe57fff640 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660182060 0x55f660184520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f9f51a3ead6508f server_cookie=d4f87d2037df37d7 in_seq=0 out_seq=0 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.591+0000 7efe37fff640 10 client.15894 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe37fff640 1 -- 172.21.15.77:0/2850410769 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f6600d7b90 con 0x55f660182060 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe37fff640 10 client.15894 handle_command_reply: tid=0 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 client.15894 shutdown 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 msgr2=0x55f66016f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009930 tx=0x7efe4c009260 comp rx=0 tx=0).stop 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 shutdown_connections 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660182060 0x55f660184520 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660172450 0x55f66016fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f660165820 0x55f66016f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 --2- 172.21.15.77:0/2850410769 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66016f410 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe37fff640 0 client.15894 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 >> 172.21.15.77:0/2850410769 conn(0x55f6601615f0 msgr2=0x55f660167350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 shutdown_connections 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 1 -- 172.21.15.77:0/2850410769 wait complete. 2024-09-15T23:34:12.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.592+0000 7efe610f9740 20 client.15894 trim_cache size 0 max 16384 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.611+0000 7efe610f9740 1 Processor -- start 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.611+0000 7efe610f9740 1 -- start start 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f660160640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f66018a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe581aab50 con 0x55f660164f00 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe581ad3d0 con 0x55f660165820 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe610f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efe581ab1c0 con 0x55f6601615f0 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33706/0 (socket says 172.21.15.77:33706) 2024-09-15T23:34:12.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 -- 172.21.15.77:0/2644886957 learned_addr learned my addr 172.21.15.77:0/2644886957 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f66018a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f660160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 -- 172.21.15.77:0/2644886957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 msgr2=0x55f660160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f660160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 -- 172.21.15.77:0/2644886957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 msgr2=0x55f66018a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f66018a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 -- 172.21.15.77:0/2644886957 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f66016d960 con 0x55f660164f00 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe5cabc640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f660160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:12.615 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.612+0000 7efe57fff640 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efe44004f50 tx=0x7efe44011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4985c58bb4c2ced6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe427fc640 1 -- 172.21.15.77:0/2644886957 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe44004660 con 0x55f660164f00 2024-09-15T23:34:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe427fc640 1 -- 172.21.15.77:0/2644886957 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe44005000 con 0x55f660164f00 2024-09-15T23:34:12.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe427fc640 1 -- 172.21.15.77:0/2644886957 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4400f9d0 con 0x55f660164f00 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 -- 172.21.15.77:0/2644886957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 msgr2=0x55f660189df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7efe44004f50 tx=0x7efe44011f90 comp rx=0 tx=0).stop 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 -- 172.21.15.77:0/2644886957 shutdown_connections 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f66018a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f660189df0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 --2- 172.21.15.77:0/2644886957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f660160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 -- 172.21.15.77:0/2644886957 >> 172.21.15.77:0/2644886957 conn(0x55f66016fff0 msgr2=0x55f66015ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.613+0000 7efe610f9740 1 -- 172.21.15.77:0/2644886957 shutdown_connections 2024-09-15T23:34:12.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 -- 172.21.15.77:0/2644886957 wait complete. 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 -- start start 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 Processor -- start 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f66017a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f660177400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efe581ab890 con 0x55f660164f00 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe581acd00 con 0x55f660165820 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efe581abf60 con 0x55f6601615f0 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe610f9740 10 client.0 _ll_register_callbacks cb 0x7efe4c004460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.614+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe57fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33714/0 (socket says 172.21.15.77:33714) 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe57fff640 1 -- 172.21.15.77:0/3207165374 learned_addr learned my addr 172.21.15.77:0/3207165374 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:12.620 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f660177400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5cabc640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f66017a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 -- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 msgr2=0x55f66017a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f66017a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 -- 172.21.15.77:0/3207165374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 msgr2=0x55f66017ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 -- 172.21.15.77:0/3207165374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f660177c00 con 0x55f660165820 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5cabc640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f66017a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe57fff640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe5d2bd640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f660177400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe500cd690 tx=0x7efe5009c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d42beacfce00173 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe37fff640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe500b5060 con 0x55f660165820 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.615+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7efe500a01b0 con 0x55f660165820 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe44005000 con 0x55f660165820 2024-09-15T23:34:12.621 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7efe5001d040 con 0x55f660165820 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 10 client.25268 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f6601ed860 con 0x55f660165820 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe44005000 con 0x55f660165820 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7efe500a4940 con 0x55f660165820 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 10 client.25268 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 10 client.25268 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 20 client.25268 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660172450 0x55f6601f0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 4 client.25268 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "5f350efb", "release": true, "await": true}] 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.616+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "set_id": "5f350efb", "release": true, "await": true}) -- 0x55f6600d20a0 con 0x55f660172450 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.617+0000 7efe5cabc640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660172450 0x55f6601f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.617+0000 7efe5cabc640 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660172450 0x55f6601f0020 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ebd7870d76adda server_cookie=a171bf7bdfe03efd in_seq=0 out_seq=0 2024-09-15T23:34:12.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.617+0000 7efe37fff640 10 client.25268 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:12.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.618+0000 7efe37fff640 1 -- 172.21.15.77:0/3207165374 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55f6600d20a0 con 0x55f660172450 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.618+0000 7efe37fff640 10 client.25268 handle_command_reply: tid=0 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.618+0000 7efe610f9740 1 client.25268 shutdown 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.619+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 msgr2=0x55f660177400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f660177400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe500cd690 tx=0x7efe5009c2d0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 shutdown_connections 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f660172450 0x55f6601f0020 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f660165820 0x55f660177400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f660164f00 0x55f66017ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe37fff640 0 client.25268 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 --2- 172.21.15.77:0/3207165374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f6601615f0 0x55f66017a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 >> 172.21.15.77:0/3207165374 conn(0x55f66016fff0 msgr2=0x55f660160750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 shutdown_connections 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 1 -- 172.21.15.77:0/3207165374 wait complete. 2024-09-15T23:34:12.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.620+0000 7efe610f9740 20 client.25268 trim_cache size 0 max 16384 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 8, 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "5f350efb": { 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 8, 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:12.625 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 139.6, 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:12.626 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 msgr2=0x7efe480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 0x7efe480a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efe4c006010 tx=0x7efe4c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 msgr2=0x7efe5819bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efe5000cad0 tx=0x7efe5000cf90 comp rx=0 tx=0).stop 2024-09-15T23:34:12.627 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 shutdown_connections 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efe480a3240 0x7efe480a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efe58106a80 0x7efe5819bc80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58101420 0x7efe581978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 --2- 172.21.15.77:0/4288540414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe58100a80 0x7efe581973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 >> 172.21.15.77:0/4288540414 conn(0x7efe580fc7a0 msgr2=0x7efe580fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 shutdown_connections 2024-09-15T23:34:12.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:12.621+0000 7efe5ed20640 1 -- 172.21.15.77:0/4288540414 wait complete. 2024-09-15T23:34:12.654 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:13.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:12 smithi155 ceph-mon[35631]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 65 MiB/s wr, 22 op/s 2024-09-15T23:34:13.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:12 smithi077 ceph-mon[30968]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 65 MiB/s wr, 22 op/s 2024-09-15T23:34:13.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:12 smithi159 ceph-mon[35472]: pgmap v429: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 65 MiB/s wr, 22 op/s 2024-09-15T23:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.947+0000 7f283312c640 1 -- 172.21.15.77:0/2620286854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c109d40 msgr2=0x7f282c1105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.947+0000 7f283312c640 1 --2- 172.21.15.77:0/2620286854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c109d40 0x7f282c1105d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f281c009900 tx=0x7f281c02a440 comp rx=0 tx=0).stop 2024-09-15T23:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.948+0000 7f283312c640 1 -- 172.21.15.77:0/2620286854 shutdown_connections 2024-09-15T23:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.948+0000 7f283312c640 1 --2- 172.21.15.77:0/2620286854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c109d40 0x7f282c1105d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.948+0000 7f283312c640 1 --2- 172.21.15.77:0/2620286854 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109380 0x7f282c109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.948+0000 7f283312c640 1 --2- 172.21.15.77:0/2620286854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c108470 0x7f282c108870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.948+0000 7f283312c640 1 -- 172.21.15.77:0/2620286854 >> 172.21.15.77:0/2620286854 conn(0x7f282c077470 msgr2=0x7f282c0798b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.956+0000 7f283312c640 1 -- 172.21.15.77:0/2620286854 shutdown_connections 2024-09-15T23:34:13.963 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.961+0000 7f283312c640 1 -- 172.21.15.77:0/2620286854 wait complete. 2024-09-15T23:34:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.963+0000 7f283312c640 1 Processor -- start 2024-09-15T23:34:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.968+0000 7f283312c640 1 -- start start 2024-09-15T23:34:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.968+0000 7f283312c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c108470 0x7f282c19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.968+0000 7f283312c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c109380 0x7f282c19ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.972 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.971+0000 7f283312c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.971+0000 7f2830ec8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c108470 0x7f282c19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.971+0000 7f283312c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f282c113f10 con 0x7f282c109d40 2024-09-15T23:34:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.971+0000 7f283312c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f282c113d90 con 0x7f282c108470 2024-09-15T23:34:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.971+0000 7f283312c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f282c114090 con 0x7f282c109380 2024-09-15T23:34:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.974+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.974+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33722/0 (socket says 172.21.15.77:33722) 2024-09-15T23:34:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.974+0000 7f28316c9640 1 -- 172.21.15.77:0/2655150000 learned_addr learned my addr 172.21.15.77:0/2655150000 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.974+0000 7f282bfff640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c109380 0x7f282c19ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:13.979 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.978+0000 7f28316c9640 1 -- 172.21.15.77:0/2655150000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c109380 msgr2=0x7f282c19ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.978+0000 7f28316c9640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c109380 0x7f282c19ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.978+0000 7f28316c9640 1 -- 172.21.15.77:0/2655150000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c108470 msgr2=0x7f282c19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.978+0000 7f28316c9640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c108470 0x7f282c19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.980 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.978+0000 7f28316c9640 1 -- 172.21.15.77:0/2655150000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1a6130 con 0x7f282c109d40 2024-09-15T23:34:13.982 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.980+0000 7f28316c9640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f281c02aa30 tx=0x7f281c032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.980+0000 7f2829ffb640 1 -- 172.21.15.77:0/2655150000 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c03f030 con 0x7f282c109d40 2024-09-15T23:34:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.980+0000 7f2829ffb640 1 -- 172.21.15.77:0/2655150000 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f281c003ce0 con 0x7f282c109d40 2024-09-15T23:34:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.980+0000 7f2829ffb640 1 -- 172.21.15.77:0/2655150000 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c035070 con 0x7f282c109d40 2024-09-15T23:34:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.981+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c1a63c0 con 0x7f282c109d40 2024-09-15T23:34:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.982+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c1a68b0 con 0x7f282c109d40 2024-09-15T23:34:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.987+0000 7f2835ebd740 1 Processor -- start 2024-09-15T23:34:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.990+0000 7f2829ffb640 1 -- 172.21.15.77:0/2655150000 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f281c042030 con 0x7f282c109d40 2024-09-15T23:34:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.991+0000 7f2835ebd740 1 -- start start 2024-09-15T23:34:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.991+0000 7f2829ffb640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 0x7f28140a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c82e0 0x55db842ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.993 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55db8422b2f0 con 0x55db842cd370 2024-09-15T23:34:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55db841d3270 con 0x55db842c79a0 2024-09-15T23:34:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2835ebd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55db842272b0 con 0x55db842c82e0 2024-09-15T23:34:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.992+0000 7f2829ffb640 1 -- 172.21.15.77:0/2655150000 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f281c0f0370 con 0x7f282c109d40 2024-09-15T23:34:13.994 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.993+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.993+0000 7f282bfff640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 0x7f28140a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.993+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33724/0 (socket says 172.21.15.77:33724) 2024-09-15T23:34:13.995 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 -- 172.21.15.77:0/4221145900 learned_addr learned my addr 172.21.15.77:0/4221145900 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 -- 172.21.15.77:0/4221145900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c82e0 msgr2=0x55db842ccda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c82e0 0x55db842ccda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 -- 172.21.15.77:0/4221145900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 msgr2=0x55db842c7da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:34:13.996 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c7da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.994+0000 7f28316c9640 1 -- 172.21.15.77:0/4221145900 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db841d2340 con 0x55db842cd370 2024-09-15T23:34:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.995+0000 7f28316c9640 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f281c0c4de0 tx=0x7f281c0bc530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf3bcd0ae15a0de server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:13.997 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:13.996+0000 7f282bfff640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 0x7f28140a5970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55db842c8d10 tx=0x7f282400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.016+0000 7f2812ffd640 1 -- 172.21.15.77:0/4221145900 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c0bc6a0 con 0x55db842cd370 2024-09-15T23:34:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.016+0000 7f2812ffd640 1 -- 172.21.15.77:0/4221145900 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f281c0c0a50 con 0x55db842cd370 2024-09-15T23:34:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.017+0000 7f2812ffd640 1 -- 172.21.15.77:0/4221145900 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c03b5f0 con 0x55db842cd370 2024-09-15T23:34:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.017+0000 7f2835ebd740 1 -- 172.21.15.77:0/4221145900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 msgr2=0x55db842cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.020 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.017+0000 7f2835ebd740 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f281c0c4de0 tx=0x7f281c0bc530 comp rx=0 tx=0).stop 2024-09-15T23:34:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.021+0000 7f2835ebd740 1 -- 172.21.15.77:0/4221145900 shutdown_connections 2024-09-15T23:34:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.021+0000 7f2835ebd740 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842cf830 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.021+0000 7f2835ebd740 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c82e0 0x55db842ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.021+0000 7f2835ebd740 1 --2- 172.21.15.77:0/4221145900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.022 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.021+0000 7f2835ebd740 1 -- 172.21.15.77:0/4221145900 >> 172.21.15.77:0/4221145900 conn(0x55db842c3010 msgr2=0x55db842c3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:14.029 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.026+0000 7f2835ebd740 1 -- 172.21.15.77:0/4221145900 shutdown_connections 2024-09-15T23:34:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.028+0000 7f2835ebd740 1 -- 172.21.15.77:0/4221145900 wait complete. 2024-09-15T23:34:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.029+0000 7f2835ebd740 1 -- start start 2024-09-15T23:34:14.030 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.029+0000 7f2835ebd740 1 Processor -- start 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55db8422b2f0 con 0x55db842cd370 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55db841b4290 con 0x55db842c82e0 2024-09-15T23:34:14.032 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55db842d0100 con 0x55db842c79a0 2024-09-15T23:34:14.033 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.030+0000 7f2835ebd740 10 client.0 _ll_register_callbacks cb 0x55db841e5140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.033+0000 7f282bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.033+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.033+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33740/0 (socket says 172.21.15.77:33740) 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.033+0000 7f28316c9640 1 -- 172.21.15.77:0/1529133681 learned_addr learned my addr 172.21.15.77:0/1529133681 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.033+0000 7f2830ec8640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 -- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 msgr2=0x55db842d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 -- 172.21.15.77:0/1529133681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 msgr2=0x55db842d1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 -- 172.21.15.77:0/1529133681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db83f3e210 con 0x55db842cd370 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f28316c9640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f281c004650 tx=0x7f281c0bc5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d4dd8e6ae9609d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:14.037 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.034+0000 7f280bfff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.036+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c0d9070 con 0x55db842cd370 2024-09-15T23:34:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.036+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f281c0b8d10 con 0x55db842cd370 2024-09-15T23:34:14.038 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.036+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f281c0c0a50 con 0x55db842cd370 2024-09-15T23:34:14.047 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.046+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f281c0c5310 con 0x55db842cd370 2024-09-15T23:34:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.048+0000 7f2835ebd740 10 client.15909 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:14.050 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.049+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db8400a620 con 0x55db842cd370 2024-09-15T23:34:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.052+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f281c0c0a50 con 0x55db842cd370 2024-09-15T23:34:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.053+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f281c04c060 con 0x55db842cd370 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 10 client.15909 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 10 client.15909 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 20 client.15909 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db842ee3f0 0x55db842f0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 4 client.15909 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.055+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db84238a20 con 0x55db842ee3f0 2024-09-15T23:34:14.059 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.058+0000 7f2830ec8640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db842ee3f0 0x55db842f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.063+0000 7f2830ec8640 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db842ee3f0 0x55db842f0850 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b87e4a69f49fb94 server_cookie=b4367750f6cfb675 in_seq=0 out_seq=0 2024-09-15T23:34:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.063+0000 7f280bfff640 10 client.15909 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.066+0000 7f280bfff640 1 -- 172.21.15.77:0/1529133681 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db84238a20 con 0x55db842ee3f0 2024-09-15T23:34:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.066+0000 7f280bfff640 10 client.15909 handle_command_reply: tid=0 2024-09-15T23:34:14.067 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.066+0000 7f2835ebd740 1 client.15909 shutdown 2024-09-15T23:34:14.070 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 msgr2=0x55db842d8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f281c004650 tx=0x7f281c0bc5a0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 shutdown_connections 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db842ee3f0 0x55db842f0850 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d8dc0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 --2- 172.21.15.77:0/1529133681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.069+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 >> 172.21.15.77:0/1529133681 conn(0x55db842c3010 msgr2=0x55db842c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.070+0000 7f280bfff640 0 client.15909 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:14.071 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.070+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 shutdown_connections 2024-09-15T23:34:14.072 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.071+0000 7f2835ebd740 1 -- 172.21.15.77:0/1529133681 wait complete. 2024-09-15T23:34:14.075 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.074+0000 7f2835ebd740 20 client.15909 trim_cache size 0 max 16384 2024-09-15T23:34:14.111 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f2835ebd740 1 Processor -- start 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f2835ebd740 1 -- start start 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842cd370 0x55db842c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.109+0000 7f282bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33756/0 (socket says 172.21.15.77:33756) 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 -- 172.21.15.77:0/2432685906 learned_addr learned my addr 172.21.15.77:0/2432685906 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f282c073ef0 con 0x55db842c82e0 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1a8f20 con 0x55db842c79a0 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1a6d10 con 0x55db842cd370 2024-09-15T23:34:14.112 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f2830ec8640 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f28316c9640 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842cd370 0x55db842c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 -- 172.21.15.77:0/2432685906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842cd370 msgr2=0x55db842c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842cd370 0x55db842c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 -- 172.21.15.77:0/2432685906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 msgr2=0x55db842c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 -- 172.21.15.77:0/2432685906 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db842cc860 con 0x55db842c82e0 2024-09-15T23:34:14.113 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.110+0000 7f282bfff640 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2824016760 tx=0x7f2824015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169ab2dfb240ad97 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.127+0000 7f28127fc640 1 -- 172.21.15.77:0/2432685906 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824015a00 con 0x55db842c82e0 2024-09-15T23:34:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.127+0000 7f28127fc640 1 -- 172.21.15.77:0/2432685906 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2824026070 con 0x55db842c82e0 2024-09-15T23:34:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.127+0000 7f28127fc640 1 -- 172.21.15.77:0/2432685906 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28240203c0 con 0x55db842c82e0 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 msgr2=0x55db842d8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2824016760 tx=0x7f2824015000 comp rx=0 tx=0).stop 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 shutdown_connections 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842cd370 0x55db842c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842c82e0 0x55db842d8d80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 --2- 172.21.15.77:0/2432685906 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c79a0 0x55db842c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 >> 172.21.15.77:0/2432685906 conn(0x55db842c3010 msgr2=0x55db842c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 shutdown_connections 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.128+0000 7f2835ebd740 1 -- 172.21.15.77:0/2432685906 wait complete. 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 -- start start 2024-09-15T23:34:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 Processor -- start 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1a73e0 con 0x55db842cd370 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1a8850 con 0x55db842c82e0 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f282c1a7ab0 con 0x55db842c79a0 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f2835ebd740 10 client.0 _ll_register_callbacks cb 0x7f281c0b8940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.129+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33764/0 (socket says 172.21.15.77:33764) 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 -- 172.21.15.77:0/3249591716 learned_addr learned my addr 172.21.15.77:0/3249591716 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:14.134 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f2830ec8640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f282bfff640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 -- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 msgr2=0x55db842d61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 -- 172.21.15.77:0/3249591716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 msgr2=0x55db842d66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 -- 172.21.15.77:0/3249591716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db842d7ca0 con 0x55db842cd370 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f28316c9640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f281c0bc630 tx=0x7f281c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4954010a2ed1bcb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f280bfff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c0d9040 con 0x55db842cd370 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f281c03b5f0 con 0x55db842cd370 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2824026070 con 0x55db842cd370 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f281c0baa10 con 0x55db842cd370 2024-09-15T23:34:14.135 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f2835ebd740 10 client.15915 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.130+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55db842d7ca0 con 0x55db842cd370 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2824026070 con 0x55db842cd370 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f281c02ac60 con 0x55db842cd370 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 10 client.15915 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 10 client.15915 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 20 client.15915 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db84359300 0x55db8435b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 4 client.15915 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55db842c90b0 con 0x55db84359300 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.131+0000 7f2830ec8640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db84359300 0x55db8435b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.132+0000 7f280bfff640 10 client.15915 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:14.136 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.132+0000 7f2830ec8640 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db84359300 0x55db8435b6f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=851c1a01db709d03 server_cookie=d046b5c063757146 in_seq=0 out_seq=0 2024-09-15T23:34:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f280bfff640 1 -- 172.21.15.77:0/3249591716 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55db842c90b0 con 0x55db84359300 2024-09-15T23:34:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f280bfff640 10 client.15915 handle_command_reply: tid=0 2024-09-15T23:34:14.312 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 client.15915 shutdown 2024-09-15T23:34:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 msgr2=0x55db842d7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f281c0bc630 tx=0x7f281c009260 comp rx=0 tx=0).stop 2024-09-15T23:34:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 shutdown_connections 2024-09-15T23:34:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55db84359300 0x55db8435b6f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.313 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55db842cd370 0x55db842d7690 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db842c82e0 0x55db842d66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 --2- 172.21.15.77:0/3249591716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55db842c79a0 0x55db842d61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f280bfff640 0 client.15915 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 >> 172.21.15.77:0/3249591716 conn(0x55db842c3010 msgr2=0x55db842c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 shutdown_connections 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.311+0000 7f2835ebd740 1 -- 172.21.15.77:0/3249591716 wait complete. 2024-09-15T23:34:14.314 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.312+0000 7f2835ebd740 20 client.15915 trim_cache size 0 max 16384 2024-09-15T23:34:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:34:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:34:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:34:14.315 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 msgr2=0x7f28140a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 0x7f28140a5970 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x55db842c8d10 tx=0x7f282400d040 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 msgr2=0x7f282c1a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f281c02aa30 tx=0x7f281c032e30 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 shutdown_connections 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f28140a34b0 0x7f28140a5970 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f282c109d40 0x7f282c1a5ac0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f282c109380 0x7f282c19ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 --2- 172.21.15.77:0/2655150000 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f282c108470 0x7f282c19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:14.320 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.315+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 >> 172.21.15.77:0/2655150000 conn(0x7f282c077470 msgr2=0x7f282c10c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.316+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 shutdown_connections 2024-09-15T23:34:14.321 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:14.316+0000 7f283312c640 1 -- 172.21.15.77:0/2655150000 wait complete. 2024-09-15T23:34:14.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:14 smithi159 ceph-mon[35472]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 58 MiB/s wr, 19 op/s 2024-09-15T23:34:14.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:14 smithi155 ceph-mon[35631]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 58 MiB/s wr, 19 op/s 2024-09-15T23:34:14.633 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:14 smithi077 ceph-mon[30968]: pgmap v430: 129 pgs: 129 active+clean; 10 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 58 MiB/s wr, 19 op/s 2024-09-15T23:34:17.065 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '5f350efb', total seconds elapsed: 28.1 2024-09-15T23:34:17.065 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.55 2024-09-15T23:34:17.065 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:17.290 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:17 smithi077 ceph-mon[30968]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 226 MiB/s wr, 127 op/s 2024-09-15T23:34:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:17 smithi155 ceph-mon[35631]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 226 MiB/s wr, 127 op/s 2024-09-15T23:34:17.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:17 smithi159 ceph-mon[35472]: pgmap v431: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 226 MiB/s wr, 127 op/s 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 -- 172.21.15.77:0/2477481676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f20112880 msgr2=0x7f6f20114c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 --2- 172.21.15.77:0/2477481676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f20112880 0x7f6f20114c70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009ca0 tx=0x7f6f1802a960 comp rx=0 tx=0).stop 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 -- 172.21.15.77:0/2477481676 shutdown_connections 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 --2- 172.21.15.77:0/2477481676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f20112880 0x7f6f20114c70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 --2- 172.21.15.77:0/2477481676 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 --2- 172.21.15.77:0/2477481676 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200fffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.710 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.707+0000 7f6f26797640 1 -- 172.21.15.77:0/2477481676 >> 172.21.15.77:0/2477481676 conn(0x7f6f200fba90 msgr2=0x7f6f200fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.711 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.709+0000 7f6f26797640 1 -- 172.21.15.77:0/2477481676 shutdown_connections 2024-09-15T23:34:17.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.710+0000 7f6f26797640 1 -- 172.21.15.77:0/2477481676 wait complete. 2024-09-15T23:34:17.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.711+0000 7f6f26797640 1 Processor -- start 2024-09-15T23:34:17.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.711+0000 7f6f26797640 1 -- start start 2024-09-15T23:34:17.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.714 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20073c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2006c750 0x7f6f2006cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f201185f0 con 0x7f6f200ffbf0 2024-09-15T23:34:17.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20118470 con 0x7f6f2006c750 2024-09-15T23:34:17.715 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.712+0000 7f6f26797640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20118770 con 0x7f6f20100510 2024-09-15T23:34:17.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.715+0000 7f6f1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20073c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20073c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.77:41092/0 (socket says 172.21.15.77:41092) 2024-09-15T23:34:17.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1f7fe640 1 -- 172.21.15.77:0/1009784819 learned_addr learned my addr 172.21.15.77:0/1009784819 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:17.717 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f24d34640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2006c750 0x7f6f2006cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 -- 172.21.15.77:0/1009784819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 msgr2=0x7f6f20073c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20073c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 -- 172.21.15.77:0/1009784819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2006c750 msgr2=0x7f6f2006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2006c750 0x7f6f2006cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.716+0000 7f6f1ffff640 1 -- 172.21.15.77:0/1009784819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2006d380 con 0x7f6f200ffbf0 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.717+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200736c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000b3f0 tx=0x7f6f1000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.717+0000 7f6f1d7fa640 1 -- 172.21.15.77:0/1009784819 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10015020 con 0x7f6f200ffbf0 2024-09-15T23:34:17.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.717+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f200711f0 con 0x7f6f200ffbf0 2024-09-15T23:34:17.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.717+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f20071780 con 0x7f6f200ffbf0 2024-09-15T23:34:17.720 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.718+0000 7f6f1d7fa640 1 -- 172.21.15.77:0/1009784819 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f10011d10 con 0x7f6f200ffbf0 2024-09-15T23:34:17.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.720+0000 7f6f1d7fa640 1 -- 172.21.15.77:0/1009784819 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1001ad70 con 0x7f6f200ffbf0 2024-09-15T23:34:17.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.725+0000 7f6f1d7fa640 1 -- 172.21.15.77:0/1009784819 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6f10018020 con 0x7f6f200ffbf0 2024-09-15T23:34:17.731 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.728+0000 7f6f1d7fa640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 0x7f6f080a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.731+0000 7f6f1d7fa640 1 -- 172.21.15.77:0/1009784819 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6f100cf4a0 con 0x7f6f200ffbf0 2024-09-15T23:34:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.733+0000 7f6f28b70740 1 Processor -- start 2024-09-15T23:34:17.735 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.734+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 0x7f6f080a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.737 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 -- start start 2024-09-15T23:34:17.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.738 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddeedc0 0x56359ddf9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddf9680 0x56359ddfba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56359dd542e0 con 0x56359ddee4a0 2024-09-15T23:34:17.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56359dcfbce0 con 0x56359ddeedc0 2024-09-15T23:34:17.739 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.736+0000 7f6f28b70740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56359dd502a0 con 0x56359ddf9680 2024-09-15T23:34:17.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40576/0 (socket says 172.21.15.77:40576) 2024-09-15T23:34:17.740 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 -- 172.21.15.77:0/3020354992 learned_addr learned my addr 172.21.15.77:0/3020354992 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 -- 172.21.15.77:0/3020354992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddf9680 msgr2=0x56359ddfba70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddf9680 0x56359ddfba70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 -- 172.21.15.77:0/3020354992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddeedc0 msgr2=0x56359ddf9140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddeedc0 0x56359ddf9140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.739+0000 7f6f1ffff640 1 -- 172.21.15.77:0/3020354992 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359dce0440 con 0x56359ddee4a0 2024-09-15T23:34:17.744 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.740+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001a980 tx=0x7f6f1009b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b20f7c9b6572e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.742+0000 7f6f067fc640 1 -- 172.21.15.77:0/3020354992 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f100b4070 con 0x56359ddee4a0 2024-09-15T23:34:17.745 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.742+0000 7f6f067fc640 1 -- 172.21.15.77:0/3020354992 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f100cf1f0 con 0x56359ddee4a0 2024-09-15T23:34:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.744+0000 7f6f28b70740 1 -- 172.21.15.77:0/3020354992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 msgr2=0x56359ddee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.744+0000 7f6f28b70740 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f6f1001a980 tx=0x7f6f1009b870 comp rx=0 tx=0).stop 2024-09-15T23:34:17.748 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.746+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 0x7f6f080a5740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006df10 tx=0x7f6f1400b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.750+0000 7f6f28b70740 1 -- 172.21.15.77:0/3020354992 shutdown_connections 2024-09-15T23:34:17.751 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.750+0000 7f6f28b70740 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddf9680 0x56359ddfba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.750+0000 7f6f28b70740 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddeedc0 0x56359ddf9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.750+0000 7f6f28b70740 1 --2- 172.21.15.77:0/3020354992 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddee4a0 0x56359ddee880 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.752 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.750+0000 7f6f28b70740 1 -- 172.21.15.77:0/3020354992 >> 172.21.15.77:0/3020354992 conn(0x56359ddeaa30 msgr2=0x56359ddeae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.757 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.756+0000 7f6f28b70740 1 -- 172.21.15.77:0/3020354992 shutdown_connections 2024-09-15T23:34:17.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.760+0000 7f6f28b70740 1 -- 172.21.15.77:0/3020354992 wait complete. 2024-09-15T23:34:17.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.760+0000 7f6f28b70740 1 -- start start 2024-09-15T23:34:17.762 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.760+0000 7f6f28b70740 1 Processor -- start 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddee4a0 0x56359ddf8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 0x56359ddf6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 0x56359ddf6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56359ddfc0d0 con 0x56359ddeedc0 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56359dd0f050 con 0x56359ddf9680 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56359ddfc250 con 0x56359ddee4a0 2024-09-15T23:34:17.767 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.765+0000 7f6f28b70740 10 client.0 _ll_register_callbacks cb 0x56359dd4f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.766+0000 7f6f1ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddee4a0 0x56359ddf8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.767+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 0x56359ddf6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.767+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 0x56359ddf6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:48394/0 (socket says 172.21.15.77:48394) 2024-09-15T23:34:17.770 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.767+0000 7f6f24d34640 1 -- 172.21.15.77:0/633641889 learned_addr learned my addr 172.21.15.77:0/633641889 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.767+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 0x56359ddf6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.769+0000 7f6f1f7fe640 1 -- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddee4a0 msgr2=0x56359ddf8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:17.771 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.769+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddee4a0 0x56359ddf8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.769+0000 7f6f1f7fe640 1 -- 172.21.15.77:0/633641889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 msgr2=0x56359ddf6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.769+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 0x56359ddf6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.769+0000 7f6f1f7fe640 1 -- 172.21.15.77:0/633641889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359dac53c0 con 0x56359ddeedc0 2024-09-15T23:34:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.770+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 0x56359ddf6240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006dfa0 tx=0x7f6f14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc93fef23e8d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.772 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.770+0000 7f6eff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.771+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14005220 con 0x56359ddeedc0 2024-09-15T23:34:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.771+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f100cf1f0 con 0x56359ddeedc0 2024-09-15T23:34:17.773 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.771+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6f140053c0 con 0x56359ddeedc0 2024-09-15T23:34:17.778 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.775+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f1402e050 con 0x56359ddeedc0 2024-09-15T23:34:17.780 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:17.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.778+0000 7f6f28b70740 10 client.15924 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:17.780 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.778+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56359de07be0 con 0x56359ddeedc0 2024-09-15T23:34:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.788+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f100cf1f0 con 0x56359ddeedc0 2024-09-15T23:34:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.789+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6f1401eb70 con 0x56359ddeedc0 2024-09-15T23:34:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 10 client.15924 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 10 client.15924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:17.791 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 20 client.15924 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de09140 0x56359de0b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 4 client.15924 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:17.792 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.790+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56359dd61850 con 0x56359de09140 2024-09-15T23:34:17.793 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.791+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de09140 0x56359de0b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.801+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de09140 0x56359de0b560 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d999646664d4cf5 server_cookie=bf9c73017215d4ab in_seq=0 out_seq=0 2024-09-15T23:34:17.803 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.801+0000 7f6eff7fe640 10 client.15924 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.805+0000 7f6eff7fe640 1 -- 172.21.15.77:0/633641889 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56359dd61850 con 0x56359de09140 2024-09-15T23:34:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.805+0000 7f6eff7fe640 10 client.15924 handle_command_reply: tid=0 2024-09-15T23:34:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.805+0000 7f6f28b70740 1 client.15924 shutdown 2024-09-15T23:34:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.806+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 msgr2=0x56359ddf6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.808 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.806+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 0x56359ddf6240 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006dfa0 tx=0x7f6f14004730 comp rx=0 tx=0).stop 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 shutdown_connections 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de09140 0x56359de0b560 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddf9680 0x56359ddf6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddeedc0 0x56359ddf6240 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 --2- 172.21.15.77:0/633641889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddee4a0 0x56359ddf8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 >> 172.21.15.77:0/633641889 conn(0x56359ddeaa30 msgr2=0x56359ddf0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.809 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.807+0000 7f6eff7fe640 0 client.15924 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.810+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 shutdown_connections 2024-09-15T23:34:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.810+0000 7f6f28b70740 1 -- 172.21.15.77:0/633641889 wait complete. 2024-09-15T23:34:17.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.810+0000 7f6f28b70740 20 client.15924 trim_cache size 0 max 16384 2024-09-15T23:34:17.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.849+0000 7f6f28b70740 1 Processor -- start 2024-09-15T23:34:17.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.849+0000 7f6f28b70740 1 -- start start 2024-09-15T23:34:17.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.850+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de05430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.850+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359de10e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f28b70740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00dce0 con 0x56359ddf9680 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40592/0 (socket says 172.21.15.77:40592) 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f24d34640 1 -- 172.21.15.77:0/869467230 learned_addr learned my addr 172.21.15.77:0/869467230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c010560 con 0x56359ddee4a0 2024-09-15T23:34:17.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00e350 con 0x56359ddeedc0 2024-09-15T23:34:17.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.851+0000 7f6f1f7fe640 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359de10e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.852+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de05430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.853+0000 7f6f24d34640 1 -- 172.21.15.77:0/869467230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 msgr2=0x56359de10e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:17.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.853+0000 7f6f24d34640 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359de10e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.853+0000 7f6f24d34640 1 -- 172.21.15.77:0/869467230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 msgr2=0x56359de05430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:17.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.853+0000 7f6f24d34640 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de05430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.853+0000 7f6f24d34640 1 -- 172.21.15.77:0/869467230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359ddebae0 con 0x56359ddf9680 2024-09-15T23:34:17.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.854+0000 7f6f24d34640 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6f18003a20 tx=0x7f6f18003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ea958fea58a741 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.855+0000 7f6f05ffb640 1 -- 172.21.15.77:0/869467230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18034040 con 0x56359ddf9680 2024-09-15T23:34:17.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.856+0000 7f6f05ffb640 1 -- 172.21.15.77:0/869467230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f18003bb0 con 0x56359ddf9680 2024-09-15T23:34:17.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.857+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 msgr2=0x56359de11370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.858 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.857+0000 7f6f28b70740 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f6f18003a20 tx=0x7f6f18003a50 comp rx=0 tx=0).stop 2024-09-15T23:34:17.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.859+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 shutdown_connections 2024-09-15T23:34:17.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.859+0000 7f6f28b70740 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359de11370 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.859+0000 7f6f28b70740 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359de10e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.859+0000 7f6f28b70740 1 --2- 172.21.15.77:0/869467230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de05430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.859+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 >> 172.21.15.77:0/869467230 conn(0x56359ddeaa30 msgr2=0x56359ddf1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.860+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 shutdown_connections 2024-09-15T23:34:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.860+0000 7f6f28b70740 1 -- 172.21.15.77:0/869467230 wait complete. 2024-09-15T23:34:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.860+0000 7f6f28b70740 1 -- start start 2024-09-15T23:34:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 Processor -- start 2024-09-15T23:34:17.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de01e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359ddfd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00ea20 con 0x56359ddf9680 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00fe90 con 0x56359ddee4a0 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6f0c00f0f0 con 0x56359ddeedc0 2024-09-15T23:34:17.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.861+0000 7f6f28b70740 10 client.0 _ll_register_callbacks cb 0x7f6f1400beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.862+0000 7f6f1f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359ddfd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40602/0 (socket says 172.21.15.77:40602) 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 -- 172.21.15.77:0/1760590351 learned_addr learned my addr 172.21.15.77:0/1760590351 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 -- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 msgr2=0x56359ddfd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359ddfd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 -- 172.21.15.77:0/1760590351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 msgr2=0x56359de01e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:17.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de01e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.863+0000 7f6f24d34640 1 -- 172.21.15.77:0/1760590351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359de83e10 con 0x56359ddf9680 2024-09-15T23:34:17.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.864+0000 7f6f24d34640 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f1802a9a0 tx=0x7f6f18004150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a1db61140c1f200 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:17.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.864+0000 7f6eff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:17.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.864+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1804e020 con 0x56359ddf9680 2024-09-15T23:34:17.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.865+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f18003bb0 con 0x56359ddf9680 2024-09-15T23:34:17.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.867+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6f18030870 con 0x56359ddf9680 2024-09-15T23:34:17.869 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.868+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6f18034040 con 0x56359ddf9680 2024-09-15T23:34:17.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.868+0000 7f6f28b70740 10 client.15930 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:17.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.868+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56359de84f70 con 0x56359ddf9680 2024-09-15T23:34:17.871 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.870+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6f18003bb0 con 0x56359ddf9680 2024-09-15T23:34:17.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.870+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f6f18039420 con 0x56359ddf9680 2024-09-15T23:34:17.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 10 client.15930 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:17.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:17.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 20 client.15930 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:17.872 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de855f0 0x56359de879e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:17.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 4 client.15930 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:34:17.873 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.871+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56359dd5bd60 con 0x56359de855f0 2024-09-15T23:34:17.874 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.873+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de855f0 0x56359de879e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.881+0000 7f6f1ffff640 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de855f0 0x56359de879e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=153fdbc7d1ed3743 server_cookie=e29bfc5353392392 in_seq=0 out_seq=0 2024-09-15T23:34:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.881+0000 7f6eff7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.882+0000 7f6eff7fe640 1 -- 172.21.15.77:0/1760590351 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56359dd5bd60 con 0x56359de855f0 2024-09-15T23:34:17.883 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.882+0000 7f6eff7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-15T23:34:17.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.884+0000 7f6f28b70740 1 client.15930 shutdown 2024-09-15T23:34:17.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.885+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 msgr2=0x56359ddfd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.885+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f6f1802a9a0 tx=0x7f6f18004150 comp rx=0 tx=0).stop 2024-09-15T23:34:17.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 shutdown_connections 2024-09-15T23:34:17.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56359de855f0 0x56359de879e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56359ddf9680 0x56359ddfd910 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56359ddeedc0 0x56359ddfd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 --2- 172.21.15.77:0/1760590351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56359ddee4a0 0x56359de01e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.889+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 >> 172.21.15.77:0/1760590351 conn(0x56359ddeaa30 msgr2=0x56359ddf82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.892 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.890+0000 7f6eff7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:17.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.890+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 shutdown_connections 2024-09-15T23:34:17.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.890+0000 7f6f28b70740 1 -- 172.21.15.77:0/1760590351 wait complete. 2024-09-15T23:34:17.896 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.891+0000 7f6f28b70740 20 client.15930 trim_cache size 0 max 16384 2024-09-15T23:34:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:17.901 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:34:17.901 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:34:17.901 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.907+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 msgr2=0x7f6f080a5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.907+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 0x7f6f080a5740 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6f2006df10 tx=0x7f6f1400b480 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.907+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 msgr2=0x7f6f200736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.907+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200736c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000b3f0 tx=0x7f6f1000b8b0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 shutdown_connections 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6f080a3280 0x7f6f080a5740 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6f2006c750 0x7f6f2006cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f20100510 0x7f6f20073c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 --2- 172.21.15.77:0/1009784819 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6f200ffbf0 0x7f6f200736c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:17.911 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 >> 172.21.15.77:0/1009784819 conn(0x7f6f200fba90 msgr2=0x7f6f20104bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:17.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 shutdown_connections 2024-09-15T23:34:17.912 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:17.908+0000 7f6f26797640 1 -- 172.21.15.77:0/1009784819 wait complete. 2024-09-15T23:34:18.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:18 smithi159 ceph-mon[35472]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 232 MiB/s wr, 125 op/s 2024-09-15T23:34:18.476 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:18 smithi077 ceph-mon[30968]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 232 MiB/s wr, 125 op/s 2024-09-15T23:34:18.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:18 smithi155 ceph-mon[35631]: pgmap v432: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 232 MiB/s wr, 125 op/s 2024-09-15T23:34:18.950 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:34:18.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.256+0000 7f544372d640 1 -- 172.21.15.77:0/1490140248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c103fe0 msgr2=0x7f543c1043c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:19.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.256+0000 7f544372d640 1 --2- 172.21.15.77:0/1490140248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c103fe0 0x7f543c1043c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f542c009900 tx=0x7f542c02a400 comp rx=0 tx=0).stop 2024-09-15T23:34:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.258+0000 7f544372d640 1 -- 172.21.15.77:0/1490140248 shutdown_connections 2024-09-15T23:34:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.258+0000 7f544372d640 1 --2- 172.21.15.77:0/1490140248 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f543c109110 0x7f543c110c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.258+0000 7f544372d640 1 --2- 172.21.15.77:0/1490140248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f543c104990 0x7f543c1089e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.258+0000 7f544372d640 1 --2- 172.21.15.77:0/1490140248 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c103fe0 0x7f543c1043c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.258+0000 7f544372d640 1 -- 172.21.15.77:0/1490140248 >> 172.21.15.77:0/1490140248 conn(0x7f543c0ffa80 msgr2=0x7f543c101ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:19.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.260+0000 7f544372d640 1 -- 172.21.15.77:0/1490140248 shutdown_connections 2024-09-15T23:34:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.260+0000 7f544372d640 1 -- 172.21.15.77:0/1490140248 wait complete. 2024-09-15T23:34:19.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.261+0000 7f544372d640 1 Processor -- start 2024-09-15T23:34:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.261+0000 7f544372d640 1 -- start start 2024-09-15T23:34:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.262+0000 7f544372d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f543c103fe0 0x7f543c19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:19.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.262+0000 7f544372d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f543c104990 0x7f543c19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.262+0000 7f544372d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f544372d640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f543c114160 con 0x7f543c109110 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f544372d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f543c113fe0 con 0x7f543c104990 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f544372d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f543c1142e0 con 0x7f543c103fe0 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f5441cca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f5441cca640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40622/0 (socket says 172.21.15.77:40622) 2024-09-15T23:34:19.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.263+0000 7f5441cca640 1 -- 172.21.15.77:0/2915575501 learned_addr learned my addr 172.21.15.77:0/2915575501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.264+0000 7f5441cca640 1 -- 172.21.15.77:0/2915575501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f543c103fe0 msgr2=0x7f543c19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.264+0000 7f5441cca640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f543c103fe0 0x7f543c19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.264+0000 7f5441cca640 1 -- 172.21.15.77:0/2915575501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f543c104990 msgr2=0x7f543c19ab80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T23:34:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.264+0000 7f5441cca640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f543c104990 0x7f543c19ab80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.264+0000 7f5441cca640 1 -- 172.21.15.77:0/2915575501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c19f5f0 con 0x7f543c109110 2024-09-15T23:34:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.269+0000 7f5441cca640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f543400eb10 tx=0x7f543400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.269+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5434004b20 con 0x7f543c109110 2024-09-15T23:34:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.270+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543c19f8e0 con 0x7f543c109110 2024-09-15T23:34:19.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.270+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f543c1a71c0 con 0x7f543c109110 2024-09-15T23:34:19.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.271+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5434004cc0 con 0x7f543c109110 2024-09-15T23:34:19.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.272+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54340216a0 con 0x7f543c109110 2024-09-15T23:34:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.279+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5420005290 con 0x7f543c109110 2024-09-15T23:34:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.280+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f5434021840 con 0x7f543c109110 2024-09-15T23:34:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.282+0000 7f54327fc640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 0x7f54280a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.282+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f54340d08e0 con 0x7f543c109110 2024-09-15T23:34:19.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.283+0000 7f54414c9640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 0x7f54280a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:19.294 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.291+0000 7f54414c9640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 0x7f54280a57c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f542c005c20 tx=0x7f542c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:19.298 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.295+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f54340152d0 con 0x7f543c109110 2024-09-15T23:34:19.472 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:19.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.659+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5420005580 con 0x7f543c109110 2024-09-15T23:34:19.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.660+0000 7f54327fc640 1 -- 172.21.15.77:0/2915575501 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f543409d210 con 0x7f543c109110 2024-09-15T23:34:19.662 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:19.663 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:19.663 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 msgr2=0x7f54280a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 0x7f54280a57c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f542c005c20 tx=0x7f542c000bc0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 msgr2=0x7f543c19ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f543400eb10 tx=0x7f543400c2d0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 shutdown_connections 2024-09-15T23:34:19.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f54280a3300 0x7f54280a57c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f543c109110 0x7f543c19ef10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f543c104990 0x7f543c19ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 --2- 172.21.15.77:0/2915575501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f543c103fe0 0x7f543c19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.664+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 >> 172.21.15.77:0/2915575501 conn(0x7f543c0ffa80 msgr2=0x7f543c100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.665+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 shutdown_connections 2024-09-15T23:34:19.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:19.665+0000 7f544372d640 1 -- 172.21.15.77:0/2915575501 wait complete. 2024-09-15T23:34:19.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:19 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2915575501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:20.113 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:19 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2915575501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:20.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:19 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2915575501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:20.432 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0' 2024-09-15T23:34:20.432 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db / --timeout 90 --expiration 139.55 --await-for 45.0 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 rewriters = 381118.41 kB/sec 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 rewriters = 381115.32 kB/sec 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 381118.41 kB/sec 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 381118.41 kB/sec 2024-09-15T23:34:20.458 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 381118.41 kB/sec 2024-09-15T23:34:20.459 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-09-15T23:34:21.015 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:20 smithi155 ceph-mon[35631]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 351 MiB/s wr, 157 op/s 2024-09-15T23:34:21.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:20 smithi077 ceph-mon[30968]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 351 MiB/s wr, 157 op/s 2024-09-15T23:34:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:20 smithi159 ceph-mon[35472]: pgmap v433: 129 pgs: 129 active+clean; 10 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 351 MiB/s wr, 157 op/s 2024-09-15T23:34:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:22 smithi159 ceph-mon[35472]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 567 MiB/s wr, 223 op/s 2024-09-15T23:34:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:22 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3648753991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:23.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:22 smithi155 ceph-mon[35631]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 567 MiB/s wr, 223 op/s 2024-09-15T23:34:23.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:22 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3648753991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:22 smithi077 ceph-mon[30968]: pgmap v434: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 567 MiB/s wr, 223 op/s 2024-09-15T23:34:23.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:23 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3648753991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 -- 172.21.15.77:0/1670475788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0101410 msgr2=0x7faca010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 --2- 172.21.15.77:0/1670475788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0101410 0x7faca010d940 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fac98009cd0 tx=0x7fac9802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 -- 172.21.15.77:0/1670475788 shutdown_connections 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 --2- 172.21.15.77:0/1670475788 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0101410 0x7faca010d940 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 --2- 172.21.15.77:0/1670475788 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0100a70 0x7faca0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 --2- 172.21.15.77:0/1670475788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0106a70 0x7faca0106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 -- 172.21.15.77:0/1670475788 >> 172.21.15.77:0/1670475788 conn(0x7faca00fc790 msgr2=0x7faca00febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 -- 172.21.15.77:0/1670475788 shutdown_connections 2024-09-15T23:34:23.995 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.130+0000 7faca8104640 1 -- 172.21.15.77:0/1670475788 wait complete. 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 Processor -- start 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 -- start start 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 0x7faca01997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 0x7faca01a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7faca0110e70 con 0x7faca0100a70 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faca0110cf0 con 0x7faca0106a70 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca8104640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faca0110ff0 con 0x7faca0101410 2024-09-15T23:34:23.996 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca5ea0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca5ea0640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40652/0 (socket says 172.21.15.77:40652) 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca5ea0640 1 -- 172.21.15.77:0/3648753991 learned_addr learned my addr 172.21.15.77:0/3648753991 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca66a1640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 0x7faca01a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.131+0000 7faca569f640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 0x7faca01997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 -- 172.21.15.77:0/3648753991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 msgr2=0x7faca01997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 0x7faca01997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:23.997 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 -- 172.21.15.77:0/3648753991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 msgr2=0x7faca01a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 0x7faca01a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 -- 172.21.15.77:0/3648753991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca01a4860 con 0x7faca0100a70 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca569f640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 0x7faca01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca66a1640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 0x7faca01a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca5ea0640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00d770 tx=0x7fac9c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c017070 con 0x7faca0100a70 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac9c005500 con 0x7faca0100a70 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca01a4a30 con 0x7faca0100a70 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac9c004e00 con 0x7faca0100a70 2024-09-15T23:34:23.998 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.132+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca01a4ef0 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.133+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca0100ed0 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.135+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fac9c004fa0 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.135+0000 7fac96ffd640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 0x7fac8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.135+0000 7faca569f640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 0x7fac8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.135+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fac9c0cfb50 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.136+0000 7faca569f640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 0x7fac8c0a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faca006b2e0 tx=0x7fac90005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.139+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fac9c09c4e0 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.341+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faca006ad80 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.341+0000 7fac96ffd640 1 -- 172.21.15.77:0/3648753991 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7faca006ad80 con 0x7faca0100a70 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:23.999 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 msgr2=0x7fac8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 0x7fac8c0a5700 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7faca006b2e0 tx=0x7fac90005ec0 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 msgr2=0x7faca01992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fac9c00d770 tx=0x7fac9c00dc30 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 shutdown_connections 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fac8c0a3240 0x7fac8c0a5700 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faca0106a70 0x7faca01a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faca0101410 0x7faca01997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 --2- 172.21.15.77:0/3648753991 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7faca0100a70 0x7faca01992a0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:24.000 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 >> 172.21.15.77:0/3648753991 conn(0x7faca00fc790 msgr2=0x7faca00fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:24.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 shutdown_connections 2024-09-15T23:34:24.001 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:22.343+0000 7faca8104640 1 -- 172.21.15.77:0/3648753991 wait complete. 2024-09-15T23:34:24.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:34:25.132 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:24 smithi159 ceph-mon[35472]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 615 MiB/s wr, 235 op/s 2024-09-15T23:34:25.254 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:24 smithi077 ceph-mon[30968]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 615 MiB/s wr, 235 op/s 2024-09-15T23:34:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:24 smithi155 ceph-mon[35631]: pgmap v435: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 615 MiB/s wr, 235 op/s 2024-09-15T23:34:25.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 -- 172.21.15.77:0/2685532659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8100a80 msgr2=0x7f3ab8100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 --2- 172.21.15.77:0/2685532659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8100a80 0x7f3ab8100ee0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009930 tx=0x7f3aac02a420 comp rx=0 tx=0).stop 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 -- 172.21.15.77:0/2685532659 shutdown_connections 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 --2- 172.21.15.77:0/2685532659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8101420 0x7f3ab810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 --2- 172.21.15.77:0/2685532659 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8100a80 0x7f3ab8100ee0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 --2- 172.21.15.77:0/2685532659 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8106a80 0x7f3ab8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 -- 172.21.15.77:0/2685532659 >> 172.21.15.77:0/2685532659 conn(0x7f3ab80fc7a0 msgr2=0x7f3ab80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 -- 172.21.15.77:0/2685532659 shutdown_connections 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 -- 172.21.15.77:0/2685532659 wait complete. 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.617+0000 7f3abd996640 1 Processor -- start 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 -- start start 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 0x7f3ab8197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 0x7f3ab8197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab8110f20 con 0x7f3ab8106a80 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab8110da0 con 0x7f3ab8101420 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3abd996640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81110a0 con 0x7f3ab8100a80 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40676/0 (socket says 172.21.15.77:40676) 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 -- 172.21.15.77:0/1722632642 learned_addr learned my addr 172.21.15.77:0/1722632642 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 0x7f3ab8197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 0x7f3ab8197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 -- 172.21.15.77:0/1722632642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 msgr2=0x7f3ab8197220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 0x7f3ab8197220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 -- 172.21.15.77:0/1722632642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 msgr2=0x7f3ab8197760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 0x7f3ab8197760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 -- 172.21.15.77:0/1722632642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab81a6a90 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 0x7f3ab8197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 0x7f3ab8197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.618+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b970 tx=0x7f3ab000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.619+0000 7f3abc994640 1 -- 172.21.15.77:0/1722632642 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0019070 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.619+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab81a6d80 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.619+0000 7f3abc994640 1 -- 172.21.15.77:0/1722632642 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ab000cb40 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.619+0000 7f3abc994640 1 -- 172.21.15.77:0/1722632642 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0007610 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.619+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab81a7290 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abc994640 1 -- 172.21.15.77:0/1722632642 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f3ab001c070 con 0x7f3ab8106a80 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 Processor -- start 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 -- start start 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf05c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.632 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf10a30 0x555dfdf12e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555dfde6a160 con 0x555dfdf06170 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555dfde11720 con 0x555dfdf10a30 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555dfde66120 con 0x555dfdf05850 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.621+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40684/0 (socket says 172.21.15.77:40684) 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 -- 172.21.15.77:0/3362020664 learned_addr learned my addr 172.21.15.77:0/3362020664 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf05c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 -- 172.21.15.77:0/3362020664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 msgr2=0x555dfdf05c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf05c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf10a30 0x555dfdf12e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.633 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 -- 172.21.15.77:0/3362020664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf10a30 msgr2=0x555dfdf12e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf10a30 0x555dfdf12e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 -- 172.21.15.77:0/3362020664 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dfdbdbba0 con 0x555dfdf06170 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3abc994640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 0x7f3aa00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 0x7f3aa00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007850 tx=0x7f3aa8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fb50b174f1869a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3abc994640 1 -- 172.21.15.77:0/1722632642 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3ab00cf2c0 con 0x7f3ab8106a80 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3a9dffb640 1 -- 172.21.15.77:0/3362020664 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800d950 con 0x555dfdf06170 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3a9dffb640 1 -- 172.21.15.77:0/3362020664 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aa8018070 con 0x555dfdf06170 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.622+0000 7f3a9dffb640 1 -- 172.21.15.77:0/3362020664 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80123e0 con 0x555dfdf06170 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- 172.21.15.77:0/3362020664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 msgr2=0x555dfdf104f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 0x7f3aa00a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3aac031550 tx=0x7f3aac005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007850 tx=0x7f3aa8007d10 comp rx=0 tx=0).stop 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- 172.21.15.77:0/3362020664 shutdown_connections 2024-09-15T23:34:25.634 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf10a30 0x555dfdf12e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf06170 0x555dfdf104f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/3362020664 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf05c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- 172.21.15.77:0/3362020664 >> 172.21.15.77:0/3362020664 conn(0x555dfdf01de0 msgr2=0x555dfdf021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- 172.21.15.77:0/3362020664 shutdown_connections 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- 172.21.15.77:0/3362020664 wait complete. 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.623+0000 7f3abfd6f740 1 -- start start 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 Processor -- start 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 0x555dfdf0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf06170 0x555dfdf0de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x555dfdf13600 con 0x555dfdf10a30 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555dfddf2900 con 0x555dfdf05850 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555dfdf13780 con 0x555dfdf06170 2024-09-15T23:34:25.635 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 10 client.0 _ll_register_callbacks cb 0x555dfddf0780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40696/0 (socket says 172.21.15.77:40696) 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 -- 172.21.15.77:0/623625481 learned_addr learned my addr 172.21.15.77:0/623625481 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 0x555dfdf0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf06170 0x555dfdf0de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 -- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf06170 msgr2=0x555dfdf0de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf06170 0x555dfdf0de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 -- 172.21.15.77:0/623625481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 msgr2=0x555dfdf0d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 0x555dfdf0d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 -- 172.21.15.77:0/623625481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dfde32c50 con 0x555dfdf10a30 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 0x555dfdf0d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00a3c90 tx=0x7f3ab009bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8970fc270bb330cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.636 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab009f900 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3ab00a3d30 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.624+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aa8018070 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3ab00a41c0 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 10 client.15954 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555dfdf1f290 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aa8018070 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3ab009aa10 con 0x555dfdf10a30 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 10 client.15954 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 10 client.15954 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 20 client.15954 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf22b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 4 client.15954 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:25.637 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555dfde77890 con 0x555dfdf206f0 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.625+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf22b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.626+0000 7f3a96ffd640 10 client.15954 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.626+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf22b80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8860119297cacf server_cookie=2242074bb0d264c3 in_seq=0 out_seq=0 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.626+0000 7f3a96ffd640 1 -- 172.21.15.77:0/623625481 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555dfde77890 con 0x555dfdf206f0 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.626+0000 7f3a96ffd640 10 client.15954 handle_command_reply: tid=0 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 client.15954 shutdown 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 msgr2=0x555dfdf0e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00a3c90 tx=0x7f3ab009bc50 comp rx=0 tx=0).stop 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 shutdown_connections 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf22b80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf0e350 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3a96ffd640 0 client.15954 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:25.638 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf06170 0x555dfdf0de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/623625481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf05850 0x555dfdf0d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 >> 172.21.15.77:0/623625481 conn(0x555dfdf01de0 msgr2=0x555dfdf07ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 shutdown_connections 2024-09-15T23:34:25.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 1 -- 172.21.15.77:0/623625481 wait complete. 2024-09-15T23:34:25.639 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.627+0000 7f3abfd6f740 20 client.15954 trim_cache size 0 max 16384 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.644+0000 7f3abfd6f740 1 Processor -- start 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.644+0000 7f3abfd6f740 1 -- start start 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf079b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf28990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81aefd0 con 0x555dfdf10a30 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81b1850 con 0x555dfdf06170 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81af640 con 0x555dfdf05850 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf28990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab67fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab67fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:48470/0 (socket says 172.21.15.77:48470) 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab77fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf28990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40708/0 (socket says 172.21.15.77:40708) 2024-09-15T23:34:25.647 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab67fc640 1 -- 172.21.15.77:0/4270973307 learned_addr learned my addr 172.21.15.77:0/4270973307 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.645+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 -- 172.21.15.77:0/4270973307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 msgr2=0x555dfdf079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 -- 172.21.15.77:0/4270973307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 msgr2=0x555dfdf28990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf28990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.648 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 -- 172.21.15.77:0/4270973307 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555dfdf0c880 con 0x555dfdf06170 2024-09-15T23:34:25.651 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009930 tx=0x7f3aac03e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23efed62a9d4ae22 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3a9d7fa640 1 -- 172.21.15.77:0/4270973307 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac04e070 con 0x555dfdf06170 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3a9d7fa640 1 -- 172.21.15.77:0/4270973307 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aac004480 con 0x555dfdf06170 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.646+0000 7f3a9d7fa640 1 -- 172.21.15.77:0/4270973307 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac035040 con 0x555dfdf06170 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- 172.21.15.77:0/4270973307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 msgr2=0x555dfdf28450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009930 tx=0x7f3aac03e000 comp rx=0 tx=0).stop 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- 172.21.15.77:0/4270973307 shutdown_connections 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf10a30 0x555dfdf28990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf28450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/4270973307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf05850 0x555dfdf079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- 172.21.15.77:0/4270973307 >> 172.21.15.77:0/4270973307 conn(0x555dfdf01de0 msgr2=0x555dfdf072a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- 172.21.15.77:0/4270973307 shutdown_connections 2024-09-15T23:34:25.652 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- 172.21.15.77:0/4270973307 wait complete. 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.647+0000 7f3abfd6f740 1 -- start start 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 Processor -- start 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf15430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 0x555dfdf8a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81afd10 con 0x555dfdf05850 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81b1180 con 0x555dfdf06170 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab81b03e0 con 0x555dfdf10a30 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3abfd6f740 10 client.0 _ll_register_callbacks cb 0x7f3ab0097130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40716/0 (socket says 172.21.15.77:40716) 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab6ffd640 1 -- 172.21.15.77:0/2648287118 learned_addr learned my addr 172.21.15.77:0/2648287118 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:25.653 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf15430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 0x555dfdf8a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 -- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 msgr2=0x555dfdf8a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 0x555dfdf8a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 -- 172.21.15.77:0/2648287118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 msgr2=0x555dfdf14ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.648+0000 7f3ab67fc640 1 -- 172.21.15.77:0/2648287118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555dfdf8aa10 con 0x555dfdf06170 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3ab77fe640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 0x555dfdf8a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3ab67fc640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf15430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x555dfdf1ce30 tx=0x7f3aac003bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6cd09bf4344988e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3a96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aac035030 con 0x555dfdf06170 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f3aac003da0 con 0x555dfdf06170 2024-09-15T23:34:25.654 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3aac004480 con 0x555dfdf06170 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3aac066050 con 0x555dfdf06170 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3abfd6f740 10 client.25301 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x555dfdf8bc90 con 0x555dfdf06170 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.649+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3aac004480 con 0x555dfdf06170 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f3aac03a050 con 0x555dfdf06170 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 10 client.25301 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 10 client.25301 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 20 client.25301 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf8e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 4 client.25301 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}] 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.55, "await_for": 45.0}) -- 0x555dfdefd410 con 0x555dfdf206f0 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.650+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf8e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.651+0000 7f3a96ffd640 10 client.25301 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:25.655 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.651+0000 7f3ab6ffd640 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf8e450 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdf6e72bc1ae2d5c server_cookie=a871c3f5e82c4115 in_seq=0 out_seq=0 2024-09-15T23:34:25.661 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3a96ffd640 1 -- 172.21.15.77:0/2648287118 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555dfdefd410 con 0x555dfdf206f0 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3a96ffd640 10 client.25301 handle_command_reply: tid=0 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 client.25301 shutdown 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 msgr2=0x555dfdf15430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf15430 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x555dfdf1ce30 tx=0x7f3aac003bb0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 shutdown_connections 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x555dfdf206f0 0x555dfdf8e450 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555dfdf10a30 0x555dfdf8a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3a96ffd640 0 client.25301 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555dfdf06170 0x555dfdf15430 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 --2- 172.21.15.77:0/2648287118 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x555dfdf05850 0x555dfdf14ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 >> 172.21.15.77:0/2648287118 conn(0x555dfdf01de0 msgr2=0x555dfdf00e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 shutdown_connections 2024-09-15T23:34:25.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 1 -- 172.21.15.77:0/2648287118 wait complete. 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.660+0000 7f3abfd6f740 20 client.25301 trim_cache size 0 max 16384 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 10, 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "86c81653": { 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 10, 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:34:25.663 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 139.6, 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "QUIESCED", 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:25.664 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:25.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:25.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:25.665 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:25.665 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:25.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 msgr2=0x7f3aa00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 0x7f3aa00a5700 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3aac031550 tx=0x7f3aac005fd0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 msgr2=0x7f3ab8197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3ab000b970 tx=0x7f3ab000be30 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 shutdown_connections 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f3aa00a3240 0x7f3aa00a5700 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f3ab8106a80 0x7f3ab8197ca0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3ab8101420 0x7f3ab8197760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 --2- 172.21.15.77:0/1722632642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ab8100a80 0x7f3ab8197220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 >> 172.21.15.77:0/1722632642 conn(0x7f3ab80fc7a0 msgr2=0x7f3ab80fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 shutdown_connections 2024-09-15T23:34:25.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:25.661+0000 7f3abd996640 1 -- 172.21.15.77:0/1722632642 wait complete. 2024-09-15T23:34:25.667 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:26.645 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '86c81653', quiesce took 9.6 seconds. Will release after: 9.950000000000001 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- 172.21.15.77:0/2389850997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 msgr2=0x7f1af010e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 --2- 172.21.15.77:0/2389850997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af010e600 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8009ca0 tx=0x7f1ae802ed60 comp rx=0 tx=0).stop 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- 172.21.15.77:0/2389850997 shutdown_connections 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 --2- 172.21.15.77:0/2389850997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af010e600 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 --2- 172.21.15.77:0/2389850997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 0x7f1af010bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.845 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 --2- 172.21.15.77:0/2389850997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- 172.21.15.77:0/2389850997 >> 172.21.15.77:0/2389850997 conn(0x7f1af00fc7d0 msgr2=0x7f1af00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- 172.21.15.77:0/2389850997 shutdown_connections 2024-09-15T23:34:26.846 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- 172.21.15.77:0/2389850997 wait complete. 2024-09-15T23:34:26.847 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 Processor -- start 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.844+0000 7f1af664a640 1 -- start start 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af01961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 0x7f1af0196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1af010fd20 con 0x7f1af010c160 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1af010fba0 con 0x7f1af0102d30 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af664a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1af010fea0 con 0x7f1af0103650 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af4be7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af4be7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40732/0 (socket says 172.21.15.77:40732) 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1af4be7640 1 -- 172.21.15.77:0/637951115 learned_addr learned my addr 172.21.15.77:0/637951115 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1aeffff640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af01961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.845+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 0x7f1af0196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.848 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 -- 172.21.15.77:0/637951115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 msgr2=0x7f1af0196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 0x7f1af0196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 -- 172.21.15.77:0/637951115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 msgr2=0x7f1af01961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af01961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 -- 172.21.15.77:0/637951115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af019b190 con 0x7f1af010c160 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1aeffff640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af01961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af4be7640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8038fd0 tx=0x7f1ae802fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1aed7fa640 1 -- 172.21.15.77:0/637951115 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae803c040 con 0x7f1af010c160 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af019b420 con 0x7f1af010c160 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1aed7fa640 1 -- 172.21.15.77:0/637951115 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae8047070 con 0x7f1af010c160 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af01a2d60 con 0x7f1af010c160 2024-09-15T23:34:26.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.846+0000 7f1aed7fa640 1 -- 172.21.15.77:0/637951115 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8004740 con 0x7f1af010c160 2024-09-15T23:34:26.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.850+0000 7f1af8a23740 1 Processor -- start 2024-09-15T23:34:26.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.850+0000 7f1aed7fa640 1 -- 172.21.15.77:0/637951115 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1ae80377f0 con 0x7f1af010c160 2024-09-15T23:34:26.851 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.850+0000 7f1af8a23740 1 -- start start 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fe71dc62f0 con 0x55fe71e605d0 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fe71d6dcf0 con 0x55fe71e6b370 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af8a23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe71dc22b0 con 0x55fe71e61b40 2024-09-15T23:34:26.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aed7fa640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 0x7f1ad80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40734/0 (socket says 172.21.15.77:40734) 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aeffff640 1 -- 172.21.15.77:0/866954661 learned_addr learned my addr 172.21.15.77:0/866954661 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.854 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aed7fa640 1 -- 172.21.15.77:0/637951115 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ae80f48f0 con 0x7f1af010c160 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1af4be7640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 0x7f1ad80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.851+0000 7f1aeffff640 1 -- 172.21.15.77:0/866954661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 msgr2=0x55fe71e60090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1aeffff640 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e60090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1aeffff640 1 -- 172.21.15.77:0/866954661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 msgr2=0x55fe71e6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1aeffff640 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1aeffff640 1 -- 172.21.15.77:0/866954661 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe71d523a0 con 0x55fe71e605d0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1aeffff640 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0010480 tx=0x7f1ae0010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889106c730662226 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1af4be7640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 0x7f1ad80a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80c92c0 tx=0x7f1ae80095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1ad67fc640 1 -- 172.21.15.77:0/866954661 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0011760 con 0x55fe71e605d0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1ad67fc640 1 -- 172.21.15.77:0/866954661 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae0011de0 con 0x55fe71e605d0 2024-09-15T23:34:26.855 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.852+0000 7f1ad67fc640 1 -- 172.21.15.77:0/866954661 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000e430 con 0x55fe71e605d0 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 -- 172.21.15.77:0/866954661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 msgr2=0x55fe71e60a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0010480 tx=0x7f1ae0010940 comp rx=0 tx=0).stop 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 -- 172.21.15.77:0/866954661 shutdown_connections 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e60a10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.859 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 --2- 172.21.15.77:0/866954661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e60090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 -- 172.21.15.77:0/866954661 >> 172.21.15.77:0/866954661 conn(0x55fe71e29310 msgr2=0x55fe71e5cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 -- 172.21.15.77:0/866954661 shutdown_connections 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.853+0000 7f1af8a23740 1 -- 172.21.15.77:0/866954661 wait complete. 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.854+0000 7f1af8a23740 1 -- start start 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.854+0000 7f1af8a23740 1 Processor -- start 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e6ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e68010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.860 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fe71e6e070 con 0x55fe71e6b370 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1aef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1aef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40736/0 (socket says 172.21.15.77:40736) 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1aef7fe640 1 -- 172.21.15.77:0/3097058319 learned_addr learned my addr 172.21.15.77:0/3097058319 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fe71d81060 con 0x55fe71e61b40 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fe71e6e1f0 con 0x55fe71e605d0 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1af8a23740 10 client.0 _ll_register_callbacks cb 0x55fe71ad48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.855+0000 7f1aeffff640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e68010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 -- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 msgr2=0x55fe71e6ad60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e6ad60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 -- 172.21.15.77:0/3097058319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 msgr2=0x55fe71e68600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:26.861 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe71b373c0 con 0x55fe71e61b40 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1aeffff640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e68010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0010e40 tx=0x7f1ae001c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dbbc8e430176ce4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1acf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0029020 con 0x55fe71e61b40 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ae0004220 con 0x55fe71e61b40 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.856+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae0011de0 con 0x55fe71e61b40 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ae0031050 con 0x55fe71e61b40 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 10 client.25313 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:26.862 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fe71e79af0 con 0x55fe71e61b40 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae0004420 con 0x55fe71e61b40 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ae0024070 con 0x55fe71e61b40 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 10 client.25313 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 10 client.25313 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 20 client.25313 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e7b370 0x55fe71e7d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 4 client.25313 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.857+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1ae0011de0 con 0x55fe71e7b370 2024-09-15T23:34:26.863 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.858+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e7b370 0x55fe71e7d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.858+0000 7f1acf7fe640 10 client.25313 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:26.864 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.858+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e7b370 0x55fe71e7d810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abf0e67179916ede server_cookie=8f181ffeb55ad963 in_seq=0 out_seq=0 2024-09-15T23:34:26.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1acf7fe640 1 -- 172.21.15.77:0/3097058319 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1ae0011de0 con 0x55fe71e7b370 2024-09-15T23:34:26.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1acf7fe640 10 client.25313 handle_command_reply: tid=0 2024-09-15T23:34:26.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 client.25313 shutdown 2024-09-15T23:34:26.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 msgr2=0x55fe71e68010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.865 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e68010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0010e40 tx=0x7f1ae001c6b0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 shutdown_connections 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e7b370 0x55fe71e7d810 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e68600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e68010 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 --2- 172.21.15.77:0/3097058319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e6ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 >> 172.21.15.77:0/3097058319 conn(0x55fe71e29310 msgr2=0x55fe71e62960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1acf7fe640 0 client.25313 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 shutdown_connections 2024-09-15T23:34:26.866 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 1 -- 172.21.15.77:0/3097058319 wait complete. 2024-09-15T23:34:26.867 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.859+0000 7f1af8a23740 20 client.25313 trim_cache size 0 max 16384 2024-09-15T23:34:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 Processor -- start 2024-09-15T23:34:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 -- start start 2024-09-15T23:34:26.878 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e63230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e63770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01aaaf0 con 0x55fe71e605d0 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01ad390 con 0x55fe71e6b370 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1af8a23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01ab180 con 0x55fe71e61b40 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1aef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1aef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:40744/0 (socket says 172.21.15.77:40744) 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.876+0000 7f1aef7fe640 1 -- 172.21.15.77:0/1541865417 learned_addr learned my addr 172.21.15.77:0/1541865417 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 -- 172.21.15.77:0/1541865417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 msgr2=0x55fe71e63230 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e63230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 -- 172.21.15.77:0/1541865417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 msgr2=0x55fe71e63770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e63770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 -- 172.21.15.77:0/1541865417 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fe71e68970 con 0x55fe71e605d0 2024-09-15T23:34:26.879 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009870 tx=0x7f1ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dedb025cfd87baf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1ad5ffb640 1 -- 172.21.15.77:0/1541865417 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4019040 con 0x55fe71e605d0 2024-09-15T23:34:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1ad5ffb640 1 -- 172.21.15.77:0/1541865417 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae40035f0 con 0x55fe71e605d0 2024-09-15T23:34:26.880 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.877+0000 7f1ad5ffb640 1 -- 172.21.15.77:0/1541865417 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4020750 con 0x55fe71e605d0 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- 172.21.15.77:0/1541865417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 msgr2=0x55fe71e77310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4009870 tx=0x7f1ae40046c0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- 172.21.15.77:0/1541865417 shutdown_connections 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e6b370 0x55fe71e63770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e61b40 0x55fe71e63230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 --2- 172.21.15.77:0/1541865417 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e605d0 0x55fe71e77310 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- 172.21.15.77:0/1541865417 >> 172.21.15.77:0/1541865417 conn(0x55fe71e29310 msgr2=0x55fe71e5c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- 172.21.15.77:0/1541865417 shutdown_connections 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- 172.21.15.77:0/1541865417 wait complete. 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.878+0000 7f1af8a23740 1 -- start start 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 Processor -- start 2024-09-15T23:34:26.885 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e83750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e82650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01ab850 con 0x55fe71e6b370 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01accc0 con 0x55fe71e61b40 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1af01abf20 con 0x55fe71e605d0 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1af8a23740 10 client.0 _ll_register_callbacks cb 0x7f1ae000bef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1aef7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e82650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1aeffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:48530/0 (socket says 172.21.15.77:48530) 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1aeffff640 1 -- 172.21.15.77:0/4041576519 learned_addr learned my addr 172.21.15.77:0/4041576519 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.879+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e83750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 -- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 msgr2=0x55fe71e83750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e83750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.886 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 -- 172.21.15.77:0/4041576519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 msgr2=0x55fe71e82650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e82650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 -- 172.21.15.77:0/4041576519 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fe71e82e80 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1aeffff640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ae001f040 tx=0x7f1ae00038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acfde76ceed46b25 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1acf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0029070 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1ae001c8a0 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ae40035f0 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1ae0010e70 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1af8a23740 10 client.25316 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.880+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fe71e733e0 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ae0043070 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1ae0024030 con 0x55fe71e61b40 2024-09-15T23:34:26.887 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 10 client.25316 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 10 client.25316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 20 client.25316 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e73b50 0x55fe71ee8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 4 client.25316 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fe71dd3860 con 0x55fe71e73b50 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.881+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e73b50 0x55fe71ee8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.882+0000 7f1acf7fe640 10 client.25316 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.882+0000 7f1aef7fe640 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e73b50 0x55fe71ee8100 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d239283c841fff1d server_cookie=8e81e768aaf9bb6d in_seq=0 out_seq=0 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.882+0000 7f1acf7fe640 1 -- 172.21.15.77:0/4041576519 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fe71dd3860 con 0x55fe71e73b50 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.882+0000 7f1acf7fe640 10 client.25316 handle_command_reply: tid=0 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.882+0000 7f1af8a23740 1 client.25316 shutdown 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 msgr2=0x55fe71e82110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1ae001f040 tx=0x7f1ae00038a0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 shutdown_connections 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fe71e73b50 0x55fe71ee8100 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fe71e6b370 0x55fe71e82650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fe71e61b40 0x55fe71e82110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 --2- 172.21.15.77:0/4041576519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fe71e605d0 0x55fe71e83750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 >> 172.21.15.77:0/4041576519 conn(0x55fe71e29310 msgr2=0x55fe71e63210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1acf7fe640 0 client.25316 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 shutdown_connections 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 1 -- 172.21.15.77:0/4041576519 wait complete. 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af8a23740 20 client.25316 trim_cache size 0 max 16384 2024-09-15T23:34:26.889 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:34:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 msgr2=0x7f1ad80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.883+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 0x7f1ad80a5700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1ae80c92c0 tx=0x7f1ae80095c0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 msgr2=0x7f1af019aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8038fd0 tx=0x7f1ae802fe50 comp rx=0 tx=0).stop 2024-09-15T23:34:26.890 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 shutdown_connections 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1ad80a3240 0x7f1ad80a5700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1af010c160 0x7f1af019aab0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1af0103650 0x7f1af0196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 --2- 172.21.15.77:0/637951115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1af0102d30 0x7f1af01961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 >> 172.21.15.77:0/637951115 conn(0x7f1af00fc7d0 msgr2=0x7f1af00fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 shutdown_connections 2024-09-15T23:34:26.891 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:26.884+0000 7f1af664a640 1 -- 172.21.15.77:0/637951115 wait complete. 2024-09-15T23:34:27.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:26 smithi077 ceph-mon[30968]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 638 MiB/s wr, 242 op/s 2024-09-15T23:34:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:26 smithi155 ceph-mon[35631]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 638 MiB/s wr, 242 op/s 2024-09-15T23:34:27.478 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:26 smithi159 ceph-mon[35472]: pgmap v436: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 638 MiB/s wr, 242 op/s 2024-09-15T23:34:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.472+0000 7f81c2a5c640 1 -- 172.21.15.77:0/4223198754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc103710 msgr2=0x7f81bc109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.485 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.472+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/4223198754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc103710 0x7f81bc109fa0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009ca0 tx=0x7f81b402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 -- 172.21.15.77:0/4223198754 shutdown_connections 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/4223198754 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc103710 0x7f81bc109fa0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/4223198754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc102d50 0x7f81bc1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/4223198754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 0x7f81bc101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 -- 172.21.15.77:0/4223198754 >> 172.21.15.77:0/4223198754 conn(0x7f81bc0fd2e0 msgr2=0x7f81bc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 -- 172.21.15.77:0/4223198754 shutdown_connections 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 -- 172.21.15.77:0/4223198754 wait complete. 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.473+0000 7f81c2a5c640 1 Processor -- start 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 -- start start 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 0x7f81bc070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc103710 0x7f81bc1a7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.486 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10d7c0 con 0x7f81bc102d50 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10d640 con 0x7f81bc103710 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c2a5c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc10d940 con 0x7f81bc101b60 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51142/0 (socket says 172.21.15.77:51142) 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 -- 172.21.15.77:0/2549946964 learned_addr learned my addr 172.21.15.77:0/2549946964 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 0x7f81bc070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc103710 0x7f81bc1a7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 -- 172.21.15.77:0/2549946964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 msgr2=0x7f81bc070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 0x7f81bc070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 -- 172.21.15.77:0/2549946964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc103710 msgr2=0x7f81bc1a7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc103710 0x7f81bc1a7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.474+0000 7f81b3fff640 1 -- 172.21.15.77:0/2549946964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81bc074120 con 0x7f81bc102d50 2024-09-15T23:34:27.487 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81b3fff640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d950 tx=0x7f81a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81b9ffb640 1 -- 172.21.15.77:0/2549946964 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4017070 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81bc1a8410 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81b9ffb640 1 -- 172.21.15.77:0/2549946964 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81a4009c30 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81b9ffb640 1 -- 172.21.15.77:0/2549946964 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a400f6b0 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.475+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81bc1a89b0 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.478+0000 7f81b9ffb640 1 -- 172.21.15.77:0/2549946964 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f81a40109d0 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81b9ffb640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 0x7f81a80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 Processor -- start 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 -- start start 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81bbfff640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 0x7f81a80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81b9ffb640 1 -- 172.21.15.77:0/2549946964 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81a40cf860 con 0x7f81bc102d50 2024-09-15T23:34:27.488 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea61fada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fb2e0 0x55fea61ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6202830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fea615e2f0 con 0x55fea6200370 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fea6106270 con 0x55fea61fb2e0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c57f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fea615a2b0 con 0x55fea61fa9a0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c0ff9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6202830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c0ff9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6202830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51152/0 (socket says 172.21.15.77:51152) 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81c0ff9640 1 -- 172.21.15.77:0/16452322 learned_addr learned my addr 172.21.15.77:0/16452322 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81bbfff640 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea61fada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.479+0000 7f81b3fff640 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fb2e0 0x55fea61ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 0x7f81a80a57b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81bc102bb0 tx=0x7f81ac00f3c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 -- 172.21.15.77:0/16452322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fb2e0 msgr2=0x55fea61ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.489 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fb2e0 0x55fea61ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 -- 172.21.15.77:0/16452322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 msgr2=0x55fea6202830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6202830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 -- 172.21.15.77:0/16452322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6105340 con 0x55fea61fa9a0 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81bbfff640 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea61fada0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81ac012520 tx=0x7f81ac01e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf5105b063585baa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81b27fc640 1 -- 172.21.15.77:0/16452322 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac01f460 con 0x55fea61fa9a0 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81b27fc640 1 -- 172.21.15.77:0/16452322 <== mon.1 v2:172.21.15.159:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ac023020 con 0x55fea61fa9a0 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.480+0000 7f81b27fc640 1 -- 172.21.15.77:0/16452322 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac010950 con 0x55fea61fa9a0 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 -- 172.21.15.77:0/16452322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 msgr2=0x55fea61fada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea61fada0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81ac012520 tx=0x7f81ac01e000 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 -- 172.21.15.77:0/16452322 shutdown_connections 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6202830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fb2e0 0x55fea61ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 --2- 172.21.15.77:0/16452322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea61fada0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.490 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 -- 172.21.15.77:0/16452322 >> 172.21.15.77:0/16452322 conn(0x55fea61f6010 msgr2=0x55fea61f6410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 -- 172.21.15.77:0/16452322 shutdown_connections 2024-09-15T23:34:27.491 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.481+0000 7f81c57f3740 1 -- 172.21.15.77:0/16452322 wait complete. 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.482+0000 7f81c57f3740 1 -- start start 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.482+0000 7f81c57f3740 1 Processor -- start 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6209480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6210450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55fea6207750 con 0x55fea6200370 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fea60e7290 con 0x55fea61fa9a0 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55fea62078d0 con 0x55fea61fb2e0 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c57f3740 10 client.0 _ll_register_callbacks cb 0x55fea6118140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:27.495 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:49964/0 (socket says 172.21.15.77:49964) 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 -- 172.21.15.77:0/3241869699 learned_addr learned my addr 172.21.15.77:0/3241869699 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6210450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 -- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 msgr2=0x55fea6209480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6209480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.483+0000 7f81bbfff640 1 -- 172.21.15.77:0/3241869699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 msgr2=0x55fea6210450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f81bbfff640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6210450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f81bbfff640 1 -- 172.21.15.77:0/3241869699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea5e71210 con 0x55fea61fa9a0 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6210450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f81bbfff640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81ac025040 tx=0x7f81ac005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2caff28df3fb782f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f819b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-15T23:34:27.496 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81ac010b20 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81ac010cc0 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.484+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81ac023020 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.485+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81ac0046c0 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.485+0000 7f81c57f3740 10 client.25328 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.485+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fea5f3d620 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81ac023020 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f81ac01f8a0 con 0x55fea61fa9a0 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 10 client.25328 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 10 client.25328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 20 client.25328 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6216c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 4 client.25328 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fea616ba20 con 0x55fea6214870 2024-09-15T23:34:27.497 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.486+0000 7f81b3fff640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6216c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.487+0000 7f819b7fe640 10 client.25328 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.487+0000 7f81b3fff640 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6216c60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0a439ca990e166a server_cookie=ad7ba6416bd45293 in_seq=0 out_seq=0 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f819b7fe640 1 -- 172.21.15.77:0/3241869699 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fea616ba20 con 0x55fea6214870 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f819b7fe640 10 client.25328 handle_command_reply: tid=0 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 client.25328 shutdown 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 msgr2=0x55fea6208f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81ac025040 tx=0x7f81ac005720 comp rx=0 tx=0).stop 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 shutdown_connections 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6216c60 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6210450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f819b7fe640 0 client.25328 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6209480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 --2- 172.21.15.77:0/3241869699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea6208f40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.498 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 >> 172.21.15.77:0/3241869699 conn(0x55fea61f6010 msgr2=0x55fea61f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 shutdown_connections 2024-09-15T23:34:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 1 -- 172.21.15.77:0/3241869699 wait complete. 2024-09-15T23:34:27.499 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.488+0000 7f81c57f3740 20 client.25328 trim_cache size 0 max 16384 2024-09-15T23:34:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 Processor -- start 2024-09-15T23:34:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 -- start start 2024-09-15T23:34:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea62084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6210410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1aec70 con 0x55fea6200370 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b14f0 con 0x55fea61fa9a0 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c57f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1af2e0 con 0x55fea61fb2e0 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c0ff9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c0ff9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51162/0 (socket says 172.21.15.77:51162) 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81c0ff9640 1 -- 172.21.15.77:0/1822646427 learned_addr learned my addr 172.21.15.77:0/1822646427 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81bbfff640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea62084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.509+0000 7f81b3fff640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6210410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 -- 172.21.15.77:0/1822646427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 msgr2=0x55fea6210410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6210410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 -- 172.21.15.77:0/1822646427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 msgr2=0x55fea62084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea62084a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 -- 172.21.15.77:0/1822646427 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fea6217240 con 0x55fea6200370 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81bbfff640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea62084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81b3fff640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6210410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009ca0 tx=0x7f81b4009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa32d606563b0428 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81b1ffb640 1 -- 172.21.15.77:0/1822646427 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b404b070 con 0x55fea6200370 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81b1ffb640 1 -- 172.21.15.77:0/1822646427 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4036040 con 0x55fea6200370 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.510+0000 7f81b1ffb640 1 -- 172.21.15.77:0/1822646427 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81b4004850 con 0x55fea6200370 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- 172.21.15.77:0/1822646427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 msgr2=0x55fea6209400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009ca0 tx=0x7f81b4009a20 comp rx=0 tx=0).stop 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- 172.21.15.77:0/1822646427 shutdown_connections 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea6200370 0x55fea6209400 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fb2e0 0x55fea6210410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 --2- 172.21.15.77:0/1822646427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea61fa9a0 0x55fea62084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- 172.21.15.77:0/1822646427 >> 172.21.15.77:0/1822646427 conn(0x55fea61f6010 msgr2=0x55fea6208cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- 172.21.15.77:0/1822646427 shutdown_connections 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- 172.21.15.77:0/1822646427 wait complete. 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.511+0000 7f81c57f3740 1 -- start start 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 Processor -- start 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea620d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea6200370 0x55fea627d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1af9b0 con 0x55fea61fb2e0 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b0e20 con 0x55fea6200370 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81bc1b0080 con 0x55fea61fa9a0 2024-09-15T23:34:27.522 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c57f3740 10 client.0 _ll_register_callbacks cb 0x7f81ac012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51170/0 (socket says 172.21.15.77:51170) 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 -- 172.21.15.77:0/878970566 learned_addr learned my addr 172.21.15.77:0/878970566 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81c0ff9640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea6200370 0x55fea627d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81bbfff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea620d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 -- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 msgr2=0x55fea620d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea620d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 -- 172.21.15.77:0/878970566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea6200370 msgr2=0x55fea627d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea6200370 0x55fea627d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 -- 172.21.15.77:0/878970566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fea6210730 con 0x55fea61fb2e0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f81b3fff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ccfd0 tx=0x7f81a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10b649281c4cca4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f819b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:27.523 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.512+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a40b4020 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81a4098210 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81b4036040 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81a4020040 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 10 client.15996 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55fea627ea30 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81b4036040 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f81a409aff0 con 0x55fea61fb2e0 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 10 client.15996 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 10 client.15996 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 20 client.15996 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6281390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 4 client.15996 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:34:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fea6165d70 con 0x55fea6214870 2024-09-15T23:34:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.513+0000 7f81bbfff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6281390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.514+0000 7f819b7fe640 10 client.15996 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.514+0000 7f81bbfff640 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6281390 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe19c4ffa345c8c8 server_cookie=104ad0a9fe67a181 in_seq=0 out_seq=0 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.524+0000 7f819b7fe640 1 -- 172.21.15.77:0/878970566 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fea6165d70 con 0x55fea6214870 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.524+0000 7f819b7fe640 10 client.15996 handle_command_reply: tid=0 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.524+0000 7f81c57f3740 1 client.15996 shutdown 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 msgr2=0x55fea620d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f81a40ccfd0 tx=0x7f81a4005880 comp rx=0 tx=0).stop 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 shutdown_connections 2024-09-15T23:34:27.527 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55fea6214870 0x55fea6281390 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fea6200370 0x55fea627d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55fea61fb2e0 0x55fea620d640 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 --2- 172.21.15.77:0/878970566 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55fea61fa9a0 0x55fea620d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 >> 172.21.15.77:0/878970566 conn(0x55fea61f6010 msgr2=0x55fea61f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f819b7fe640 0 client.15996 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 shutdown_connections 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 1 -- 172.21.15.77:0/878970566 wait complete. 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.525+0000 7f81c57f3740 20 client.15996 trim_cache size 0 max 16384 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:34:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:34:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:34:27.529 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:34:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 msgr2=0x7f81a80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 0x7f81a80a57b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f81bc102bb0 tx=0x7f81ac00f3c0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 msgr2=0x7f81bc070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f81a400d950 tx=0x7f81a400de10 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 shutdown_connections 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81a80a32f0 0x7f81a80a57b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81bc103710 0x7f81bc1a7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81bc102d50 0x7f81bc070fa0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 --2- 172.21.15.77:0/2549946964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81bc101b60 0x7f81bc070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 >> 172.21.15.77:0/2549946964 conn(0x7f81bc0fd2e0 msgr2=0x7f81bc105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 shutdown_connections 2024-09-15T23:34:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:27.526+0000 7f81c2a5c640 1 -- 172.21.15.77:0/2549946964 wait complete. 2024-09-15T23:34:28.703 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-15T23:34:28.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-15T23:34:29.037 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:29.132 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:28 smithi077 ceph-mon[30968]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 464 MiB/s wr, 134 op/s 2024-09-15T23:34:29.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:28 smithi155 ceph-mon[35631]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 464 MiB/s wr, 134 op/s 2024-09-15T23:34:29.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:28 smithi159 ceph-mon[35472]: pgmap v437: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 464 MiB/s wr, 134 op/s 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 -- 172.21.15.77:0/505750755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754100e20 msgr2=0x7f9754101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 --2- 172.21.15.77:0/505750755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754100e20 0x7f9754101200 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9744009900 tx=0x7f974402a4a0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 -- 172.21.15.77:0/505750755 shutdown_connections 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 --2- 172.21.15.77:0/505750755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754102ef0 0x7f975410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 --2- 172.21.15.77:0/505750755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 0x7f97541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 --2- 172.21.15.77:0/505750755 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754100e20 0x7f9754101200 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 -- 172.21.15.77:0/505750755 >> 172.21.15.77:0/505750755 conn(0x7f97540fc7d0 msgr2=0x7f97540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 -- 172.21.15.77:0/505750755 shutdown_connections 2024-09-15T23:34:29.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.577+0000 7f975a6e9640 1 -- 172.21.15.77:0/505750755 wait complete. 2024-09-15T23:34:29.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.578+0000 7f975a6e9640 1 Processor -- start 2024-09-15T23:34:29.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.578+0000 7f975a6e9640 1 -- start start 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754100e20 0x7f9754199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 0x7f97541999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9754110fc0 con 0x7f9754102ef0 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9754110e40 con 0x7f9754100e20 2024-09-15T23:34:29.581 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f975a6e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9754111140 con 0x7f9754102570 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51180/0 (socket says 172.21.15.77:51180) 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f9758c86640 1 -- 172.21.15.77:0/3063494925 learned_addr learned my addr 172.21.15.77:0/3063494925 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f97537fe640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 0x7f97541999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.579+0000 7f9753fff640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754100e20 0x7f9754199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 -- 172.21.15.77:0/3063494925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 msgr2=0x7f97541999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 0x7f97541999a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 -- 172.21.15.77:0/3063494925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754100e20 msgr2=0x7f9754199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754100e20 0x7f9754199460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 -- 172.21.15.77:0/3063494925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97541a4a20 con 0x7f9754102ef0 2024-09-15T23:34:29.582 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f9758c86640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f974c00eaa0 tx=0x7f974c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f97517fa640 1 -- 172.21.15.77:0/3063494925 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c00cdb0 con 0x7f9754102ef0 2024-09-15T23:34:29.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97541a4bf0 con 0x7f9754102ef0 2024-09-15T23:34:29.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f97517fa640 1 -- 172.21.15.77:0/3063494925 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974c005020 con 0x7f9754102ef0 2024-09-15T23:34:29.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f97517fa640 1 -- 172.21.15.77:0/3063494925 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c0116b0 con 0x7f9754102ef0 2024-09-15T23:34:29.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.580+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97541a5100 con 0x7f9754102ef0 2024-09-15T23:34:29.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.583+0000 7f97517fa640 1 -- 172.21.15.77:0/3063494925 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f974c005560 con 0x7f9754102ef0 2024-09-15T23:34:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.583+0000 7f97517fa640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 0x7f973c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.584+0000 7f9753fff640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 0x7f973c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.585 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.584+0000 7f97517fa640 1 -- 172.21.15.77:0/3063494925 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f974c0cfef0 con 0x7f9754102ef0 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.584+0000 7f9753fff640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 0x7f973c0a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9744005940 tx=0x7f97440058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.584+0000 7f975cac2740 1 Processor -- start 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.584+0000 7f975cac2740 1 -- start start 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac139c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac13c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac090280 con 0x55c7ac12aa20 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac037b10 con 0x55c7ac12b340 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f975cac2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac08c240 con 0x55c7ac13a150 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51186/0 (socket says 172.21.15.77:51186) 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 -- 172.21.15.77:0/2712749564 learned_addr learned my addr 172.21.15.77:0/2712749564 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9758c86640 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac13c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 -- 172.21.15.77:0/2712749564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 msgr2=0x55c7ac13c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac13c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 -- 172.21.15.77:0/2712749564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 msgr2=0x55c7ac139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 -- 172.21.15.77:0/2712749564 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ac0441f0 con 0x55c7ac12aa20 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.585+0000 7f9753fff640 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9744033000 tx=0x7f974403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f62c05f3b22e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.586+0000 7f973a7fc640 1 -- 172.21.15.77:0/2712749564 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744035050 con 0x55c7ac12aa20 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.586+0000 7f973a7fc640 1 -- 172.21.15.77:0/2712749564 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974404d070 con 0x55c7ac12aa20 2024-09-15T23:34:29.588 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.586+0000 7f973a7fc640 1 -- 172.21.15.77:0/2712749564 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744003e40 con 0x55c7ac12aa20 2024-09-15T23:34:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.586+0000 7f975cac2740 1 -- 172.21.15.77:0/2712749564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 msgr2=0x55c7ac12ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.586+0000 7f975cac2740 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f9744033000 tx=0x7f974403c000 comp rx=0 tx=0).stop 2024-09-15T23:34:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 -- 172.21.15.77:0/2712749564 shutdown_connections 2024-09-15T23:34:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac13c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.591 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 --2- 172.21.15.77:0/2712749564 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac12ae00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 -- 172.21.15.77:0/2712749564 >> 172.21.15.77:0/2712749564 conn(0x55c7ac1270f0 msgr2=0x55c7ac1274d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 -- 172.21.15.77:0/2712749564 shutdown_connections 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 -- 172.21.15.77:0/2712749564 wait complete. 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 -- start start 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.587+0000 7f975cac2740 1 Processor -- start 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac137090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac1375d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac137b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac13ccc0 con 0x55c7ac12aa20 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac04af10 con 0x55c7ac12b340 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55c7ac13ce40 con 0x55c7ac13a150 2024-09-15T23:34:29.592 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f975cac2740 10 client.0 _ll_register_callbacks cb 0x55c7ac013a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac137090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9753fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac137090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51194/0 (socket says 172.21.15.77:51194) 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f97537fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac1375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9753fff640 1 -- 172.21.15.77:0/3928703807 learned_addr learned my addr 172.21.15.77:0/3928703807 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac137b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.593 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 -- 172.21.15.77:0/3928703807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 msgr2=0x55c7ac1375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac1375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 -- 172.21.15.77:0/3928703807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 msgr2=0x55c7ac137090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac137090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 -- 172.21.15.77:0/3928703807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7abe016a0 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f97537fe640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac1375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f9758c86640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac137b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f974c009270 tx=0x7f974c09c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a0531440db862c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.588+0000 7f97337fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c0b5060 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f974c0a0170 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f974404d070 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f974c01f070 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 10 client.25393 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7ac1489c0 con 0x55c7ac13a150 2024-09-15T23:34:29.594 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974404d070 con 0x55c7ac13a150 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f974c00f040 con 0x55c7ac13a150 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 10 client.25393 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 10 client.25393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 20 client.25393 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac149e80 0x55c7ac14c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 4 client.25393 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.589+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c7ac09d7f0 con 0x55c7ac149e80 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.590+0000 7f9753fff640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac149e80 0x55c7ac14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.590+0000 7f97337fe640 10 client.25393 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:29.595 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.590+0000 7f9753fff640 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac149e80 0x55c7ac14c270 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a43936c43f92d64c server_cookie=b9ce6bf756eda7d3 in_seq=0 out_seq=0 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f97337fe640 1 -- 172.21.15.77:0/3928703807 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c7ac09d7f0 con 0x55c7ac149e80 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f97337fe640 10 client.25393 handle_command_reply: tid=0 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 client.25393 shutdown 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 msgr2=0x55c7ac137b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac137b10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f974c009270 tx=0x7f974c09c300 comp rx=0 tx=0).stop 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 shutdown_connections 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac149e80 0x55c7ac14c270 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac13a150 0x55c7ac137b10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12b340 0x55c7ac1375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 --2- 172.21.15.77:0/3928703807 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac12aa20 0x55c7ac137090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f97337fe640 0 client.25393 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:29.597 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 >> 172.21.15.77:0/3928703807 conn(0x55c7ac1270f0 msgr2=0x55c7ac12ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 shutdown_connections 2024-09-15T23:34:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 1 -- 172.21.15.77:0/3928703807 wait complete. 2024-09-15T23:34:29.598 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.591+0000 7f975cac2740 20 client.25393 trim_cache size 0 max 16384 2024-09-15T23:34:29.617 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.615+0000 7f975cac2740 1 Processor -- start 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.615+0000 7f975cac2740 1 -- start start 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.615+0000 7f975cac2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.615+0000 7f975cac2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f975cac2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f975cac2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97541aaaf0 con 0x55c7ac13a150 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f975cac2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97541ad370 con 0x55c7ac12aa20 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f975cac2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f97541ab160 con 0x55c7ac12b340 2024-09-15T23:34:29.618 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51198/0 (socket says 172.21.15.77:51198) 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 -- 172.21.15.77:0/1733885774 learned_addr learned my addr 172.21.15.77:0/1733885774 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f97537fe640 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 -- 172.21.15.77:0/1733885774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 msgr2=0x55c7ac152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 -- 172.21.15.77:0/1733885774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 msgr2=0x55c7ac151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 -- 172.21.15.77:0/1733885774 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7ac14c5e0 con 0x55c7ac13a150 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9758c86640 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f974c0d0210 tx=0x7f974c0053e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17eae9ca1f8a4c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.616+0000 7f9739ffb640 1 -- 172.21.15.77:0/1733885774 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c0b5050 con 0x55c7ac13a150 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f9739ffb640 1 -- 172.21.15.77:0/1733885774 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974c0987f0 con 0x55c7ac13a150 2024-09-15T23:34:29.619 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f9739ffb640 1 -- 172.21.15.77:0/1733885774 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f974c097f20 con 0x55c7ac13a150 2024-09-15T23:34:29.622 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 -- 172.21.15.77:0/1733885774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 msgr2=0x55c7ac1342f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f974c0d0210 tx=0x7f974c0053e0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 -- 172.21.15.77:0/1733885774 shutdown_connections 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac1342f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 --2- 172.21.15.77:0/1733885774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 -- 172.21.15.77:0/1733885774 >> 172.21.15.77:0/1733885774 conn(0x55c7ac1270f0 msgr2=0x55c7ac126270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.617+0000 7f975cac2740 1 -- 172.21.15.77:0/1733885774 shutdown_connections 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 -- 172.21.15.77:0/1733885774 wait complete. 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 -- start start 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 Processor -- start 2024-09-15T23:34:29.623 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac142230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac142770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac13e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f97541ab830 con 0x55c7ac13a150 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97541acca0 con 0x55c7ac12aa20 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f97541abf00 con 0x55c7ac12b340 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.618+0000 7f975cac2740 10 client.0 _ll_register_callbacks cb 0x7f974c09bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac13e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f9758c86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac13e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51202/0 (socket says 172.21.15.77:51202) 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f9758c86640 1 -- 172.21.15.77:0/3009577911 learned_addr learned my addr 172.21.15.77:0/3009577911 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f9753fff640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.624 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 -- 172.21.15.77:0/3009577911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 msgr2=0x55c7ac142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac142230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 -- 172.21.15.77:0/3009577911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 msgr2=0x55c7ac13e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac13e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 -- 172.21.15.77:0/3009577911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7ac13ee30 con 0x55c7ac12b340 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f9753fff640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97537fe640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac142770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c7ac1386d0 tx=0x7f9748014e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560332987fd20868 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.619+0000 7f97337fe640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mon.1 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748022060 con 0x55c7ac12b340 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f974c0987f0 con 0x55c7ac12b340 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mon.1 v2:172.21.15.159:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9748012bf0 con 0x55c7ac12b340 2024-09-15T23:34:29.625 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mon.1 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f9748029050 con 0x55c7ac12b340 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f975cac2740 10 client.25399 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55c7ac1b56e0 con 0x55c7ac12b340 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.620+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mon.1 v2:172.21.15.159:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f974c0987f0 con 0x55c7ac12b340 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mon.1 v2:172.21.15.159:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f9748015420 con 0x55c7ac12b340 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 10 client.25399 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 10 client.25399 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 20 client.25399 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac1b5db0 0x55c7ac1b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 4 client.25399 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c7ac097d00 con 0x55c7ac1b5db0 2024-09-15T23:34:29.626 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.621+0000 7f9753fff640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac1b5db0 0x55c7ac1b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.622+0000 7f9753fff640 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac1b5db0 0x55c7ac1b81d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5415ae6a66864722 server_cookie=3db473322d1ce6b1 in_seq=0 out_seq=0 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.622+0000 7f97337fe640 10 client.25399 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.623+0000 7f97337fe640 1 -- 172.21.15.77:0/3009577911 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c7ac097d00 con 0x55c7ac1b5db0 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f97337fe640 10 client.25399 handle_command_reply: tid=0 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 client.25399 shutdown 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 msgr2=0x55c7ac142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac142770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55c7ac1386d0 tx=0x7f9748014e30 comp rx=0 tx=0).stop 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 shutdown_connections 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55c7ac1b5db0 0x55c7ac1b81d0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.628 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55c7ac13a150 0x55c7ac13e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55c7ac12b340 0x55c7ac142770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 --2- 172.21.15.77:0/3009577911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c7ac12aa20 0x55c7ac142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 >> 172.21.15.77:0/3009577911 conn(0x55c7ac1270f0 msgr2=0x55c7ac125a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.624+0000 7f97337fe640 0 client.25399 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 shutdown_connections 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975cac2740 1 -- 172.21.15.77:0/3009577911 wait complete. 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975cac2740 20 client.25399 trim_cache size 0 max 16384 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "return_code": 0, 2024-09-15T23:34:29.629 INFO:teuthology.orchestra.run.smithi077.stdout: "scrub_tag": "b218d833-a811-491b-83f3-19c3c8593764", 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": "asynchronous" 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 msgr2=0x7f973c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 0x7f973c0a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9744005940 tx=0x7f97440058b0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 msgr2=0x7f97541a44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.625+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f974c00eaa0 tx=0x7f974c00ef60 comp rx=0 tx=0).stop 2024-09-15T23:34:29.630 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 shutdown_connections 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f973c0a3240 0x7f973c0a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9754102ef0 0x7f97541a44e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9754102570 0x7f97541999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 --2- 172.21.15.77:0/3063494925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9754100e20 0x7f9754199460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 >> 172.21.15.77:0/3063494925 conn(0x7f97540fc7d0 msgr2=0x7f97540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 shutdown_connections 2024-09-15T23:34:29.631 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:29.626+0000 7f975a6e9640 1 -- 172.21.15.77:0/3063494925 wait complete. 2024-09-15T23:34:30.519 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:34:30.842 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:31.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:30 smithi077 ceph-mon[30968]: scrub queued for path: / 2024-09-15T23:34:31.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:30 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:30 smithi077 ceph-mon[30968]: scrub summary: active paths [/] 2024-09-15T23:34:31.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:30 smithi077 ceph-mon[30968]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.322 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:30 smithi077 ceph-mon[30968]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 MiB/s rd, 439 MiB/s wr, 148 op/s 2024-09-15T23:34:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:30 smithi155 ceph-mon[35631]: scrub queued for path: / 2024-09-15T23:34:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:30 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:30 smithi155 ceph-mon[35631]: scrub summary: active paths [/] 2024-09-15T23:34:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:30 smithi155 ceph-mon[35631]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:30 smithi155 ceph-mon[35631]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 MiB/s rd, 439 MiB/s wr, 148 op/s 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 -- 172.21.15.77:0/3767080669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102570 msgr2=0x7fea541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 --2- 172.21.15.77:0/3767080669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102570 0x7fea541029b0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fea48009900 tx=0x7fea4802a480 comp rx=0 tx=0).stop 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 -- 172.21.15.77:0/3767080669 shutdown_connections 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 --2- 172.21.15.77:0/3767080669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102ef0 0x7fea5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 --2- 172.21.15.77:0/3767080669 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102570 0x7fea541029b0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 --2- 172.21.15.77:0/3767080669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 -- 172.21.15.77:0/3767080669 >> 172.21.15.77:0/3767080669 conn(0x7fea540fc7d0 msgr2=0x7fea540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.437 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 -- 172.21.15.77:0/3767080669 shutdown_connections 2024-09-15T23:34:31.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.435+0000 7fea5a857640 1 -- 172.21.15.77:0/3767080669 wait complete. 2024-09-15T23:34:31.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.436+0000 7fea5a857640 1 Processor -- start 2024-09-15T23:34:31.438 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.436+0000 7fea5a857640 1 -- start start 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.437+0000 7fea5a857640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54073b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea5a857640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 0x7fea5406eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea5a857640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea5a857640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea54110ff0 con 0x7fea54102ef0 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea5a857640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea54110e70 con 0x7fea54102570 2024-09-15T23:34:31.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea5a857640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea54111170 con 0x7fea54100e20 2024-09-15T23:34:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51218/0 (socket says 172.21.15.77:51218) 2024-09-15T23:34:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 -- 172.21.15.77:0/1304897961 learned_addr learned my addr 172.21.15.77:0/1304897961 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea537fe640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 0x7fea5406eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.440 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea53fff640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54073b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 -- 172.21.15.77:0/1304897961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 msgr2=0x7fea54073b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54073b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 -- 172.21.15.77:0/1304897961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 msgr2=0x7fea5406eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 0x7fea5406eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea58df4640 1 -- 172.21.15.77:0/1304897961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea5406f620 con 0x7fea54102ef0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea537fe640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 0x7fea5406eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.438+0000 7fea53fff640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea58df4640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ead0 tx=0x7fea4c00eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea517fa640 1 -- 172.21.15.77:0/1304897961 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c004d20 con 0x7fea54102ef0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea5406f910 con 0x7fea54102ef0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea541ad7f0 con 0x7fea54102ef0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea517fa640 1 -- 172.21.15.77:0/1304897961 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4c005020 con 0x7fea54102ef0 2024-09-15T23:34:31.441 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.439+0000 7fea517fa640 1 -- 172.21.15.77:0/1304897961 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0116d0 con 0x7fea54102ef0 2024-09-15T23:34:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.442+0000 7fea5cc30740 1 Processor -- start 2024-09-15T23:34:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.442+0000 7fea517fa640 1 -- 172.21.15.77:0/1304897961 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fea4c011870 con 0x7fea54102ef0 2024-09-15T23:34:31.443 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.442+0000 7fea5cc30740 1 -- start start 2024-09-15T23:34:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.442+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.444 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea5cc30740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559c4c8122e0 con 0x559c4c8ac4a0 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea5cc30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559c4c7b9ce0 con 0x559c4c8acdc0 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea5cc30740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559c4c80e2a0 con 0x559c4c8b7680 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea53fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea53fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.77:50070/0 (socket says 172.21.15.77:50070) 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea53fff640 1 -- 172.21.15.77:0/1849366191 learned_addr learned my addr 172.21.15.77:0/1849366191 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea537fe640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.445 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea537fe640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea517fa640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 0x7fea3c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.443+0000 7fea58df4640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 0x7fea3c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 -- 172.21.15.77:0/1849366191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 msgr2=0x559c4c8b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 -- 172.21.15.77:0/1849366191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 msgr2=0x559c4c8ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 -- 172.21.15.77:0/1849366191 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4c79e440 con 0x559c4c8acdc0 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea537fe640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea517fa640 1 -- 172.21.15.77:0/1304897961 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea4c0cfc90 con 0x7fea54102ef0 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea53fff640 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea44009e70 tx=0x7fea4400e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d245646cca7636af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.447 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea58df4640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 0x7fea3c0a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea4c097c00 tx=0x7fea4c097a90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea3a7fc640 1 -- 172.21.15.77:0/1849366191 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44017070 con 0x559c4c8acdc0 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea3a7fc640 1 -- 172.21.15.77:0/1849366191 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea44013950 con 0x559c4c8acdc0 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.444+0000 7fea3a7fc640 1 -- 172.21.15.77:0/1849366191 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea44012a10 con 0x559c4c8acdc0 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 -- 172.21.15.77:0/1849366191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 msgr2=0x559c4c8b7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fea44009e70 tx=0x7fea4400e5a0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 -- 172.21.15.77:0/1849366191 shutdown_connections 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8b7140 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 --2- 172.21.15.77:0/1849366191 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 -- 172.21.15.77:0/1849366191 >> 172.21.15.77:0/1849366191 conn(0x559c4c8a8a30 msgr2=0x559c4c8a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 -- 172.21.15.77:0/1849366191 shutdown_connections 2024-09-15T23:34:31.448 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.445+0000 7fea5cc30740 1 -- 172.21.15.77:0/1849366191 wait complete. 2024-09-15T23:34:31.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 -- start start 2024-09-15T23:34:31.449 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 Processor -- start 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8acdc0 0x559c4c8b41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8b7680 0x559c4c8b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x559c4c8ba250 con 0x559c4c8ac4a0 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559c4c7cd050 con 0x559c4c8b7680 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x559c4c8ba3d0 con 0x559c4c8acdc0 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea5cc30740 10 client.0 _ll_register_callbacks cb 0x559c4c80d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51228/0 (socket says 172.21.15.77:51228) 2024-09-15T23:34:31.451 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.446+0000 7fea537fe640 1 -- 172.21.15.77:0/2257226799 learned_addr learned my addr 172.21.15.77:0/2257226799 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8b7680 0x559c4c8b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea53fff640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8acdc0 0x559c4c8b41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 -- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8acdc0 msgr2=0x559c4c8b41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8acdc0 0x559c4c8b41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 -- 172.21.15.77:0/2257226799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8b7680 msgr2=0x559c4c8b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8b7680 0x559c4c8b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 -- 172.21.15.77:0/2257226799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4c5833c0 con 0x559c4c8ac4a0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea537fe640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea48009230 tx=0x7fea48041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94680a3ba351cb78 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea337fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48035070 con 0x559c4c8ac4a0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea48048040 con 0x559c4c8ac4a0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea44013950 con 0x559c4c8ac4a0 2024-09-15T23:34:31.452 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea48031810 con 0x559c4c8ac4a0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea5cc30740 10 client.16026 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.447+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559c4c8c5ba0 con 0x559c4c8ac4a0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea44013950 con 0x559c4c8ac4a0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea4803da10 con 0x559c4c8ac4a0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 10 client.16026 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 20 client.16026 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c8c6fb0 0x559c4c8c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 4 client.16026 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.448+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c4c81f850 con 0x559c4c8c6fb0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.449+0000 7fea53fff640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c8c6fb0 0x559c4c8c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.450+0000 7fea53fff640 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c8c6fb0 0x559c4c8c9410 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88ae831bcf8b5031 server_cookie=23cca25d103d2de7 in_seq=0 out_seq=0 2024-09-15T23:34:31.453 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.450+0000 7fea337fe640 10 client.16026 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:31.454 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.451+0000 7fea337fe640 1 -- 172.21.15.77:0/2257226799 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559c4c81f850 con 0x559c4c8c6fb0 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.451+0000 7fea337fe640 10 client.16026 handle_command_reply: tid=0 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.451+0000 7fea5cc30740 1 client.16026 shutdown 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 msgr2=0x559c4c8b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fea48009230 tx=0x7fea48041040 comp rx=0 tx=0).stop 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 shutdown_connections 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c8c6fb0 0x559c4c8c9410 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8b7680 0x559c4c8b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8acdc0 0x559c4c8b41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea337fe640 0 client.16026 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 --2- 172.21.15.77:0/2257226799 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b6ef0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 >> 172.21.15.77:0/2257226799 conn(0x559c4c8a8a30 msgr2=0x559c4c8a7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 shutdown_connections 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 1 -- 172.21.15.77:0/2257226799 wait complete. 2024-09-15T23:34:31.455 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.452+0000 7fea5cc30740 20 client.16026 trim_cache size 0 max 16384 2024-09-15T23:34:31.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:30 smithi159 ceph-mon[35472]: scrub queued for path: / 2024-09-15T23:34:31.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:30 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:30 smithi159 ceph-mon[35472]: scrub summary: active paths [/] 2024-09-15T23:34:31.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:30 smithi159 ceph-mon[35472]: scrub summary: idle+waiting paths [/] 2024-09-15T23:34:31.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:30 smithi159 ceph-mon[35472]: pgmap v438: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 MiB/s rd, 439 MiB/s wr, 148 op/s 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.474+0000 7fea5cc30740 1 Processor -- start 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 -- start start 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8cf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000db80 con 0x559c4c8ac4a0 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea40010400 con 0x559c4c8acdc0 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea5cc30740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000e1f0 con 0x559c4c8b7680 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51236/0 (socket says 172.21.15.77:51236) 2024-09-15T23:34:31.477 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 -- 172.21.15.77:0/460523275 learned_addr learned my addr 172.21.15.77:0/460523275 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 -- 172.21.15.77:0/460523275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 msgr2=0x559c4c8cf220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8cf220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 -- 172.21.15.77:0/460523275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 msgr2=0x559c4c8cece0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8cece0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.475+0000 7fea537fe640 1 -- 172.21.15.77:0/460523275 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c4c8b3150 con 0x559c4c8ac4a0 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.476+0000 7fea537fe640 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fea48000c00 tx=0x7fea4802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b0d61870aedcf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.476+0000 7fea39ffb640 1 -- 172.21.15.77:0/460523275 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48035070 con 0x559c4c8ac4a0 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.476+0000 7fea39ffb640 1 -- 172.21.15.77:0/460523275 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4803c470 con 0x559c4c8ac4a0 2024-09-15T23:34:31.478 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.476+0000 7fea39ffb640 1 -- 172.21.15.77:0/460523275 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea4803cc00 con 0x559c4c8ac4a0 2024-09-15T23:34:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- 172.21.15.77:0/460523275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 msgr2=0x559c4c8b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fea48000c00 tx=0x7fea4802a480 comp rx=0 tx=0).stop 2024-09-15T23:34:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- 172.21.15.77:0/460523275 shutdown_connections 2024-09-15T23:34:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8b7680 0x559c4c8cf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.480 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 --2- 172.21.15.77:0/460523275 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8ac4a0 0x559c4c8b2a70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- 172.21.15.77:0/460523275 >> 172.21.15.77:0/460523275 conn(0x559c4c8a8a30 msgr2=0x559c4c8a7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- 172.21.15.77:0/460523275 shutdown_connections 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- 172.21.15.77:0/460523275 wait complete. 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 -- start start 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.477+0000 7fea5cc30740 1 Processor -- start 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8ac4a0 0x559c4c8bd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8bdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000e8c0 con 0x559c4c8b7680 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000fd30 con 0x559c4c8acdc0 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea4000ef90 con 0x559c4c8ac4a0 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea5cc30740 10 client.0 _ll_register_callbacks cb 0x7fea48005d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:31.481 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51244/0 (socket says 172.21.15.77:51244) 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 -- 172.21.15.77:0/972783161 learned_addr learned my addr 172.21.15.77:0/972783161 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 -- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8ac4a0 msgr2=0x559c4c8bd6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8ac4a0 0x559c4c8bd6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 -- 172.21.15.77:0/972783161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 msgr2=0x559c4c8bdc30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8bdc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 -- 172.21.15.77:0/972783161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c4c930f90 con 0x559c4c8b7680 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea537fe640 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fea4803dfd0 tx=0x7fea4803cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185267a7b2dd492a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.478+0000 7fea337fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48035040 con 0x559c4c8b7680 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fea48004760 con 0x559c4c8b7680 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fea4803c470 con 0x559c4c8b7680 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fea4803c620 con 0x559c4c8b7680 2024-09-15T23:34:31.482 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 10 client.16032 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:31.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x559c4c9322a0 con 0x559c4c8b7680 2024-09-15T23:34:31.483 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea4803c470 con 0x559c4c8b7680 2024-09-15T23:34:31.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fea4804c420 con 0x559c4c8b7680 2024-09-15T23:34:31.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 10 client.16032 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:31.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:31.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 20 client.16032 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:31.484 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.479+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c9328a0 0x559c4c934c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.480+0000 7fea5cc30740 4 client.16032 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.480+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559c4c819d60 con 0x559c4c9328a0 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.481+0000 7fea53fff640 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c9328a0 0x559c4c934c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.481+0000 7fea53fff640 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c9328a0 0x559c4c934c90 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e75fdadaeecc5ca server_cookie=c1cba25638f24622 in_seq=0 out_seq=0 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.481+0000 7fea337fe640 10 client.16032 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.481+0000 7fea337fe640 1 -- 172.21.15.77:0/972783161 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559c4c819d60 con 0x559c4c9328a0 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.481+0000 7fea337fe640 10 client.16032 handle_command_reply: tid=0 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 client.16032 shutdown 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 msgr2=0x559c4c8be190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fea4803dfd0 tx=0x7fea4803cbb0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 shutdown_connections 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x559c4c9328a0 0x559c4c934c90 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.485 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x559c4c8b7680 0x559c4c8be190 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559c4c8acdc0 0x559c4c8bdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea337fe640 0 client.16032 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 --2- 172.21.15.77:0/972783161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x559c4c8ac4a0 0x559c4c8bd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 >> 172.21.15.77:0/972783161 conn(0x559c4c8a8a30 msgr2=0x559c4c8b5a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 shutdown_connections 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 1 -- 172.21.15.77:0/972783161 wait complete. 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.482+0000 7fea5cc30740 20 client.16032 trim_cache size 0 max 16384 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": { 2024-09-15T23:34:31.486 INFO:teuthology.orchestra.run.smithi077.stdout: "b218d833-a811-491b-83f3-19c3c8593764": { 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout: "path": "/", 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout: "tag": "b218d833-a811-491b-83f3-19c3c8593764", 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout: "options": "recursive,force" 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:31.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 msgr2=0x7fea3c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 0x7fea3c0a5780 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fea4c097c00 tx=0x7fea4c097a90 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 msgr2=0x7fea5406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00ead0 tx=0x7fea4c00eed0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 shutdown_connections 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fea3c0a32c0 0x7fea3c0a5780 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fea54102ef0 0x7fea5406f060 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea54102570 0x7fea5406eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 --2- 172.21.15.77:0/1304897961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea54100e20 0x7fea54073b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 >> 172.21.15.77:0/1304897961 conn(0x7fea540fc7d0 msgr2=0x7fea54105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 shutdown_connections 2024-09-15T23:34:31.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:31.483+0000 7fea5a857640 1 -- 172.21.15.77:0/1304897961 wait complete. 2024-09-15T23:34:32.298 INFO:tasks.cephfs.filesystem:scrub status for tag:b218d833-a811-491b-83f3-19c3c8593764 - {'path': '/', 'tag': 'b218d833-a811-491b-83f3-19c3c8593764', 'options': 'recursive,force'} 2024-09-15T23:34:33.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:32 smithi155 ceph-mon[35631]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 317 MiB/s wr, 164 op/s 2024-09-15T23:34:33.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:32 smithi155 ceph-mon[35631]: scrub summary: idle 2024-09-15T23:34:33.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:32 smithi077 ceph-mon[30968]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 317 MiB/s wr, 164 op/s 2024-09-15T23:34:33.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:32 smithi077 ceph-mon[30968]: scrub summary: idle 2024-09-15T23:34:33.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:32 smithi159 ceph-mon[35472]: pgmap v439: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 262 MiB/s rd, 317 MiB/s wr, 164 op/s 2024-09-15T23:34:33.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:32 smithi159 ceph-mon[35472]: scrub summary: idle 2024-09-15T23:34:35.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:34 smithi155 ceph-mon[35631]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 MiB/s rd, 91 MiB/s wr, 112 op/s 2024-09-15T23:34:35.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:34 smithi077 ceph-mon[30968]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 MiB/s rd, 91 MiB/s wr, 112 op/s 2024-09-15T23:34:35.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:34 smithi159 ceph-mon[35472]: pgmap v440: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 332 MiB/s rd, 91 MiB/s wr, 112 op/s 2024-09-15T23:34:36.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:35 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:34:36.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:35 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:34:36.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:35 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-15T23:34:36.597 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:36.939 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:37.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:36 smithi077 ceph-mon[30968]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 MiB/s rd, 32 MiB/s wr, 176 op/s 2024-09-15T23:34:37.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:34:37.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:34:37.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:36 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:34:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:36 smithi155 ceph-mon[35631]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 MiB/s rd, 32 MiB/s wr, 176 op/s 2024-09-15T23:34:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:34:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:34:37.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:36 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:34:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:36 smithi159 ceph-mon[35472]: pgmap v441: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 642 MiB/s rd, 32 MiB/s wr, 176 op/s 2024-09-15T23:34:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-15T23:34:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-15T23:34:37.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:36 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.485+0000 7f986f41a640 1 -- 172.21.15.77:0/964841672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868100de0 msgr2=0x7f9868104e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 --2- 172.21.15.77:0/964841672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868100de0 0x7f9868104e30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9858009900 tx=0x7f985802a410 comp rx=0 tx=0).stop 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 -- 172.21.15.77:0/964841672 shutdown_connections 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 --2- 172.21.15.77:0/964841672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868105560 0x7f986810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 --2- 172.21.15.77:0/964841672 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868100de0 0x7f9868104e30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.487 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 --2- 172.21.15.77:0/964841672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 0x7f9868100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 -- 172.21.15.77:0/964841672 >> 172.21.15.77:0/964841672 conn(0x7f9868077230 msgr2=0x7f98680fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:37.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 -- 172.21.15.77:0/964841672 shutdown_connections 2024-09-15T23:34:37.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.486+0000 7f986f41a640 1 -- 172.21.15.77:0/964841672 wait complete. 2024-09-15T23:34:37.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 Processor -- start 2024-09-15T23:34:37.488 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 -- start start 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 0x7f9868110b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868100de0 0x7f98681110c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f986810dd30 con 0x7f9868105560 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f986810dbb0 con 0x7f9868100430 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.487+0000 7f986f41a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f986810deb0 con 0x7f9868100de0 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33100/0 (socket says 172.21.15.77:33100) 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 -- 172.21.15.77:0/3470087434 learned_addr learned my addr 172.21.15.77:0/3470087434 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986c9b5640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868100de0 0x7f98681110c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:37.490 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d1b6640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 0x7f9868110b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 -- 172.21.15.77:0/3470087434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868100de0 msgr2=0x7f98681110c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868100de0 0x7f98681110c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 -- 172.21.15.77:0/3470087434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 msgr2=0x7f9868110b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 0x7f9868110b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 -- 172.21.15.77:0/3470087434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98681a68a0 con 0x7f9868105560 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.488+0000 7f986d9b7640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f986000cad0 tx=0x7f986000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.489+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986000ae20 con 0x7f9868105560 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.489+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9860005020 con 0x7f9868105560 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.489+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986000f6f0 con 0x7f9868105560 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.489+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98681a6b90 con 0x7f9868105560 2024-09-15T23:34:37.491 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.489+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98681a7090 con 0x7f9868105560 2024-09-15T23:34:37.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.490+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9868100810 con 0x7f9868105560 2024-09-15T23:34:37.492 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.491+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9860004b20 con 0x7f9868105560 2024-09-15T23:34:37.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.492+0000 7f985e7fc640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 0x7f98540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:37.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.492+0000 7f986d1b6640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 0x7f98540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:37.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.493+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f98600cff50 con 0x7f9868105560 2024-09-15T23:34:37.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.494+0000 7f986d1b6640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 0x7f98540a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9864009b60 tx=0x7f9864005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:37.500 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.499+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9860014030 con 0x7f9868105560 2024-09-15T23:34:37.548 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:37.548 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 readers = 917635.38 kB/sec 2024-09-15T23:34:37.548 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 readers = 917616.93 kB/sec 2024-09-15T23:34:37.548 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 917635.38 kB/sec 2024-09-15T23:34:37.548 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 917635.38 kB/sec 2024-09-15T23:34:37.549 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 917635.38 kB/sec 2024-09-15T23:34:37.549 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-09-15T23:34:37.718 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.717+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f98681a7320 con 0x7f9868105560 2024-09-15T23:34:37.719 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.717+0000 7f985e7fc640 1 -- 172.21.15.77:0/3470087434 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f98600bae20 con 0x7f9868105560 2024-09-15T23:34:37.719 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:37.719 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:37.720 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 msgr2=0x7f98540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 0x7f98540a5780 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9864009b60 tx=0x7f9864005f90 comp rx=0 tx=0).stop 2024-09-15T23:34:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 msgr2=0x7f9868111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f986000cad0 tx=0x7f986000cf90 comp rx=0 tx=0).stop 2024-09-15T23:34:37.721 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 shutdown_connections 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f98540a32c0 0x7f98540a5780 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9868105560 0x7f9868111600 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9868100de0 0x7f98681110c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 --2- 172.21.15.77:0/3470087434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9868100430 0x7f9868110b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 >> 172.21.15.77:0/3470087434 conn(0x7f9868077230 msgr2=0x7f9868102f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 shutdown_connections 2024-09-15T23:34:37.722 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:37.720+0000 7f986f41a640 1 -- 172.21.15.77:0/3470087434 wait complete. 2024-09-15T23:34:38.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:37 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3470087434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:38.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:37 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3470087434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:38.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:37 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3470087434' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:39.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:38 smithi155 ceph-mon[35631]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 MiB/s rd, 2.5 KiB/s wr, 180 op/s 2024-09-15T23:34:39.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:38 smithi077 ceph-mon[30968]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 MiB/s rd, 2.5 KiB/s wr, 180 op/s 2024-09-15T23:34:39.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:38 smithi159 ceph-mon[35472]: pgmap v442: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 697 MiB/s rd, 2.5 KiB/s wr, 180 op/s 2024-09-15T23:34:39.841 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db --set-id 86c81653 --release --await' 2024-09-15T23:34:39.841 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db --set-id 86c81653 --release --await 2024-09-15T23:34:40.094 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 -- 172.21.15.77:0/3800930830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 msgr2=0x7fa6cc103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 --2- 172.21.15.77:0/3800930830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc103120 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc009ca0 tx=0x7fa6bc02a950 comp rx=0 tx=0).stop 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 -- 172.21.15.77:0/3800930830 shutdown_connections 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 --2- 172.21.15.77:0/3800930830 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 0x7fa6cc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 --2- 172.21.15.77:0/3800930830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6cc103660 0x7fa6cc10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 --2- 172.21.15.77:0/3800930830 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc103120 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 -- 172.21.15.77:0/3800930830 >> 172.21.15.77:0/3800930830 conn(0x7fa6cc0fc7a0 msgr2=0x7fa6cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.540 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 -- 172.21.15.77:0/3800930830 shutdown_connections 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.537+0000 7fa6d08de640 1 -- 172.21.15.77:0/3800930830 wait complete. 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 Processor -- start 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 -- start start 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6cc103660 0x7fa6cc198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 0x7fa6cc19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc111fb0 con 0x7fa6cc102d40 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc111e30 con 0x7fa6cc10c170 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6d08de640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc112130 con 0x7fa6cc103660 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33120/0 (socket says 172.21.15.77:33120) 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 -- 172.21.15.77:0/759135287 learned_addr learned my addr 172.21.15.77:0/759135287 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.541 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 -- 172.21.15.77:0/759135287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6cc103660 msgr2=0x7fa6cc198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 0x7fa6cc19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6cc103660 0x7fa6cc198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 -- 172.21.15.77:0/759135287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 msgr2=0x7fa6cc19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 0x7fa6cc19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 -- 172.21.15.77:0/759135287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6cc19d4c0 con 0x7fa6cc102d40 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.538+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005cc0 tx=0x7fa6bc02f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.539+0000 7fa6bb7fe640 1 -- 172.21.15.77:0/759135287 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc034040 con 0x7fa6cc102d40 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.539+0000 7fa6bb7fe640 1 -- 172.21.15.77:0/759135287 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6bc003e40 con 0x7fa6cc102d40 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.539+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6cc19d750 con 0x7fa6cc102d40 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.539+0000 7fa6bb7fe640 1 -- 172.21.15.77:0/759135287 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc045480 con 0x7fa6cc102d40 2024-09-15T23:34:40.542 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.539+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6cc1008d0 con 0x7fa6cc102d40 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.541+0000 7fa6bb7fe640 1 -- 172.21.15.77:0/759135287 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa6bc037020 con 0x7fa6cc102d40 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.541+0000 7fa6d2cb7740 1 Processor -- start 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 -- start start 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa7e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa8b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5607fa9e3620 con 0x5607faa7e980 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5607fa98ae50 con 0x5607faa7e060 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5607fa9df5e0 con 0x5607faa89240 2024-09-15T23:34:40.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6ca59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33136/0 (socket says 172.21.15.77:33136) 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6ca59c640 1 -- 172.21.15.77:0/4202002685 learned_addr learned my addr 172.21.15.77:0/4202002685 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa7e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6bb7fe640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 0x7fa6b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa8b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.542+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 0x7fa6b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6bb7fe640 1 -- 172.21.15.77:0/759135287 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa6bc0f0f30 con 0x7fa6cc102d40 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 -- 172.21.15.77:0/4202002685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 msgr2=0x5607faa8b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa8b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 -- 172.21.15.77:0/4202002685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 msgr2=0x5607faa7e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa7e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 -- 172.21.15.77:0/4202002685 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607fa97bd40 con 0x5607faa7e980 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0b95c0 tx=0x7fa6bc02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ce06669ad6a1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.549 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 0x7fa6b40a5780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ae40 tx=0x7fa6c40046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6b8ff9640 1 -- 172.21.15.77:0/4202002685 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc0bcac0 con 0x5607faa7e980 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6b8ff9640 1 -- 172.21.15.77:0/4202002685 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6bc0bd860 con 0x5607faa7e980 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.543+0000 7fa6b8ff9640 1 -- 172.21.15.77:0/4202002685 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc02c040 con 0x5607faa7e980 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/4202002685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 msgr2=0x5607faa88d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0b95c0 tx=0x7fa6bc02a950 comp rx=0 tx=0).stop 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/4202002685 shutdown_connections 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa8b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faa88d00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/4202002685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa7e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/4202002685 >> 172.21.15.77:0/4202002685 conn(0x5607faa7a5f0 msgr2=0x5607faa7a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/4202002685 shutdown_connections 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/4202002685 wait complete. 2024-09-15T23:34:40.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 -- start start 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.544+0000 7fa6d2cb7740 1 Processor -- start 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e980 0x5607faa86630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x5607faa8bbd0 con 0x5607faa89240 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5607fa96bf10 con 0x5607faa7e060 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5607faa8bd50 con 0x5607faa7e980 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33144/0 (socket says 172.21.15.77:33144) 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3524876280 learned_addr learned my addr 172.21.15.77:0/3524876280 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6d2cb7740 10 client.0 _ll_register_callbacks cb 0x5607fa98fdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e980 0x5607faa86630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e980 msgr2=0x5607faa86630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e980 0x5607faa86630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3524876280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 msgr2=0x5607faa860f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa860f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3524876280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607fa6f2580 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40166e0 tx=0x7fa6c40047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19de5e9744af3a7b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.545+0000 7fa6b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4026060 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa6c4015b10 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6bc0bd860 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa6c400f040 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 10 client.16050 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607fa7bc960 con 0x5607faa89240 2024-09-15T23:34:40.552 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6bc0bd860 con 0x5607faa89240 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa6c4015070 con 0x5607faa89240 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 10 client.16050 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 10 client.16050 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 20 client.16050 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607faa98b10 0x5607faa9af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 4 client.16050 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.546+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5607fa9f0b90 con 0x5607faa98b10 2024-09-15T23:34:40.553 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.547+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607faa98b10 0x5607faa9af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.547+0000 7fa6b1ffb640 10 client.16050 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.547+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607faa98b10 0x5607faa9af40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9633828ec6b54ff3 server_cookie=582d93b9cfc642d0 in_seq=0 out_seq=0 2024-09-15T23:34:40.554 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3524876280 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5607fa9f0b90 con 0x5607faa98b10 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6b1ffb640 10 client.16050 handle_command_reply: tid=0 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 client.16050 shutdown 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 msgr2=0x5607faa86b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40166e0 tx=0x7fa6c40047d0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 shutdown_connections 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607faa98b10 0x5607faa9af40 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa86b70 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e980 0x5607faa86630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3524876280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faa860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 >> 172.21.15.77:0/3524876280 conn(0x5607faa7a5f0 msgr2=0x5607faa80320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6b1ffb640 0 client.16050 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 shutdown_connections 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3524876280 wait complete. 2024-09-15T23:34:40.555 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.548+0000 7fa6d2cb7740 20 client.16050 trim_cache size 0 max 16384 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 Processor -- start 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 -- start start 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faaa0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa83370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.567 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1aef50 con 0x5607faa7e980 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1b17d0 con 0x5607faa7e060 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1af5c0 con 0x5607faa89240 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6c9d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33146/0 (socket says 172.21.15.77:33146) 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6c9d9b640 1 -- 172.21.15.77:0/680714008 learned_addr learned my addr 172.21.15.77:0/680714008 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faaa0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.565+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa83370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 -- 172.21.15.77:0/680714008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 msgr2=0x5607faa83370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa83370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 -- 172.21.15.77:0/680714008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 msgr2=0x5607faaa0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faaa0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 -- 172.21.15.77:0/680714008 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607faa7b1a0 con 0x5607faa7e980 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faaa0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:40.568 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa83370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000ab40 tx=0x7fa6c0010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e796805ef548b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6b3fff640 1 -- 172.21.15.77:0/680714008 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c001e070 con 0x5607faa7e980 2024-09-15T23:34:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6b3fff640 1 -- 172.21.15.77:0/680714008 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c0010e30 con 0x5607faa7e980 2024-09-15T23:34:40.569 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.566+0000 7fa6b3fff640 1 -- 172.21.15.77:0/680714008 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000fa00 con 0x5607faa7e980 2024-09-15T23:34:40.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/680714008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 msgr2=0x5607faaa0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa6c000ab40 tx=0x7fa6c0010430 comp rx=0 tx=0).stop 2024-09-15T23:34:40.575 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/680714008 shutdown_connections 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa89240 0x5607faa83370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa7e980 0x5607faaa0d50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/680714008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e060 0x5607faaa0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/680714008 >> 172.21.15.77:0/680714008 conn(0x5607faa7a5f0 msgr2=0x5607faa88170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/680714008 shutdown_connections 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/680714008 wait complete. 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 -- start start 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.567+0000 7fa6d2cb7740 1 Processor -- start 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e060 0x5607faa90ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e980 0x5607faa91400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.576 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1afc90 con 0x5607faa89240 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1b1100 con 0x5607faa7e980 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6cc1b0360 con 0x5607faa7e060 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6d2cb7740 10 client.0 _ll_register_callbacks cb 0x7fa6c4013ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33150/0 (socket says 172.21.15.77:33150) 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3825654524 learned_addr learned my addr 172.21.15.77:0/3825654524 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6c9d9b640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e980 0x5607faa91400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e060 0x5607faa90ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e060 msgr2=0x5607faa90ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e060 0x5607faa90ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3825654524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e980 msgr2=0x5607faa91400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e980 0x5607faa91400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 -- 172.21.15.77:0/3825654524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607faa83ff0 con 0x5607faa89240 2024-09-15T23:34:40.577 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6cad9d640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4020580 tx=0x7fa6c400a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af815e0f6e89e032 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.568+0000 7fa6b1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c4035020 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fa6c4015760 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c0010e30 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa6c4040050 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 10 client.16056 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x5607fab03d10 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6c0010e30 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fa6c40319c0 con 0x5607faa89240 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 10 client.16056 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 10 client.16056 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 20 client.16056 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:40.578 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607fab044b0 0x5607fab068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 4 client.16056 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "86c81653", "release": true, "await": true}] 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.569+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "set_id": "86c81653", "release": true, "await": true}) -- 0x5607fa9eb0a0 con 0x5607fab044b0 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.570+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607fab044b0 0x5607fab068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.570+0000 7fa6ca59c640 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607fab044b0 0x5607fab068d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=508f3c4f15453511 server_cookie=bbe9415fade3d3b1 in_seq=0 out_seq=0 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.570+0000 7fa6b1ffb640 10 client.16056 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6b1ffb640 1 -- 172.21.15.77:0/3825654524 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5607fa9eb0a0 con 0x5607fab044b0 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6b1ffb640 10 client.16056 handle_command_reply: tid=0 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6d2cb7740 1 client.16056 shutdown 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 msgr2=0x5607faa8de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa6c4020580 tx=0x7fa6c400a2e0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 shutdown_connections 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.571+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x5607fab044b0 0x5607fab068d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x5607faa89240 0x5607faa8de90 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.579 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5607faa7e980 0x5607faa91400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 --2- 172.21.15.77:0/3825654524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5607faa7e060 0x5607faa90ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6b1ffb640 0 client.16056 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 >> 172.21.15.77:0/3825654524 conn(0x5607faa7a5f0 msgr2=0x5607faa78f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 shutdown_connections 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 1 -- 172.21.15.77:0/3825654524 wait complete. 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d2cb7740 20 client.16056 trim_cache size 0 max 16384 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:34:40.580 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 12, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": { 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "86c81653": { 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "version": 12, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "age_ref": 0.0, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "timeout": 90.0, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "expiration": 139.6, 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "members": { 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "file:/": { 2024-09-15T23:34:40.581 INFO:teuthology.orchestra.run.smithi077.stdout: "excluded": false, 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: "state": { 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RELEASED", 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: "age": 0.0 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:34:40.582 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 msgr2=0x7fa6b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 0x7fa6b40a5780 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa6c400ae40 tx=0x7fa6c40046c0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 msgr2=0x7fa6cc198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc005cc0 tx=0x7fa6bc02f770 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 shutdown_connections 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fa6b40a32c0 0x7fa6b40a5780 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6cc10c170 0x7fa6cc19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6cc103660 0x7fa6cc198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 --2- 172.21.15.77:0/759135287 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fa6cc102d40 0x7fa6cc198510 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 >> 172.21.15.77:0/759135287 conn(0x7fa6cc0fc7a0 msgr2=0x7fa6cc0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 shutdown_connections 2024-09-15T23:34:40.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:40.572+0000 7fa6d08de640 1 -- 172.21.15.77:0/759135287 wait complete. 2024-09-15T23:34:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- 172.21.15.77:0/3430491143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d8074c50 msgr2=0x7f81d80750b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- 172.21.15.77:0/3430491143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d8074c50 0x7f81d80750b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009900 tx=0x7f81c802a410 comp rx=0 tx=0).stop 2024-09-15T23:34:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- 172.21.15.77:0/3430491143 shutdown_connections 2024-09-15T23:34:40.627 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- 172.21.15.77:0/3430491143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d810e130 0x7f81d8110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- 172.21.15.77:0/3430491143 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d8074c50 0x7f81d80750b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- 172.21.15.77:0/3430491143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8076230 0x7f81d8074680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- 172.21.15.77:0/3430491143 >> 172.21.15.77:0/3430491143 conn(0x7f81d80fd2e0 msgr2=0x7f81d80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- 172.21.15.77:0/3430491143 shutdown_connections 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- 172.21.15.77:0/3430491143 wait complete. 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 Processor -- start 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- start start 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8074c50 0x7f81d819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 0x7f81d819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8113df0 con 0x7f81d810e130 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8113c70 con 0x7f81d8076230 2024-09-15T23:34:40.628 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.624+0000 7f81e0227640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81d8113f70 con 0x7f81d8074c50 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33166/0 (socket says 172.21.15.77:33166) 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 -- 172.21.15.77:0/2371864670 learned_addr learned my addr 172.21.15.77:0/2371864670 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8074c50 0x7f81d819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 0x7f81d819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 -- 172.21.15.77:0/2371864670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8074c50 msgr2=0x7f81d819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8074c50 0x7f81d819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 -- 172.21.15.77:0/2371864670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 msgr2=0x7f81d819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 0x7f81d819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 -- 172.21.15.77:0/2371864670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d81a6050 con 0x7f81d810e130 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 0x7f81d819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81de7c4640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f81d000eb10 tx=0x7f81d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.629 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81ceffd640 1 -- 172.21.15.77:0/2371864670 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0004b20 con 0x7f81d810e130 2024-09-15T23:34:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81ceffd640 1 -- 172.21.15.77:0/2371864670 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d0004cc0 con 0x7f81d810e130 2024-09-15T23:34:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d81a6340 con 0x7f81d810e130 2024-09-15T23:34:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81ceffd640 1 -- 172.21.15.77:0/2371864670 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0010760 con 0x7f81d810e130 2024-09-15T23:34:40.630 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.625+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d81a6840 con 0x7f81d810e130 2024-09-15T23:34:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.627+0000 7f81ceffd640 1 -- 172.21.15.77:0/2371864670 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f81d0005020 con 0x7f81d810e130 2024-09-15T23:34:40.636 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 Processor -- start 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 -- start start 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a02da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a05830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558aa19612f0 con 0x558aa19fd9a0 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558aa1909270 con 0x558aa1a03370 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558aa195d2b0 con 0x558aa19fe2e0 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33170/0 (socket says 172.21.15.77:33170) 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81dd7c2640 1 -- 172.21.15.77:0/2521205106 learned_addr learned my addr 172.21.15.77:0/2521205106 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.628+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a02da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81ceffd640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 0x7f81c40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.637 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a05830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 -- 172.21.15.77:0/2521205106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 msgr2=0x558aa1a02da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a02da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 -- 172.21.15.77:0/2521205106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 msgr2=0x558aa1a05830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a05830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81de7c4640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 0x7f81c40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 -- 172.21.15.77:0/2521205106 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa1908340 con 0x558aa19fd9a0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81ceffd640 1 -- 172.21.15.77:0/2371864670 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81d00d0300 con 0x7f81d810e130 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f81c8005ab0 tx=0x7f81c8005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69d5f1c712ae62 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81c3fff640 1 -- 172.21.15.77:0/2521205106 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8045070 con 0x558aa19fd9a0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81c3fff640 1 -- 172.21.15.77:0/2521205106 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81c8005040 con 0x558aa19fd9a0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81c3fff640 1 -- 172.21.15.77:0/2521205106 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8035050 con 0x558aa19fd9a0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.629+0000 7f81de7c4640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 0x7f81c40a57b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f81d00049d0 tx=0x7f81d00673c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.638 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- 172.21.15.77:0/2521205106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 msgr2=0x558aa19fdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f81c8005ab0 tx=0x7f81c8005a20 comp rx=0 tx=0).stop 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- 172.21.15.77:0/2521205106 shutdown_connections 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a05830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a02da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/2521205106 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa19fdda0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- 172.21.15.77:0/2521205106 >> 172.21.15.77:0/2521205106 conn(0x558aa19f9010 msgr2=0x558aa19f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- 172.21.15.77:0/2521205106 shutdown_connections 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- 172.21.15.77:0/2521205106 wait complete. 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 -- start start 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.630+0000 7f81e2fc1740 1 Processor -- start 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a08100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.639 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a0f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x558aa1a062e0 con 0x558aa19fd9a0 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558aa18ea290 con 0x558aa1a03370 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x558aa1a06460 con 0x558aa19fe2e0 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 10 client.0 _ll_register_callbacks cb 0x558aa191b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33184/0 (socket says 172.21.15.77:33184) 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 -- 172.21.15.77:0/1941547636 learned_addr learned my addr 172.21.15.77:0/1941547636 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 -- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 msgr2=0x558aa1a08100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a08100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 -- 172.21.15.77:0/1941547636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 msgr2=0x558aa1a0f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a0f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.640 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 -- 172.21.15.77:0/1941547636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa1674210 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a08100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f81c8033000 tx=0x7f81c8031aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea2658494e5df87 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8045070 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81c8004b00 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.631+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81c8005040 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81c8035040 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 10 client.16068 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558aa1740620 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81c8005040 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f81c8039bc0 con 0x558aa19fd9a0 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 10 client.16068 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 10 client.16068 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:40.641 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 20 client.16068 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a13440 0x558aa1a15830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 4 client.16068 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558aa196ea20 con 0x558aa1a13440 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.632+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a13440 0x558aa1a15830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81c17fa640 10 client.16068 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a13440 0x558aa1a15830 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=213471d5ef69cd92 server_cookie=d20340b45f0fb4b in_seq=0 out_seq=0 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81c17fa640 1 -- 172.21.15.77:0/1941547636 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558aa196ea20 con 0x558aa1a13440 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81c17fa640 10 client.16068 handle_command_reply: tid=0 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 client.16068 shutdown 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 msgr2=0x558aa1a07bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f81c8033000 tx=0x7f81c8031aa0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 shutdown_connections 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a13440 0x558aa1a15830 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.642 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa1a03370 0x558aa1a0f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81c17fa640 0 client.16068 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.633+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa1a08100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.634+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1941547636 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a07bc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.634+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 >> 172.21.15.77:0/1941547636 conn(0x558aa19f9010 msgr2=0x558aa19fa820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.634+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 shutdown_connections 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.634+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1941547636 wait complete. 2024-09-15T23:34:40.643 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.634+0000 7f81e2fc1740 20 client.16068 trim_cache size 0 max 16384 2024-09-15T23:34:40.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.647+0000 7f81e2fc1740 1 Processor -- start 2024-09-15T23:34:40.650 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.647+0000 7f81e2fc1740 1 -- start start 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a08080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa19f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81aecd0 con 0x558aa19fd9a0 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81b1550 con 0x558aa19f9010 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81af340 con 0x558aa19fe2e0 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33194/0 (socket says 172.21.15.77:33194) 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 -- 172.21.15.77:0/1648296440 learned_addr learned my addr 172.21.15.77:0/1648296440 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a08080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 -- 172.21.15.77:0/1648296440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 msgr2=0x558aa19f9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa19f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.651 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 -- 172.21.15.77:0/1648296440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 msgr2=0x558aa1a08080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a08080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 -- 172.21.15.77:0/1648296440 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558aa1a15ba0 con 0x558aa19fd9a0 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a08080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x558aa1a16070 tx=0x7f81d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8474a435f9c16d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81c37fe640 1 -- 172.21.15.77:0/1648296440 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4003d20 con 0x558aa19fd9a0 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81c37fe640 1 -- 172.21.15.77:0/1648296440 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d4010910 con 0x558aa19fd9a0 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.648+0000 7f81c37fe640 1 -- 172.21.15.77:0/1648296440 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d401e930 con 0x558aa19fd9a0 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1648296440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 msgr2=0x558aa1a0f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x558aa1a16070 tx=0x7f81d40046c0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1648296440 shutdown_connections 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fe2e0 0x558aa19f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fd9a0 0x558aa1a0f100 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.652 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/1648296440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a08080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1648296440 >> 172.21.15.77:0/1648296440 conn(0x558aa1a02ec0 msgr2=0x558aa1a07970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1648296440 shutdown_connections 2024-09-15T23:34:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- 172.21.15.77:0/1648296440 wait complete. 2024-09-15T23:34:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 -- start start 2024-09-15T23:34:40.653 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.649+0000 7f81e2fc1740 1 Processor -- start 2024-09-15T23:34:40.655 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a0c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fd9a0 0x558aa1a0ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81afa10 con 0x558aa19fe2e0 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81b0e80 con 0x558aa19f9010 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81b00e0 con 0x558aa19fd9a0 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81e2fc1740 10 client.0 _ll_register_callbacks cb 0x7f81c8043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:33198/0 (socket says 172.21.15.77:33198) 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 -- 172.21.15.77:0/135448307 learned_addr learned my addr 172.21.15.77:0/135448307 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a0c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 -- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fd9a0 msgr2=0x558aa1a0ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.656 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fd9a0 0x558aa1a0ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fd9a0 0x558aa1a0ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 -- 172.21.15.77:0/135448307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 msgr2=0x558aa1a0c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a0c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 -- 172.21.15.77:0/135448307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558aa1a0e450 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81dd7c2640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f81c8032fd0 tx=0x7f81c8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b7ba62557d0366 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.650+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81c8061060 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f81c8005500 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d4010910 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f81c8068050 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 10 client.16074 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x558aa1a7e160 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f81d4010910 con 0x558aa19fe2e0 2024-09-15T23:34:40.657 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f81c80393f0 con 0x558aa19fe2e0 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 10 client.16074 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 10 client.16074 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 20 client.16074 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a03370 0x558aa1a80b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 4 client.16074 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558aa1968d70 con 0x558aa1a03370 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.651+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a03370 0x558aa1a80b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.652+0000 7f81c17fa640 10 client.16074 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.658 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.652+0000 7f81ddfc3640 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a03370 0x558aa1a80b20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e65e385ace320a2 server_cookie=916754876822265c in_seq=0 out_seq=0 2024-09-15T23:34:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81c17fa640 1 -- 172.21.15.77:0/135448307 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558aa1968d70 con 0x558aa1a03370 2024-09-15T23:34:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81c17fa640 10 client.16074 handle_command_reply: tid=0 2024-09-15T23:34:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 client.16074 shutdown 2024-09-15T23:34:40.662 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 msgr2=0x558aa1a0de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f81c8032fd0 tx=0x7f81c8005fd0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 shutdown_connections 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x558aa1a03370 0x558aa1a80b20 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x558aa19fe2e0 0x558aa1a0de40 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x558aa19fd9a0 0x558aa1a0ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81c17fa640 0 client.16074 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 --2- 172.21.15.77:0/135448307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558aa19f9010 0x558aa1a0c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 >> 172.21.15.77:0/135448307 conn(0x558aa1a02ec0 msgr2=0x558aa19f79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.660+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 shutdown_connections 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e2fc1740 1 -- 172.21.15.77:0/135448307 wait complete. 2024-09-15T23:34:40.663 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e2fc1740 20 client.16074 trim_cache size 0 max 16384 2024-09-15T23:34:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:34:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:34:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:34:40.664 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 msgr2=0x7f81c40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 0x7f81c40a57b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f81d00049d0 tx=0x7f81d00673c0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 msgr2=0x7f81d81a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f81d000eb10 tx=0x7f81d000c2d0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 shutdown_connections 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f81c40a32f0 0x7f81c40a57b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f81d810e130 0x7f81d81a59e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f81d8076230 0x7f81d819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 --2- 172.21.15.77:0/2371864670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81d8074c50 0x7f81d819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 >> 172.21.15.77:0/2371864670 conn(0x7f81d80fd2e0 msgr2=0x7f81d81013b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:40.665 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 shutdown_connections 2024-09-15T23:34:40.666 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:40.661+0000 7f81e0227640 1 -- 172.21.15.77:0/2371864670 wait complete. 2024-09-15T23:34:41.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:40 smithi077 ceph-mon[30968]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 MiB/s rd, 2.5 KiB/s wr, 198 op/s 2024-09-15T23:34:41.346 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '86c81653', total seconds elapsed: 24.3 2024-09-15T23:34:41.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:40 smithi155 ceph-mon[35631]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 MiB/s rd, 2.5 KiB/s wr, 198 op/s 2024-09-15T23:34:41.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:40 smithi159 ceph-mon[35472]: pgmap v443: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 765 MiB/s rd, 2.5 KiB/s wr, 198 op/s 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Children see throughput for 1 re-readers = 7951058.00 kB/sec 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Parent sees throughput for 1 re-readers = 7949822.05 kB/sec 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Min throughput per process = 7951058.00 kB/sec 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Max throughput per process = 7951058.00 kB/sec 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Avg throughput per process = 7951058.00 kB/sec 2024-09-15T23:34:42.388 INFO:tasks.workunit.client.0.smithi077.stdout: Min xfer = 10485760.00 kB 2024-09-15T23:34:43.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:42 smithi155 ceph-mon[35631]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 MiB/s rd, 1.7 KiB/s wr, 197 op/s 2024-09-15T23:34:43.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:42 smithi077 ceph-mon[30968]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 MiB/s rd, 1.7 KiB/s wr, 197 op/s 2024-09-15T23:34:43.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:42 smithi159 ceph-mon[35472]: pgmap v444: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 771 MiB/s rd, 1.7 KiB/s wr, 197 op/s 2024-09-15T23:34:45.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:45 smithi155 ceph-mon[35631]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 MiB/s rd, 170 B/s wr, 150 op/s 2024-09-15T23:34:45.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:45 smithi077 ceph-mon[30968]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 MiB/s rd, 170 B/s wr, 150 op/s 2024-09-15T23:34:45.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:45 smithi159 ceph-mon[35472]: pgmap v445: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 591 MiB/s rd, 170 B/s wr, 150 op/s 2024-09-15T23:34:47.267 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:47 smithi159 ceph-mon[35472]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 MiB/s rd, 767 B/s wr, 134 op/s 2024-09-15T23:34:47.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:47 smithi155 ceph-mon[35631]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 MiB/s rd, 767 B/s wr, 134 op/s 2024-09-15T23:34:47.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:47 smithi077 ceph-mon[30968]: pgmap v446: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 521 MiB/s rd, 767 B/s wr, 134 op/s 2024-09-15T23:34:49.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:49 smithi155 ceph-mon[35631]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s rd, 767 B/s wr, 56 op/s 2024-09-15T23:34:49.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:49 smithi077 ceph-mon[30968]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s rd, 767 B/s wr, 56 op/s 2024-09-15T23:34:49.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:49 smithi159 ceph-mon[35472]: pgmap v447: 129 pgs: 129 active+clean; 10 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 211 MiB/s rd, 767 B/s wr, 56 op/s 2024-09-15T23:34:50.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:50 smithi155 ceph-mon[35631]: pgmap v448: 129 pgs: 129 active+clean; 7.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 MiB/s rd, 853 B/s wr, 99 op/s 2024-09-15T23:34:50.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:50 smithi077 ceph-mon[30968]: pgmap v448: 129 pgs: 129 active+clean; 7.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 MiB/s rd, 853 B/s wr, 99 op/s 2024-09-15T23:34:50.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:50 smithi159 ceph-mon[35472]: pgmap v448: 129 pgs: 129 active+clean; 7.4 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 156 MiB/s rd, 853 B/s wr, 99 op/s 2024-09-15T23:34:51.370 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:51.370 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:51.371 INFO:tasks.workunit.client.0.smithi077.stdout: 2024-09-15T23:34:51.371 INFO:tasks.workunit.client.0.smithi077.stdout:iozone test complete. 2024-09-15T23:34:51.372 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-15T23:34:51.372 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-15T23:34:51.408 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-09-15T23:34:51.408 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-15T23:34:51.750 DEBUG:teuthology.parallel:result is None 2024-09-15T23:34:51.750 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:34:51.783 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-15T23:34:51.783 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-15T23:34:51.797 INFO:tasks.quiescer:joining Quiescers 2024-09-15T23:34:51.797 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-15T23:34:51.797 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:34:52.083 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 -- 172.21.15.77:0/1049655079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce0101df0 msgr2=0x7f9ce01021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 --2- 172.21.15.77:0/1049655079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce0101df0 0x7f9ce01021d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009900 tx=0x7f9cd002a410 comp rx=0 tx=0).stop 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 -- 172.21.15.77:0/1049655079 shutdown_connections 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 --2- 172.21.15.77:0/1049655079 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0106f20 0x7f9ce010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 --2- 172.21.15.77:0/1049655079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce01027a0 0x7f9ce01067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 --2- 172.21.15.77:0/1049655079 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce0101df0 0x7f9ce01021d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 -- 172.21.15.77:0/1049655079 >> 172.21.15.77:0/1049655079 conn(0x7f9ce00fd8b0 msgr2=0x7f9ce00ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 -- 172.21.15.77:0/1049655079 shutdown_connections 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 -- 172.21.15.77:0/1049655079 wait complete. 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.605+0000 7f9ce6877640 1 Processor -- start 2024-09-15T23:34:52.607 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 -- start start 2024-09-15T23:34:52.609 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 0x7f9ce01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 0x7f9ce019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0111f80 con 0x7f9ce01027a0 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0111e00 con 0x7f9ce0101df0 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce6877640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0112100 con 0x7f9ce0106f20 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9cdf7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38506/0 (socket says 172.21.15.77:38506) 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9cdf7fe640 1 -- 172.21.15.77:0/3399409812 learned_addr learned my addr 172.21.15.77:0/3399409812 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9cdffff640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 0x7f9ce01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.606+0000 7f9ce4e14640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 0x7f9ce019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 -- 172.21.15.77:0/3399409812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 msgr2=0x7f9ce019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 0x7f9ce019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 -- 172.21.15.77:0/3399409812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 msgr2=0x7f9ce01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:52.610 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 0x7f9ce01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 -- 172.21.15.77:0/3399409812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce019d470 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdffff640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 0x7f9ce01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9ce4e14640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 0x7f9ce019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdf7fe640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c970 tx=0x7f9cd400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4007bb0 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9cd4007d50 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd400f450 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce019d760 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.607+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce0074420 con 0x7f9ce01027a0 2024-09-15T23:34:52.611 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.608+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce01032d0 con 0x7f9ce01027a0 2024-09-15T23:34:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.610+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9cd4004fe0 con 0x7f9ce01027a0 2024-09-15T23:34:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.611+0000 7f9cdd7fa640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 0x7f9cc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.611+0000 7f9cdffff640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 0x7f9cc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.611+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f9cd40cff20 con 0x7f9ce01027a0 2024-09-15T23:34:52.612 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.611+0000 7f9cdffff640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 0x7f9cc80a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005ab0 tx=0x7f9cd0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:52.614 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.613+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f9cd4014030 con 0x7f9ce01027a0 2024-09-15T23:34:52.821 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.820+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ce01021d0 con 0x7f9ce01027a0 2024-09-15T23:34:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.821+0000 7f9cdd7fa640 1 -- 172.21.15.77:0/3399409812 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f9cd409c8b0 con 0x7f9ce01027a0 2024-09-15T23:34:52.822 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:34:52.822 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:34:52.823 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:34:52.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 msgr2=0x7f9cc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:52.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 0x7f9cc80a5700 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0005ab0 tx=0x7f9cd0005a20 comp rx=0 tx=0).stop 2024-09-15T23:34:52.824 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 msgr2=0x7f9ce0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c970 tx=0x7f9cd400ce30 comp rx=0 tx=0).stop 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 shutdown_connections 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f9cc80a3240 0x7f9cc80a5700 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce0106f20 0x7f9ce019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9ce01027a0 0x7f9ce0198a00 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 --2- 172.21.15.77:0/3399409812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9ce0101df0 0x7f9ce01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 >> 172.21.15.77:0/3399409812 conn(0x7f9ce00fd8b0 msgr2=0x7f9ce00feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 shutdown_connections 2024-09-15T23:34:52.825 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:52.823+0000 7f9ce6877640 1 -- 172.21.15.77:0/3399409812 wait complete. 2024-09-15T23:34:53.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:52 smithi077 ceph-mon[30968]: pgmap v449: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 1.7 KiB/s wr, 199 op/s 2024-09-15T23:34:53.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:52 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3399409812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:52 smithi155 ceph-mon[35631]: pgmap v449: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 1.7 KiB/s wr, 199 op/s 2024-09-15T23:34:53.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:52 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3399409812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:53.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:52 smithi159 ceph-mon[35472]: pgmap v449: 129 pgs: 129 active+clean; 1.8 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 MiB/s rd, 1.7 KiB/s wr, 199 op/s 2024-09-15T23:34:53.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:52 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3399409812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:34:53.584 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24460 quiesce db --cancel --all' 2024-09-15T23:34:53.584 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24460 quiesce db --cancel --all 2024-09-15T23:34:53.753 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 -- 172.21.15.77:0/1924516678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 msgr2=0x7fe6741020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 --2- 172.21.15.77:0/1924516678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe6741020b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe660009900 tx=0x7fe66002a410 comp rx=0 tx=0).stop 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 -- 172.21.15.77:0/1924516678 shutdown_connections 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 --2- 172.21.15.77:0/1924516678 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 0x7fe674108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 --2- 172.21.15.77:0/1924516678 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe6741020b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 --2- 172.21.15.77:0/1924516678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe674100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 -- 172.21.15.77:0/1924516678 >> 172.21.15.77:0/1924516678 conn(0x7fe6740fc1e0 msgr2=0x7fe6740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 -- 172.21.15.77:0/1924516678 shutdown_connections 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.749+0000 7fe67abd6640 1 -- 172.21.15.77:0/1924516678 wait complete. 2024-09-15T23:34:53.754 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 Processor -- start 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 -- start start 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe6741049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 0x7fe674103550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe67410c6c0 con 0x7fe674101c30 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe67410c540 con 0x7fe6741025f0 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe67abd6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe67410c840 con 0x7fe674100a40 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe673fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe678972640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe6741049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe673fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38526/0 (socket says 172.21.15.77:38526) 2024-09-15T23:34:53.755 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe673fff640 1 -- 172.21.15.77:0/83095528 learned_addr learned my addr 172.21.15.77:0/83095528 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.750+0000 7fe679173640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 0x7fe674103550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 -- 172.21.15.77:0/83095528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 msgr2=0x7fe6741049d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe6741049d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 -- 172.21.15.77:0/83095528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 msgr2=0x7fe674103550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 0x7fe674103550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 -- 172.21.15.77:0/83095528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe674103de0 con 0x7fe674101c30 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe678972640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe6741049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe673fff640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe660009230 tx=0x7fe660031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe671ffb640 1 -- 172.21.15.77:0/83095528 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66003f030 con 0x7fe674101c30 2024-09-15T23:34:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe671ffb640 1 -- 172.21.15.77:0/83095528 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe660003ad0 con 0x7fe674101c30 2024-09-15T23:34:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6741a1ea0 con 0x7fe674101c30 2024-09-15T23:34:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe671ffb640 1 -- 172.21.15.77:0/83095528 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe660035070 con 0x7fe674101c30 2024-09-15T23:34:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.751+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6741a2300 con 0x7fe674101c30 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.753+0000 7fe671ffb640 1 -- 172.21.15.77:0/83095528 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fe660042030 con 0x7fe674101c30 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.754+0000 7fe671ffb640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 0x7fe6640a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.754+0000 7fe678972640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 0x7fe6640a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.754+0000 7fe671ffb640 1 -- 172.21.15.77:0/83095528 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe6600f0180 con 0x7fe674101c30 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.754+0000 7fe67da50740 1 Processor -- start 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 -- start start 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.765 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8beda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56303f81d2f0 con 0x56303f8b99a0 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56303f7c5270 con 0x56303f8ba2e0 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe67da50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56303f8192b0 con 0x56303f8bf370 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 0x7fe6640a57b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe674101a90 tx=0x7fe668005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38528/0 (socket says 172.21.15.77:38528) 2024-09-15T23:34:53.766 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 -- 172.21.15.77:0/1568622311 learned_addr learned my addr 172.21.15.77:0/1568622311 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe673fff640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe679173640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 -- 172.21.15.77:0/1568622311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 msgr2=0x56303f8c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 -- 172.21.15.77:0/1568622311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 msgr2=0x56303f8beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8beda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 -- 172.21.15.77:0/1568622311 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303f7c4340 con 0x56303f8b99a0 2024-09-15T23:34:53.767 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe679173640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.755+0000 7fe678972640 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe668009560 tx=0x7fe668014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e517876b431ca30e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe65effd640 1 -- 172.21.15.77:0/1568622311 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66801c810 con 0x56303f8b99a0 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe65effd640 1 -- 172.21.15.77:0/1568622311 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800e3b0 con 0x56303f8b99a0 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe65effd640 1 -- 172.21.15.77:0/1568622311 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680255f0 con 0x56303f8b99a0 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 -- 172.21.15.77:0/1568622311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 msgr2=0x56303f8b9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe668009560 tx=0x7fe668014000 comp rx=0 tx=0).stop 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 -- 172.21.15.77:0/1568622311 shutdown_connections 2024-09-15T23:34:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 --2- 172.21.15.77:0/1568622311 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b9da0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 -- 172.21.15.77:0/1568622311 >> 172.21.15.77:0/1568622311 conn(0x56303f8b5010 msgr2=0x56303f8b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 -- 172.21.15.77:0/1568622311 shutdown_connections 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.756+0000 7fe67da50740 1 -- 172.21.15.77:0/1568622311 wait complete. 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 -- start start 2024-09-15T23:34:53.769 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 Processor -- start 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 0x56303f8c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8cb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x56303f8c2340 con 0x56303f8ba2e0 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56303f7a6290 con 0x56303f8b99a0 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x56303f8c24c0 con 0x56303f8bf370 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe67da50740 10 client.0 _ll_register_callbacks cb 0x56303f7d7140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:53.770 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe673fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe673fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38534/0 (socket says 172.21.15.77:38534) 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe673fff640 1 -- 172.21.15.77:0/272726358 learned_addr learned my addr 172.21.15.77:0/272726358 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.757+0000 7fe679173640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe678972640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 0x56303f8c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 -- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 msgr2=0x56303f8cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 -- 172.21.15.77:0/272726358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 msgr2=0x56303f8c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 0x56303f8c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 -- 172.21.15.77:0/272726358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303f530210 con 0x56303f8ba2e0 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe678972640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 0x56303f8c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe673fff640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe6600bc160 tx=0x7fe6600bc460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e2be2dc4ddf36e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe653fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6600d5060 con 0x56303f8ba2e0 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe6600b8ad0 con 0x56303f8ba2e0 2024-09-15T23:34:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66800e3b0 con 0x56303f8ba2e0 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe660049050 con 0x56303f8ba2e0 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe67da50740 10 client.16092 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56303f5fc620 con 0x56303f8ba2e0 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.758+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800e3b0 con 0x56303f8ba2e0 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe660003c80 con 0x56303f8ba2e0 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 10 client.16092 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 10 client.16092 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 20 client.16092 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f8cf6a0 0x56303f8d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 4 client.16092 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56303f82aa20 con 0x56303f8cf6a0 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe678972640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f8cf6a0 0x56303f8d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe653fff640 10 client.16092 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.759+0000 7fe678972640 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f8cf6a0 0x56303f8d1b00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7746ec77c84603 server_cookie=afa29786788c61ba in_seq=0 out_seq=0 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe653fff640 1 -- 172.21.15.77:0/272726358 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56303f82aa20 con 0x56303f8cf6a0 2024-09-15T23:34:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe653fff640 10 client.16092 handle_command_reply: tid=0 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 client.16092 shutdown 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 msgr2=0x56303f8c40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe6600bc160 tx=0x7fe6600bc460 comp rx=0 tx=0).stop 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 shutdown_connections 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f8cf6a0 0x56303f8d1b00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8ba2e0 0x56303f8c40d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe653fff640 0 client.16092 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 --2- 172.21.15.77:0/272726358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8b99a0 0x56303f8c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 >> 172.21.15.77:0/272726358 conn(0x56303f8b5010 msgr2=0x56303f8b6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.760+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 shutdown_connections 2024-09-15T23:34:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.761+0000 7fe67da50740 1 -- 172.21.15.77:0/272726358 wait complete. 2024-09-15T23:34:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.761+0000 7fe67da50740 20 client.16092 trim_cache size 0 max 16384 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.775+0000 7fe67da50740 1 Processor -- start 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.775+0000 7fe67da50740 1 -- start start 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8d6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741aa8e0 con 0x56303f8b99a0 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741ad160 con 0x56303f8ba2e0 2024-09-15T23:34:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe67da50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741aaf50 con 0x56303f8bf370 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38542/0 (socket says 172.21.15.77:38542) 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 -- 172.21.15.77:0/3277569258 learned_addr learned my addr 172.21.15.77:0/3277569258 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe673fff640 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe679173640 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8d6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 -- 172.21.15.77:0/3277569258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 msgr2=0x56303f8d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8d6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 -- 172.21.15.77:0/3277569258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 msgr2=0x56303f8cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.776+0000 7fe678972640 1 -- 172.21.15.77:0/3277569258 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56303f8ba7c0 con 0x56303f8b99a0 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.777+0000 7fe678972640 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe668009560 tx=0x7fe66800ea60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6ea82c620f3875 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.777+0000 7fe65e7fc640 1 -- 172.21.15.77:0/3277569258 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe66800ebf0 con 0x56303f8b99a0 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.777+0000 7fe65e7fc640 1 -- 172.21.15.77:0/3277569258 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800ee00 con 0x56303f8b99a0 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.777+0000 7fe65e7fc640 1 -- 172.21.15.77:0/3277569258 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668004680 con 0x56303f8b99a0 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- 172.21.15.77:0/3277569258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 msgr2=0x56303f8b40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe668009560 tx=0x7fe66800ea60 comp rx=0 tx=0).stop 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- 172.21.15.77:0/3277569258 shutdown_connections 2024-09-15T23:34:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8d6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- 172.21.15.77:0/3277569258 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8b40b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- 172.21.15.77:0/3277569258 >> 172.21.15.77:0/3277569258 conn(0x56303f8b5010 msgr2=0x56303f8b39a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- 172.21.15.77:0/3277569258 shutdown_connections 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- 172.21.15.77:0/3277569258 wait complete. 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- start start 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 Processor -- start 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741ab620 con 0x56303f8b99a0 2024-09-15T23:34:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741aca90 con 0x56303f8ba2e0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe6741abcf0 con 0x56303f8bf370 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.778+0000 7fe67da50740 10 client.0 _ll_register_callbacks cb 0x7fe660009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38554/0 (socket says 172.21.15.77:38554) 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 -- 172.21.15.77:0/3643024215 learned_addr learned my addr 172.21.15.77:0/3643024215 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe673fff640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe679173640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 -- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 msgr2=0x56303f8c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 -- 172.21.15.77:0/3643024215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 msgr2=0x56303f8c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8c8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 -- 172.21.15.77:0/3643024215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56303f8ca520 con 0x56303f8b99a0 2024-09-15T23:34:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe678972640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe668009e80 tx=0x7fe668009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a57c23505c0a596 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe653fff640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6680090b0 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fe66800ead0 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe66800ee00 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe66801c040 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe67da50740 10 client.16098 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.779+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x56303f93a5b0 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe66800ee00 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fe66802f030 con 0x56303f8b99a0 2024-09-15T23:34:53.789 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 10 client.16098 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 10 client.16098 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.i 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 20 client.16098 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f93ab70 0x56303f93cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 4 client.16098 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56303f824d70 con 0x56303f93ab70 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.780+0000 7fe673fff640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f93ab70 0x56303f93cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.781+0000 7fe653fff640 10 client.16098 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.781+0000 7fe673fff640 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f93ab70 0x56303f93cf90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2c09190562a1be1 server_cookie=a75afbaaef17f949 in_seq=0 out_seq=0 2024-09-15T23:34:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.791+0000 7fe653fff640 1 -- 172.21.15.77:0/3643024215 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56303f824d70 con 0x56303f93ab70 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.791+0000 7fe653fff640 10 client.16098 handle_command_reply: tid=0 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.791+0000 7fe67da50740 1 client.16098 shutdown 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 msgr2=0x56303f8c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe668009e80 tx=0x7fe668009040 comp rx=0 tx=0).stop 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 shutdown_connections 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x56303f93ab70 0x56303f93cf90 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x56303f8bf370 0x56303f8c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56303f8ba2e0 0x56303f8c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 --2- 172.21.15.77:0/3643024215 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x56303f8b99a0 0x56303f8c8a10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 >> 172.21.15.77:0/3643024215 conn(0x56303f8b5010 msgr2=0x56303f8b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe653fff640 0 client.16098 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 shutdown_connections 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 1 -- 172.21.15.77:0/3643024215 wait complete. 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.792+0000 7fe67da50740 20 client.16098 trim_cache size 0 max 16384 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:{ 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "message": "", 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout: "return_code": 0 2024-09-15T23:34:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stdout:} 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 msgr2=0x7fe6640a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 0x7fe6640a57b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe674101a90 tx=0x7fe668005f90 comp rx=0 tx=0).stop 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 msgr2=0x7fe674103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe660009230 tx=0x7fe660031b60 comp rx=0 tx=0).stop 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 shutdown_connections 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fe6640a32f0 0x7fe6640a57b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe6741025f0 0x7fe674103550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fe674101c30 0x7fe674103010 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 --2- 172.21.15.77:0/83095528 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe674100a40 0x7fe6741049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 >> 172.21.15.77:0/83095528 conn(0x7fe6740fc1e0 msgr2=0x7fe6740fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 shutdown_connections 2024-09-15T23:34:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi077.front.sepia.ceph.com.smithi077.stderr:2024-09-15T23:34:53.793+0000 7fe67abd6640 1 -- 172.21.15.77:0/83095528 wait complete. 2024-09-15T23:34:53.841 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 -- 172.21.15.77:0/4035277123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874106f40 msgr2=0x7f687410eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 --2- 172.21.15.77:0/4035277123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874106f40 0x7f687410eac0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f686c009ca0 tx=0x7f686c02a8c0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 -- 172.21.15.77:0/4035277123 shutdown_connections 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 --2- 172.21.15.77:0/4035277123 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874106f40 0x7f687410eac0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 --2- 172.21.15.77:0/4035277123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 0x7f6874106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.326 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 --2- 172.21.15.77:0/4035277123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101e10 0x7f68741021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 -- 172.21.15.77:0/4035277123 >> 172.21.15.77:0/4035277123 conn(0x7f68740fd8d0 msgr2=0x7f68740ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 -- 172.21.15.77:0/4035277123 shutdown_connections 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.309+0000 7f687c696640 1 -- 172.21.15.77:0/4035277123 wait complete. 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 Processor -- start 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 -- start start 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 0x7f6874198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 0x7f687419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6874112040 con 0x7f6874101e10 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111ec0 con 0x7f6874106f40 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687c696640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f68741121c0 con 0x7f68741027c0 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.327 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38560/0 (socket says 172.21.15.77:38560) 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 -- 172.21.15.77:0/2966586471 learned_addr learned my addr 172.21.15.77:0/2966586471 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687ac33640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 0x7f687419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f6879c31640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 0x7f6874198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 -- 172.21.15.77:0/2966586471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 msgr2=0x7f6874198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 0x7f6874198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 -- 172.21.15.77:0/2966586471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 msgr2=0x7f687419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 0x7f687419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 -- 172.21.15.77:0/2966586471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687419d5b0 con 0x7f6874101e10 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687ac33640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 0x7f687419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.310+0000 7f687a432640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f687000b4a0 tx=0x7f687000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.311+0000 7f68677fe640 1 -- 172.21.15.77:0/2966586471 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870014070 con 0x7f6874101e10 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.311+0000 7f68677fe640 1 -- 172.21.15.77:0/2966586471 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6870010af0 con 0x7f6874101e10 2024-09-15T23:34:54.328 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.311+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687419d8a0 con 0x7f6874101e10 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.311+0000 7f68677fe640 1 -- 172.21.15.77:0/2966586471 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870017d10 con 0x7f6874101e10 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.311+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68741a5180 con 0x7f6874101e10 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.313+0000 7f68677fe640 1 -- 172.21.15.77:0/2966586471 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6870017070 con 0x7f6874101e10 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.313+0000 7f687ea6f740 1 Processor -- start 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 -- start start 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c64566a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c6458fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f1c63b0200 con 0x55f1c644ba00 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f1c6356dc0 con 0x55f1c644c320 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ea6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f1c63ac1c0 con 0x55f1c6456be0 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38572/0 (socket says 172.21.15.77:38572) 2024-09-15T23:34:54.329 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f68677fe640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 -- 172.21.15.77:0/3657305505 learned_addr learned my addr 172.21.15.77:0/3657305505 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687a432640 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c64566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f6879c31640 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c6458fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f68677fe640 1 -- 172.21.15.77:0/2966586471 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f68700cf180 con 0x7f6874101e10 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 -- 172.21.15.77:0/3657305505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 msgr2=0x55f1c6458fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c6458fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 -- 172.21.15.77:0/3657305505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 msgr2=0x55f1c64566a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c64566a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.314+0000 7f687ac33640 1 -- 172.21.15.77:0/3657305505 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c6121620 con 0x55f1c644ba00 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.315+0000 7f687ac33640 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f686c035000 tx=0x7f686c003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0744ea3e5df1789 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.315+0000 7f6864ff9640 1 -- 172.21.15.77:0/3657305505 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c041c00 con 0x55f1c644ba00 2024-09-15T23:34:54.330 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.315+0000 7f6864ff9640 1 -- 172.21.15.77:0/3657305505 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686c053070 con 0x55f1c644ba00 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.315+0000 7f6864ff9640 1 -- 172.21.15.77:0/3657305505 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c004db0 con 0x55f1c644ba00 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.315+0000 7f687ac33640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f686c052000 tx=0x7f686c050000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- 172.21.15.77:0/3657305505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 msgr2=0x55f1c644bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f686c035000 tx=0x7f686c003a70 comp rx=0 tx=0).stop 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- 172.21.15.77:0/3657305505 shutdown_connections 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c6458fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c64566a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- 172.21.15.77:0/3657305505 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644bde0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- 172.21.15.77:0/3657305505 >> 172.21.15.77:0/3657305505 conn(0x55f1c6447f90 msgr2=0x55f1c6448370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- 172.21.15.77:0/3657305505 shutdown_connections 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- 172.21.15.77:0/3657305505 wait complete. 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- start start 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 Processor -- start 2024-09-15T23:34:54.331 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644ba00 0x55f1c64564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 0x55f1c6453c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55f1c6459630 con 0x55f1c644c320 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f1c634ac50 con 0x55f1c6456be0 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55f1c64597b0 con 0x55f1c644ba00 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.316+0000 7f687ea6f740 10 client.0 _ll_register_callbacks cb 0x55f1c635cba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38584/0 (socket says 172.21.15.77:38584) 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 -- 172.21.15.77:0/1444970315 learned_addr learned my addr 172.21.15.77:0/1444970315 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687a432640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644ba00 0x55f1c64564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687ac33640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 0x55f1c6453c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 -- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644ba00 msgr2=0x55f1c64564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644ba00 0x55f1c64564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.332 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 -- 172.21.15.77:0/1444970315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 msgr2=0x55f1c6453c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 0x55f1c6453c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 -- 172.21.15.77:0/1444970315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c64544c0 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687ac33640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 0x55f1c6453c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f6879c31640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f686800f4f0 tx=0x7f686800f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2037919ebf94d7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f685dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6868013850 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f68680139f0 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686c053070 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f6868024050 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687ea6f740 10 client.16110 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.317+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f1c64651a0 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f686c053070 con 0x55f1c644c320 2024-09-15T23:34:54.333 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f68680113e0 con 0x55f1c644c320 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 10 client.16110 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 10 client.16110 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 20 client.16110 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64666b0 0x55f1c6468ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 4 client.16110 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f1c63bd770 con 0x55f1c64666b0 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.318+0000 7f687a432640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64666b0 0x55f1c6468ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.319+0000 7f685dffb640 10 client.16110 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.319+0000 7f687a432640 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64666b0 0x55f1c6468ad0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3273b1fbc9aea26 server_cookie=45c64e2aa553a5f4 in_seq=0 out_seq=0 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.319+0000 7f685dffb640 1 -- 172.21.15.77:0/1444970315 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f1c63bd770 con 0x55f1c64666b0 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.319+0000 7f685dffb640 10 client.16110 handle_command_reply: tid=0 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 client.16110 shutdown 2024-09-15T23:34:54.334 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 msgr2=0x55f1c6453750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f686800f4f0 tx=0x7f686800f9b0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 shutdown_connections 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64666b0 0x55f1c6468ad0 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c6456be0 0x55f1c6453c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644c320 0x55f1c6453750 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f685dffb640 0 client.16110 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 --2- 172.21.15.77:0/1444970315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644ba00 0x55f1c64564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 >> 172.21.15.77:0/1444970315 conn(0x55f1c6447f90 msgr2=0x55f1c64471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 shutdown_connections 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 1 -- 172.21.15.77:0/1444970315 wait complete. 2024-09-15T23:34:54.335 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.320+0000 7f687ea6f740 20 client.16110 trim_cache size 0 max 16384 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 Processor -- start 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 -- start start 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c6462890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c646e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68741aac10 con 0x55f1c644ba00 2024-09-15T23:34:54.343 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ad490 con 0x55f1c644c320 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ea6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ab280 con 0x55f1c6456be0 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38590/0 (socket says 172.21.15.77:38590) 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 -- 172.21.15.77:0/249484161 learned_addr learned my addr 172.21.15.77:0/249484161 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f6879c31640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c6462890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ac33640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c646e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 -- 172.21.15.77:0/249484161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 msgr2=0x55f1c646e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c646e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 -- 172.21.15.77:0/249484161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 msgr2=0x55f1c6462890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c6462890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 -- 172.21.15.77:0/249484161 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f1c6447dc0 con 0x55f1c644ba00 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687ac33640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c646e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:54.344 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.337+0000 7f687a432640 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6870017fd0 tx=0x7f6870017730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c484b95bb93ac104 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f685ffff640 1 -- 172.21.15.77:0/249484161 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687001e040 con 0x55f1c644ba00 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f685ffff640 1 -- 172.21.15.77:0/249484161 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68700a4020 con 0x55f1c644ba00 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f685ffff640 1 -- 172.21.15.77:0/249484161 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870097a20 con 0x55f1c644ba00 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- 172.21.15.77:0/249484161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 msgr2=0x55f1c644ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6870017fd0 tx=0x7f6870017730 comp rx=0 tx=0).stop 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- 172.21.15.77:0/249484161 shutdown_connections 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c6456be0 0x55f1c646e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644c320 0x55f1c6462890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 --2- 172.21.15.77:0/249484161 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c644ba00 0x55f1c644ecb0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- 172.21.15.77:0/249484161 >> 172.21.15.77:0/249484161 conn(0x55f1c6447f90 msgr2=0x55f1c64557d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- 172.21.15.77:0/249484161 shutdown_connections 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- 172.21.15.77:0/249484161 wait complete. 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.338+0000 7f687ea6f740 1 -- start start 2024-09-15T23:34:54.345 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 Processor -- start 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 0x55f1c645f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644c320 0x55f1c6450380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ab950 con 0x55f1c6456be0 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68741acdc0 con 0x55f1c644ba00 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ac020 con 0x55f1c644c320 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ea6f740 10 client.0 _ll_register_callbacks cb 0x7f686800ad30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:38606/0 (socket says 172.21.15.77:38606) 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 -- 172.21.15.77:0/2809099230 learned_addr learned my addr 172.21.15.77:0/2809099230 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f6879c31640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644c320 0x55f1c6450380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.346 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 -- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644c320 msgr2=0x55f1c6450380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687a432640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 0x55f1c645f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644c320 0x55f1c6450380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 -- 172.21.15.77:0/2809099230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 msgr2=0x55f1c645f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 0x55f1c645f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 -- 172.21.15.77:0/2809099230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1c6450f60 con 0x55f1c6456be0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687a432640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 0x55f1c645f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f687ac33640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f686c009ca0 tx=0x7f686c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ecaf21080ae9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.339+0000 7f685dffb640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c065060 con 0x55f1c6456be0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f686c041c00 con 0x55f1c6456be0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68700a4020 con 0x55f1c6456be0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f686c06c050 con 0x55f1c6456be0 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 10 client.16116 fetch_fsmap learned FSMap version 21 2024-09-15T23:34:54.347 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55f1c64d1150 con 0x55f1c6456be0 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68700a4020 con 0x55f1c6456be0 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f686c004b40 con 0x55f1c6456be0 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 10 client.16116 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 10 client.16116 resolve_mds: validated gid 24460 aka daemon mds.i 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 20 client.16116 populate_metadata read hostname 'smithi077' 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64d1620 0x55f1c64d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 4 client.16116 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.340+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x55f1c63b7c80 con 0x55f1c64d1620 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f687a432640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64d1620 0x55f1c64d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f687a432640 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64d1620 0x55f1c64d3a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c98702f0578b0894 server_cookie=28268415d0b9db32 in_seq=0 out_seq=0 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f685dffb640 10 client.16116 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f685dffb640 1 -- 172.21.15.77:0/2809099230 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x55f1c63b7c80 con 0x55f1c64d1620 2024-09-15T23:34:54.348 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f685dffb640 10 client.16116 handle_command_reply: tid=0 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f687ea6f740 1 client.16116 shutdown 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 msgr2=0x55f1c64508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.341+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f686c009ca0 tx=0x7f686c009b20 comp rx=0 tx=0).stop 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 shutdown_connections 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55f1c64d1620 0x55f1c64d3a40 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55f1c6456be0 0x55f1c64508c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55f1c644c320 0x55f1c6450380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 --2- 172.21.15.77:0/2809099230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f1c644ba00 0x55f1c645f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 >> 172.21.15.77:0/2809099230 conn(0x55f1c6447f90 msgr2=0x55f1c64471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f685dffb640 0 client.16116 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 shutdown_connections 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 1 -- 172.21.15.77:0/2809099230 wait complete. 2024-09-15T23:34:54.349 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687ea6f740 20 client.16116 trim_cache size 0 max 16384 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 21, 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout: "leader": 24460, 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout: "set_version": 12, 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout: "sets": {} 2024-09-15T23:34:54.350 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 msgr2=0x7f68600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f686c052000 tx=0x7f686c050000 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 msgr2=0x7f6874198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f687000b4a0 tx=0x7f687000b960 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 shutdown_connections 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874106f40 0x7f687419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68741027c0 0x7f6874198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 --2- 172.21.15.77:0/2966586471 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6874101e10 0x7f6874198600 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 >> 172.21.15.77:0/2966586471 conn(0x7f68740fd8d0 msgr2=0x7f68740fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:34:54.351 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 shutdown_connections 2024-09-15T23:34:54.352 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:34:54.342+0000 7f687c696640 1 -- 172.21.15.77:0/2966586471 wait complete. 2024-09-15T23:34:55.097 INFO:tasks.quiescer:done joining Quiescers 2024-09-15T23:34:55.097 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-15T23:34:55.108 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:34:55.116 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-15T23:34:55.146 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-15T23:34:55.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:54 smithi155 ceph-mon[35631]: pgmap v450: 129 pgs: 129 active+clean; 676 KiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 KiB/s wr, 217 op/s 2024-09-15T23:34:55.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:54 smithi077 ceph-mon[30968]: pgmap v450: 129 pgs: 129 active+clean; 676 KiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 KiB/s wr, 217 op/s 2024-09-15T23:34:55.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:54 smithi159 ceph-mon[35472]: pgmap v450: 129 pgs: 129 active+clean; 676 KiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.7 KiB/s wr, 217 op/s 2024-09-15T23:34:57.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:56 smithi155 ceph-mon[35631]: pgmap v451: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-15T23:34:57.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:56 smithi077 ceph-mon[30968]: pgmap v451: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-15T23:34:57.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:56 smithi159 ceph-mon[35472]: pgmap v451: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 4.2 KiB/s wr, 220 op/s 2024-09-15T23:34:59.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:34:58 smithi155 ceph-mon[35631]: pgmap v452: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:34:59.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:34:58 smithi077 ceph-mon[30968]: pgmap v452: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:34:59.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:34:58 smithi159 ceph-mon[35472]: pgmap v452: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:35:01.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:00 smithi155 ceph-mon[35631]: pgmap v453: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:35:01.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:00 smithi077 ceph-mon[30968]: pgmap v453: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:35:01.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:00 smithi159 ceph-mon[35472]: pgmap v453: 129 pgs: 129 active+clean; 693 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 4.0 KiB/s wr, 220 op/s 2024-09-15T23:35:02.299 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-15T23:35:02.563 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:03.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.049+0000 7f17469f7640 1 -- 172.21.15.77:0/4115668012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740102570 msgr2=0x7f17401029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.049+0000 7f17469f7640 1 --2- 172.21.15.77:0/4115668012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740102570 0x7f17401029b0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f1734009900 tx=0x7f173402a480 comp rx=0 tx=0).stop 2024-09-15T23:35:03.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 -- 172.21.15.77:0/4115668012 shutdown_connections 2024-09-15T23:35:03.077 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 --2- 172.21.15.77:0/4115668012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102ef0 0x7f174010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 --2- 172.21.15.77:0/4115668012 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740102570 0x7f17401029b0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 --2- 172.21.15.77:0/4115668012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740100e20 0x7f1740101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 -- 172.21.15.77:0/4115668012 >> 172.21.15.77:0/4115668012 conn(0x7f17400fc7d0 msgr2=0x7f17400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 -- 172.21.15.77:0/4115668012 shutdown_connections 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 -- 172.21.15.77:0/4115668012 wait complete. 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 Processor -- start 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.050+0000 7f17469f7640 1 -- start start 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102570 0x7f1740199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740102ef0 0x7f17401a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1740110f80 con 0x7f1740100e20 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1740110e00 con 0x7f1740102ef0 2024-09-15T23:35:03.078 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f17469f7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1740111100 con 0x7f1740102570 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37824/0 (socket says 172.21.15.77:37824) 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 -- 172.21.15.77:0/1977772409 learned_addr learned my addr 172.21.15.77:0/1977772409 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f1744f94640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740102ef0 0x7f17401a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102570 0x7f1740199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 -- 172.21.15.77:0/1977772409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102570 msgr2=0x7f1740199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102570 0x7f1740199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 -- 172.21.15.77:0/1977772409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740102ef0 msgr2=0x7f17401a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740102ef0 0x7f17401a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 -- 172.21.15.77:0/1977772409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17401a48b0 con 0x7f1740100e20 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.051+0000 7f173ffff640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f173000c920 tx=0x7f173000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.052+0000 7f173d7fa640 1 -- 172.21.15.77:0/1977772409 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730007c70 con 0x7f1740100e20 2024-09-15T23:35:03.079 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.052+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17401a4a80 con 0x7f1740100e20 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.052+0000 7f173d7fa640 1 -- 172.21.15.77:0/1977772409 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1730007e10 con 0x7f1740100e20 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.052+0000 7f173d7fa640 1 -- 172.21.15.77:0/1977772409 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1730018890 con 0x7f1740100e20 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.052+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17401a4fc0 con 0x7f1740100e20 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.054+0000 7f173d7fa640 1 -- 172.21.15.77:0/1977772409 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1730018a70 con 0x7f1740100e20 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.054+0000 7f1748dd0740 1 Processor -- start 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 -- start start 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173d7fa640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 0x7f17280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb5112550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb5114e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.080 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfb50692e0 con 0x55dfb5103380 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dfb5010ce0 con 0x55dfb5103ca0 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1748dd0740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dfb50652a0 con 0x55dfb5112a90 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173d7fa640 1 -- 172.21.15.77:0/1977772409 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f17300cfea0 con 0x7f1740100e20 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1744f94640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 0x7f17280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37838/0 (socket says 172.21.15.77:37838) 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 -- 172.21.15.77:0/471320945 learned_addr learned my addr 172.21.15.77:0/471320945 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173f7fe640 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb5112550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1744f94640 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb5114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 -- 172.21.15.77:0/471320945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 msgr2=0x55dfb5114e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb5114e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 -- 172.21.15.77:0/471320945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 msgr2=0x55dfb5112550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb5112550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f173ffff640 1 -- 172.21.15.77:0/471320945 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb4ff5440 con 0x55dfb5103380 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.055+0000 7f1744f94640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 0x7f17280a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17380092f0 tx=0x7f1738010740 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.056+0000 7f173ffff640 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f173009c0c0 tx=0x7f173009c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03ee51d21a4ad9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.056+0000 7f17267fc640 1 -- 172.21.15.77:0/471320945 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300a4da0 con 0x55dfb5103380 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.056+0000 7f17267fc640 1 -- 172.21.15.77:0/471320945 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173009a430 con 0x55dfb5103380 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.056+0000 7f17267fc640 1 -- 172.21.15.77:0/471320945 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300bc070 con 0x55dfb5103380 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- 172.21.15.77:0/471320945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 msgr2=0x55dfb5103760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f173009c0c0 tx=0x7f173009c8f0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- 172.21.15.77:0/471320945 shutdown_connections 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb5114e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb5112550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 --2- 172.21.15.77:0/471320945 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5103760 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- 172.21.15.77:0/471320945 >> 172.21.15.77:0/471320945 conn(0x55dfb50ffa30 msgr2=0x55dfb50ffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- 172.21.15.77:0/471320945 shutdown_connections 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- 172.21.15.77:0/471320945 wait complete. 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 -- start start 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.057+0000 7f1748dd0740 1 Processor -- start 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb510f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x55dfb5115660 con 0x55dfb5103380 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dfb5024050 con 0x55dfb5103ca0 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55dfb51157e0 con 0x55dfb5112a90 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 10 client.0 _ll_register_callbacks cb 0x55dfb5064160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37850/0 (socket says 172.21.15.77:37850) 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 -- 172.21.15.77:0/1075734181 learned_addr learned my addr 172.21.15.77:0/1075734181 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb510f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1744f94640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 -- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 msgr2=0x55dfb510fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 -- 172.21.15.77:0/1075734181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 msgr2=0x55dfb510f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb510f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 -- 172.21.15.77:0/1075734181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb4dda3c0 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1744f94640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f173ffff640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f17300a4870 tx=0x7f17300a0170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5a5823b7394cc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f171f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17300987a0 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f17300a4910 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.058+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173009a430 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1730082050 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 10 client.16128 fetch_fsmap learned FSMap version 21 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfb5121090 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f173009a430 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f17300cdad0 con 0x55dfb5103380 2024-09-15T23:35:03.085 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 10 client.16128 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 20 client.16128 populate_metadata read hostname 'smithi077' 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb51247d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 4 client.16128 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfb5076850 con 0x55dfb51223e0 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.059+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb51247d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.060+0000 7f171f7fe640 10 client.16128 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.060+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb51247d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e425f3cedebee159 server_cookie=a3d11567586699ff in_seq=0 out_seq=0 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f171f7fe640 1 -- 172.21.15.77:0/1075734181 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfb5076850 con 0x55dfb51223e0 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f171f7fe640 10 client.16128 handle_command_reply: tid=0 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 client.16128 shutdown 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 msgr2=0x55dfb5112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f17300a4870 tx=0x7f17300a0170 comp rx=0 tx=0).stop 2024-09-15T23:35:03.086 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 shutdown_connections 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb51247d0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f171f7fe640 0 client.16128 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103ca0 0x55dfb510f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1075734181 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103380 0x55dfb5112410 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 >> 172.21.15.77:0/1075734181 conn(0x55dfb50ffa30 msgr2=0x55dfb5105790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 shutdown_connections 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 1 -- 172.21.15.77:0/1075734181 wait complete. 2024-09-15T23:35:03.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.061+0000 7f1748dd0740 20 client.16128 trim_cache size 0 max 16384 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 Processor -- start 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 -- start start 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb51277f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17401aaa80 con 0x55dfb5103ca0 2024-09-15T23:35:03.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ad300 con 0x55dfb5103380 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f1748dd0740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ab0f0 con 0x55dfb5112a90 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.079+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37860/0 (socket says 172.21.15.77:37860) 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 -- 172.21.15.77:0/1401638054 learned_addr learned my addr 172.21.15.77:0/1401638054 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f1744f94640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173ffff640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb51277f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 -- 172.21.15.77:0/1401638054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 msgr2=0x55dfb510c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 -- 172.21.15.77:0/1401638054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 msgr2=0x55dfb51277f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb51277f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 -- 172.21.15.77:0/1401638054 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfb510ffb0 con 0x55dfb5103ca0 2024-09-15T23:35:03.093 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173ffff640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb51277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f173f7fe640 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1734009230 tx=0x7f17340058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8358aac0573da0b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f1725ffb640 1 -- 172.21.15.77:0/1401638054 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734035040 con 0x55dfb5103ca0 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f1725ffb640 1 -- 172.21.15.77:0/1401638054 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1734049070 con 0x55dfb5103ca0 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.080+0000 7f1725ffb640 1 -- 172.21.15.77:0/1401638054 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734031540 con 0x55dfb5103ca0 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- 172.21.15.77:0/1401638054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 msgr2=0x55dfb5127d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1734009230 tx=0x7f17340058d0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- 172.21.15.77:0/1401638054 shutdown_connections 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb510c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5127d30 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 --2- 172.21.15.77:0/1401638054 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb51277f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- 172.21.15.77:0/1401638054 >> 172.21.15.77:0/1401638054 conn(0x55dfb50ffa30 msgr2=0x55dfb510e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- 172.21.15.77:0/1401638054 shutdown_connections 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- 172.21.15.77:0/1401638054 wait complete. 2024-09-15T23:35:03.094 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.081+0000 7f1748dd0740 1 -- start start 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 Processor -- start 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb5125000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb51275d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f17401ab7c0 con 0x55dfb5103ca0 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17401acc30 con 0x55dfb5103380 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17401abe90 con 0x55dfb5112a90 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f1748dd0740 10 client.0 _ll_register_callbacks cb 0x7f1734009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f173f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37866/0 (socket says 172.21.15.77:37866) 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f173f7fe640 1 -- 172.21.15.77:0/4042162809 learned_addr learned my addr 172.21.15.77:0/4042162809 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.082+0000 7f173ffff640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb5125000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.095 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f1744f94640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb51275d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 -- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 msgr2=0x55dfb51275d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb51275d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 -- 172.21.15.77:0/4042162809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 msgr2=0x55dfb5125000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb5125000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 -- 172.21.15.77:0/4042162809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfb5127c10 con 0x55dfb5103ca0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173ffff640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb5125000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f173f7fe640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f17340092a0 tx=0x7f1734000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef0a766973c875a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f171f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734051020 con 0x55dfb5103ca0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1734049070 con 0x55dfb5103ca0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f1734004d40 con 0x55dfb5103ca0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1734035040 con 0x55dfb5103ca0 2024-09-15T23:35:03.096 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f1748dd0740 10 client.16134 fetch_fsmap learned FSMap version 21 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x55dfb518c800 con 0x55dfb5103ca0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.083+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1734049070 con 0x55dfb5103ca0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7f1734031a80 con 0x55dfb5103ca0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 10 client.16134 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 10 client.16134 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 20 client.16134 populate_metadata read hostname 'smithi077' 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb518eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 4 client.16134 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dfb5070d60 con 0x55dfb51223e0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.084+0000 7f173ffff640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb518eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f173ffff640 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb518eeb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5e62e853e5b3f66 server_cookie=1e3ede72ea03d5d in_seq=0 out_seq=0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f171f7fe640 10 client.16134 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f171f7fe640 1 -- 172.21.15.77:0/4042162809 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dfb5070d60 con 0x55dfb51223e0 2024-09-15T23:35:03.097 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f171f7fe640 10 client.16134 handle_command_reply: tid=0 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 client.16134 shutdown 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 msgr2=0x55dfb5125540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f17340092a0 tx=0x7f1734000bc0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 shutdown_connections 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x55dfb51223e0 0x55dfb518eeb0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f171f7fe640 0 client.16134 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55dfb5112a90 0x55dfb51275d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x55dfb5103ca0 0x55dfb5125540 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 --2- 172.21.15.77:0/4042162809 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfb5103380 0x55dfb5125000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 >> 172.21.15.77:0/4042162809 conn(0x55dfb50ffa30 msgr2=0x55dfb50fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 shutdown_connections 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 1 -- 172.21.15.77:0/4042162809 wait complete. 2024-09-15T23:35:03.098 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.085+0000 7f1748dd0740 20 client.16134 trim_cache size 0 max 16384 2024-09-15T23:35:03.099 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:35:03.099 INFO:teuthology.orchestra.run.smithi077.stdout: "status": "no active scrubs running", 2024-09-15T23:35:03.099 INFO:teuthology.orchestra.run.smithi077.stdout: "scrubs": {} 2024-09-15T23:35:03.099 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 msgr2=0x7f17280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 0x7f17280a5700 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17380092f0 tx=0x7f1738010740 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 msgr2=0x7f17401992f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f173000c920 tx=0x7f173000cde0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 shutdown_connections 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f17280a3240 0x7f17280a5700 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1740102ef0 0x7f17401a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1740102570 0x7f1740199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 --2- 172.21.15.77:0/1977772409 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1740100e20 0x7f17401992f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 >> 172.21.15.77:0/1977772409 conn(0x7f17400fc7d0 msgr2=0x7f1740106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:03.100 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 shutdown_connections 2024-09-15T23:35:03.101 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:03.086+0000 7f17469f7640 1 -- 172.21.15.77:0/1977772409 wait complete. 2024-09-15T23:35:03.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:02 smithi155 ceph-mon[35631]: pgmap v454: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.1 KiB/s wr, 164 op/s 2024-09-15T23:35:03.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:02 smithi077 ceph-mon[30968]: pgmap v454: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.1 KiB/s wr, 164 op/s 2024-09-15T23:35:03.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:02 smithi159 ceph-mon[35472]: pgmap v454: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 4.1 KiB/s wr, 164 op/s 2024-09-15T23:35:03.903 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-15T23:35:03.903 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:35:04.151 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 -- 172.21.15.77:0/3108840562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 msgr2=0x7f291c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 --2- 172.21.15.77:0/3108840562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c103170 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f290c009cd0 tx=0x7f290c02a8e0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 -- 172.21.15.77:0/3108840562 shutdown_connections 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 --2- 172.21.15.77:0/3108840562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c108290 0x7f291c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 --2- 172.21.15.77:0/3108840562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c103740 0x7f291c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 --2- 172.21.15.77:0/3108840562 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c103170 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 -- 172.21.15.77:0/3108840562 >> 172.21.15.77:0/3108840562 conn(0x7f291c0fc7d0 msgr2=0x7f291c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 -- 172.21.15.77:0/3108840562 shutdown_connections 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.639+0000 7f2920f9f640 1 -- 172.21.15.77:0/3108840562 wait complete. 2024-09-15T23:35:04.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 Processor -- start 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 -- start start 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c103740 0x7f291c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 0x7f291c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f291c1120d0 con 0x7f291c102d90 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f291c111f50 con 0x7f291c103740 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2920f9f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f291c112250 con 0x7f291c108290 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37886/0 (socket says 172.21.15.77:37886) 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 -- 172.21.15.77:0/2606531729 learned_addr learned my addr 172.21.15.77:0/2606531729 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291ad9d640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 0x7f291c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f2919d9b640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c103740 0x7f291c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:04.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 -- 172.21.15.77:0/2606531729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 msgr2=0x7f291c19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 0x7f291c19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 -- 172.21.15.77:0/2606531729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c103740 msgr2=0x7f291c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c103740 0x7f291c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 -- 172.21.15.77:0/2606531729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291c19d5f0 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291ad9d640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 0x7f291c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.640+0000 7f291a59c640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f290c02ae00 tx=0x7f290c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.641+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c004240 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.641+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f290c0305a0 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.641+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291c19d880 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.641+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c03a660 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.641+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291c1a51c0 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.642+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291c06a7f0 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.643+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f290c030ac0 con 0x7f291c102d90 2024-09-15T23:35:04.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.643+0000 7f290b7fe640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.643+0000 7f2919d9b640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.644+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f290c02e030 con 0x7f291c102d90 2024-09-15T23:35:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.644+0000 7f2919d9b640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 0x7f29040a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f291c0fee80 tx=0x7f2910008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:04.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.648+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f290c0098b0 con 0x7f291c102d90 2024-09-15T23:35:04.849 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.848+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f291c10a2a0 con 0x7f291c102d90 2024-09-15T23:35:04.850 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.849+0000 7f290b7fe640 1 -- 172.21.15.77:0/2606531729 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f290c0bd980 con 0x7f291c102d90 2024-09-15T23:35:04.851 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:04.851 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:35:04.851 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:35:04.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 msgr2=0x7f29040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:04.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 0x7f29040a5700 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f291c0fee80 tx=0x7f2910008040 comp rx=0 tx=0).stop 2024-09-15T23:35:04.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 msgr2=0x7f291c198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:04.852 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f290c02ae00 tx=0x7f290c003ba0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 shutdown_connections 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f29040a3240 0x7f29040a5700 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f291c108290 0x7f291c19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f291c103740 0x7f291c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 --2- 172.21.15.77:0/2606531729 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f291c102d90 0x7f291c198640 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 >> 172.21.15.77:0/2606531729 conn(0x7f291c0fc7d0 msgr2=0x7f291c105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 shutdown_connections 2024-09-15T23:35:04.853 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:04.851+0000 7f2920f9f640 1 -- 172.21.15.77:0/2606531729 wait complete. 2024-09-15T23:35:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:04 smithi077 ceph-mon[30968]: pgmap v455: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-09-15T23:35:05.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:04 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2606531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:05.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:04 smithi155 ceph-mon[35631]: pgmap v455: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-09-15T23:35:05.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:04 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2606531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:05.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:04 smithi159 ceph-mon[35472]: pgmap v455: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.2 KiB/s wr, 44 op/s 2024-09-15T23:35:05.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:04 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2606531729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:05.520 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-15T23:35:05.765 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 -- 172.21.15.77:0/703697255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 msgr2=0x7fd250103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 --2- 172.21.15.77:0/703697255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd250103120 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd244009900 tx=0x7fd24402a480 comp rx=0 tx=0).stop 2024-09-15T23:35:06.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 -- 172.21.15.77:0/703697255 shutdown_connections 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 --2- 172.21.15.77:0/703697255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 --2- 172.21.15.77:0/703697255 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 0x7fd25010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 --2- 172.21.15.77:0/703697255 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd250103120 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 -- 172.21.15.77:0/703697255 >> 172.21.15.77:0/703697255 conn(0x7fd2500fc7a0 msgr2=0x7fd2500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 -- 172.21.15.77:0/703697255 shutdown_connections 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.250+0000 7fd255c46640 1 -- 172.21.15.77:0/703697255 wait complete. 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 Processor -- start 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 -- start start 2024-09-15T23:35:06.263 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 0x7fd2501989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd250111fd0 con 0x7fd250102d40 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd250111e50 con 0x7fd25010c170 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd255c46640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd250112150 con 0x7fd250103660 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd24f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd24f7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37898/0 (socket says 172.21.15.77:37898) 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd24f7fe640 1 -- 172.21.15.77:0/626179517 learned_addr learned my addr 172.21.15.77:0/626179517 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.251+0000 7fd24effd640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 0x7fd2501989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24ffff640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 -- 172.21.15.77:0/626179517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 msgr2=0x7fd2501989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.264 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 0x7fd2501989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 -- 172.21.15.77:0/626179517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 msgr2=0x7fd25019cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25019cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 -- 172.21.15.77:0/626179517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd25019d460 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24ffff640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd244006010 tx=0x7fd2440042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24cff9640 1 -- 172.21.15.77:0/626179517 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24403f030 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd25019d6f0 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24cff9640 1 -- 172.21.15.77:0/626179517 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd244003ce0 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd24cff9640 1 -- 172.21.15.77:0/626179517 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244035070 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.252+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2501a5030 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.254+0000 7fd24cff9640 1 -- 172.21.15.77:0/626179517 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fd244042030 con 0x7fd250102d40 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.254+0000 7fd25801f740 1 Processor -- start 2024-09-15T23:35:06.265 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 -- start start 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de004ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 0x564de005db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564ddffb22f0 con 0x564de004db40 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564ddff59cf0 con 0x564de004c5d0 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd25801f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564ddffae2b0 con 0x564de005b780 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24cff9640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 0x7fd2380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37902/0 (socket says 172.21.15.77:37902) 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 -- 172.21.15.77:0/4033422501 learned_addr learned my addr 172.21.15.77:0/4033422501 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 0x7fd2380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24effd640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 0x564de005db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.266 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24cff9640 1 -- 172.21.15.77:0/626179517 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fd2440f0380 con 0x7fd250102d40 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de004ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 -- 172.21.15.77:0/4033422501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 msgr2=0x564de005db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 0x564de005db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 -- 172.21.15.77:0/4033422501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 msgr2=0x564de004ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de004ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24ffff640 1 -- 172.21.15.77:0/4033422501 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ddff3e3a0 con 0x564de004db40 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.255+0000 7fd24effd640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 0x564de005db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd24ffff640 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd248014e40 tx=0x7fd248011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76df7e5f3a472849 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd24ffff640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 0x7fd2380a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd248009fd0 tx=0x7fd248016000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd235ffb640 1 -- 172.21.15.77:0/4033422501 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24800cc00 con 0x564de004db40 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd235ffb640 1 -- 172.21.15.77:0/4033422501 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd24800cda0 con 0x564de004db40 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd235ffb640 1 -- 172.21.15.77:0/4033422501 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248005310 con 0x564de004db40 2024-09-15T23:35:06.267 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 -- 172.21.15.77:0/4033422501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 msgr2=0x564de004c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fd248014e40 tx=0x7fd248011750 comp rx=0 tx=0).stop 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 -- 172.21.15.77:0/4033422501 shutdown_connections 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de005b780 0x564de005db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de004ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 --2- 172.21.15.77:0/4033422501 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de004c090 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.256+0000 7fd25801f740 1 -- 172.21.15.77:0/4033422501 >> 172.21.15.77:0/4033422501 conn(0x564de0015310 msgr2=0x564de0048c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- 172.21.15.77:0/4033422501 shutdown_connections 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- 172.21.15.77:0/4033422501 wait complete. 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- start start 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 Processor -- start 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de005b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.268 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de005b780 0x564de0058bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x564de005e420 con 0x564de004db40 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564ddff6d060 con 0x564de005b780 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564de005e5a0 con 0x564de004c5d0 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd25801f740 10 client.0 _ll_register_callbacks cb 0x564ddfcc08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd24effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd24effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37906/0 (socket says 172.21.15.77:37906) 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.257+0000 7fd24effd640 1 -- 172.21.15.77:0/322091978 learned_addr learned my addr 172.21.15.77:0/322091978 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de005b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24ffff640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de005b780 0x564de0058bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 -- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 msgr2=0x564de005b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de005b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.269 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 -- 172.21.15.77:0/322091978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de005b780 msgr2=0x564de0058bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de005b780 0x564de0058bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 -- 172.21.15.77:0/322091978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ddfd233c0 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd24effd640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd24000bea0 tx=0x7fd24000f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb1d58ba9afc73a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd22effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd240018020 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fd240014660 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd24800cda0 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd240023050 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd25801f740 10 client.16152 fetch_fsmap learned FSMap version 21 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564de0069f60 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.258+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd24800cda0 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd240013a30 con 0x564de004db40 2024-09-15T23:35:06.270 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 10 client.16152 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:35:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 10 client.16152 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:35:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 20 client.16152 populate_metadata read hostname 'smithi077' 2024-09-15T23:35:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de006b4c0 0x564de006d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 4 client.16152 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T23:35:06.271 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ddffbf860 con 0x564de006b4c0 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de006b4c0 0x564de006d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de006b4c0 0x564de006d8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8761c301290e37b3 server_cookie=1ff65c13ce553c38 in_seq=0 out_seq=0 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.259+0000 7fd22effd640 10 client.16152 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd22effd640 1 -- 172.21.15.77:0/322091978 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564ddffbf860 con 0x564de006b4c0 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd22effd640 10 client.16152 handle_command_reply: tid=0 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 client.16152 shutdown 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 msgr2=0x564de0058460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd24000bea0 tx=0x7fd24000f5b0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 shutdown_connections 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de006b4c0 0x564de006d8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de005b780 0x564de0058bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de004db40 0x564de0058460 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.272 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd22effd640 0 client.16152 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 --2- 172.21.15.77:0/322091978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de005b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 >> 172.21.15.77:0/322091978 conn(0x564de0015310 msgr2=0x564de004e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 shutdown_connections 2024-09-15T23:35:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.260+0000 7fd25801f740 1 -- 172.21.15.77:0/322091978 wait complete. 2024-09-15T23:35:06.273 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.261+0000 7fd25801f740 20 client.16152 trim_cache size 0 max 16384 2024-09-15T23:35:06.275 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.273+0000 7fd25801f740 1 Processor -- start 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.273+0000 7fd25801f740 1 -- start start 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.273+0000 7fd25801f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de0058430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.273+0000 7fd25801f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004db40 0x564de00731b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd25801f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd25801f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501aab30 con 0x564de005b780 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd25801f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501ad3b0 con 0x564de004db40 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd25801f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501ab1a0 con 0x564de004c5d0 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37908/0 (socket says 172.21.15.77:37908) 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 -- 172.21.15.77:0/600207990 learned_addr learned my addr 172.21.15.77:0/600207990 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:06.276 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24effd640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004db40 0x564de00731b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de0058430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 -- 172.21.15.77:0/600207990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 msgr2=0x564de0058430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de0058430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 -- 172.21.15.77:0/600207990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004db40 msgr2=0x564de00731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004db40 0x564de00731b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 -- 172.21.15.77:0/600207990 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564de0048510 con 0x564de005b780 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de0058430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd24ffff640 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd248014e10 tx=0x7fd248009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788d71da3a277c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd2357fa640 1 -- 172.21.15.77:0/600207990 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248014990 con 0x564de005b780 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd2357fa640 1 -- 172.21.15.77:0/600207990 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd24800cc00 con 0x564de005b780 2024-09-15T23:35:06.277 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.274+0000 7fd2357fa640 1 -- 172.21.15.77:0/600207990 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480052a0 con 0x564de005b780 2024-09-15T23:35:06.281 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- 172.21.15.77:0/600207990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 msgr2=0x564de00736f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd248014e10 tx=0x7fd248009450 comp rx=0 tx=0).stop 2024-09-15T23:35:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- 172.21.15.77:0/600207990 shutdown_connections 2024-09-15T23:35:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de00736f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004db40 0x564de00731b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.282 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 --2- 172.21.15.77:0/600207990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004c5d0 0x564de0058430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- 172.21.15.77:0/600207990 >> 172.21.15.77:0/600207990 conn(0x564de0015310 msgr2=0x564de0057d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.283 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- 172.21.15.77:0/600207990 shutdown_connections 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- 172.21.15.77:0/600207990 wait complete. 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.275+0000 7fd25801f740 1 -- start start 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 Processor -- start 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de0063d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004db40 0x564de005f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501ab870 con 0x564de005b780 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501acce0 con 0x564de004c5d0 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd2501abf40 con 0x564de004db40 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.284 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd25801f740 10 client.0 _ll_register_callbacks cb 0x7fd25006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:37920/0 (socket says 172.21.15.77:37920) 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 -- 172.21.15.77:0/240367978 learned_addr learned my addr 172.21.15.77:0/240367978 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de0063d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24effd640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004db40 0x564de005f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 -- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004db40 msgr2=0x564de005f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004db40 0x564de005f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 -- 172.21.15.77:0/240367978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 msgr2=0x564de0063d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de0063d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.276+0000 7fd24ffff640 1 -- 172.21.15.77:0/240367978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564de005fb10 con 0x564de005b780 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd24ffff640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd248011790 tx=0x7fd248014cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530a8c3c66d0dac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:06.285 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 10 client.0 ms_handle_connect on v2:172.21.15.77:3300/0 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2480049c0 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mon.0 v2:172.21.15.77:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fd248004b60 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd24800cc00 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd248004d60 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 10 client.16158 fetch_fsmap learned FSMap version 21 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=4+}) -- 0x564de00d5e90 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mon.0 v2:172.21.15.77:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd24800cc00 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mon.0 v2:172.21.15.77:3300/0 5 ==== fsmap(e 21) ==== 8338+0+0 (secure 0 0 0) 0x7fd24802e020 con 0x564de005b780 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 10 client.16158 fetch_fsmap finished waiting for FSMap version 21 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 10 client.16158 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.i 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 20 client.16158 populate_metadata read hostname 'smithi077' 2024-09-15T23:35:06.286 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de00d6300 0x564de00d86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 4 client.16158 mds_command: new command op to 24460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 --> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564ddffb9d70 con 0x564de00d6300 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.277+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de00d6300 0x564de00d86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd24f7fe640 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de00d6300 0x564de00d86f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c91572681c2ec2 server_cookie=f87ff5c94fc6f9c8 in_seq=0 out_seq=0 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd22effd640 10 client.16158 ms_handle_connect on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd22effd640 1 -- 172.21.15.77:0/240367978 <== mds.0 v2:172.21.15.159:6838/2481115545 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564ddffb9d70 con 0x564de00d6300 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd22effd640 10 client.16158 handle_command_reply: tid=0 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 client.16158 shutdown 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 msgr2=0x564de005f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.287 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd248011790 tx=0x7fd248014cc0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 shutdown_connections 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:6838/2481115545,v1:172.21.15.159:6839/2481115545] conn(0x564de00d6300 0x564de00d86f0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x564de005b780 0x564de005f5a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd22effd640 0 client.16158 ms_handle_reset on v2:172.21.15.159:6838/2481115545 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564de004db40 0x564de005f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 --2- 172.21.15.77:0/240367978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564de004c5d0 0x564de0063d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 >> 172.21.15.77:0/240367978 conn(0x564de0015310 msgr2=0x564de0056d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 shutdown_connections 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 1 -- 172.21.15.77:0/240367978 wait complete. 2024-09-15T23:35:06.288 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.278+0000 7fd25801f740 20 client.16158 trim_cache size 0 max 16384 2024-09-15T23:35:06.289 INFO:teuthology.orchestra.run.smithi077.stdout:[] 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 msgr2=0x7fd2380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 0x7fd2380a5700 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fd248009fd0 tx=0x7fd248016000 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 msgr2=0x7fd2501984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fd244006010 tx=0x7fd2440042f0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 shutdown_connections 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fd2380a3240 0x7fd2380a5700 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd25010c170 0x7fd25019cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd250103660 0x7fd2501989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 --2- 172.21.15.77:0/626179517 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fd250102d40 0x7fd2501984b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 >> 172.21.15.77:0/626179517 conn(0x7fd2500fc7a0 msgr2=0x7fd2500fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:06.290 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 shutdown_connections 2024-09-15T23:35:06.291 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:06.279+0000 7fd255c46640 1 -- 172.21.15.77:0/626179517 wait complete. 2024-09-15T23:35:07.097 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-15T23:35:07.098 INFO:tasks.fwd_scrub:done joining 2024-09-15T23:35:07.098 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-15T23:35:07.108 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T23:35:07.212 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 -- 172.21.15.77:0/469695671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0101c20 msgr2=0x7f41f01020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 --2- 172.21.15.77:0/469695671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0101c20 0x7f41f01020a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009900 tx=0x7f41e402a410 comp rx=0 tx=0).stop 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 -- 172.21.15.77:0/469695671 shutdown_connections 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 --2- 172.21.15.77:0/469695671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f01025e0 0x7f41f0108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 --2- 172.21.15.77:0/469695671 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0101c20 0x7f41f01020a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 --2- 172.21.15.77:0/469695671 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f0100a30 0x7f41f0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 -- 172.21.15.77:0/469695671 >> 172.21.15.77:0/469695671 conn(0x7f41f00fc190 msgr2=0x7f41f00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 -- 172.21.15.77:0/469695671 shutdown_connections 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.208+0000 7f41f87d6640 1 -- 172.21.15.77:0/469695671 wait complete. 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 Processor -- start 2024-09-15T23:35:07.213 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 -- start start 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f0101c20 0x7f41f01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 0x7f41f019f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d840 con 0x7f41f0100a30 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d6c0 con 0x7f41f0101c20 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f87d6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f41f010d9c0 con 0x7f41f01025e0 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56026/0 (socket says 172.21.15.77:56026) 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 -- 172.21.15.77:0/2236691660 learned_addr learned my addr 172.21.15.77:0/2236691660 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6d73640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 0x7f41f019f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f5d71640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f0101c20 0x7f41f01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 -- 172.21.15.77:0/2236691660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 msgr2=0x7f41f019f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.214 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 0x7f41f019f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 -- 172.21.15.77:0/2236691660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f0101c20 msgr2=0x7f41f01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f0101c20 0x7f41f01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6572640 1 -- 172.21.15.77:0/2236691660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f019fb80 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.209+0000 7f41f6d73640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 0x7f41f019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41f6572640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f41e800b450 tx=0x7f41e800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8015020 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f41e8011d70 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e800f340 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f019fe70 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.210+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f01a0360 con 0x7f41f0100a30 2024-09-15T23:35:07.215 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.211+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f0107e70 con 0x7f41f0100a30 2024-09-15T23:35:07.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.212+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f41e8018020 con 0x7f41f0100a30 2024-09-15T23:35:07.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.212+0000 7f41ef7fe640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 0x7f41d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.213+0000 7f41f5d71640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 0x7f41d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.213+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f41e80cf740 con 0x7f41f0100a30 2024-09-15T23:35:07.216 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.213+0000 7f41f5d71640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 0x7f41d80a5790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41f0199470 tx=0x7f41e40315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.218 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.217+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f41e801f020 con 0x7f41f0100a30 2024-09-15T23:35:07.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:06 smithi155 ceph-mon[35631]: pgmap v456: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-15T23:35:07.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:06 smithi077 ceph-mon[30968]: pgmap v456: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-15T23:35:07.385 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.384+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41f0062e90 con 0x7f41f0100a30 2024-09-15T23:35:07.386 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.385+0000 7f41ef7fe640 1 -- 172.21.15.77:0/2236691660 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7f41e800d040 con 0x7f41f0100a30 2024-09-15T23:35:07.387 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:07.387 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 msgr2=0x7f41d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 0x7f41d80a5790 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f41f0199470 tx=0x7f41e40315b0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 msgr2=0x7f41f0197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f41e800b450 tx=0x7f41e800b910 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 shutdown_connections 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f41d80a32d0 0x7f41d80a5790 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f41f01025e0 0x7f41f019f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f41f0101c20 0x7f41f01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 --2- 172.21.15.77:0/2236691660 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f41f0100a30 0x7f41f0197f60 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.389 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 >> 172.21.15.77:0/2236691660 conn(0x7f41f00fc190 msgr2=0x7f41f0105040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 shutdown_connections 2024-09-15T23:35:07.390 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.387+0000 7f41f87d6640 1 -- 172.21.15.77:0/2236691660 wait complete. 2024-09-15T23:35:07.400 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T23:24:50.012656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T23:29:26.912021+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T23:29:29.489806+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T23:29:35.970801+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T23:35:07.401 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T23:35:07.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:06 smithi159 ceph-mon[35472]: pgmap v456: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 3.2 KiB/s wr, 6 op/s 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 -- 172.21.15.77:0/394396372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 msgr2=0x7fcbd4102430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 --2- 172.21.15.77:0/394396372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd4102430 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0009900 tx=0x7fcbd002a410 comp rx=0 tx=0).stop 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 -- 172.21.15.77:0/394396372 shutdown_connections 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 --2- 172.21.15.77:0/394396372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 0x7fcbd4108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 --2- 172.21.15.77:0/394396372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd4101100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 --2- 172.21.15.77:0/394396372 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd4102430 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 -- 172.21.15.77:0/394396372 >> 172.21.15.77:0/394396372 conn(0x7fcbd40fb900 msgr2=0x7fcbd40fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.507 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 -- 172.21.15.77:0/394396372 shutdown_connections 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.503+0000 7fcbdc277640 1 -- 172.21.15.77:0/394396372 wait complete. 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 Processor -- start 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 -- start start 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd41006e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 0x7fcbd419cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410c690 con 0x7fcbd4102030 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410c510 con 0x7fcbd4101640 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbdc277640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcbd410c810 con 0x7fcbd4100c80 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56032/0 (socket says 172.21.15.77:56032) 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 -- 172.21.15.77:0/4256327334 learned_addr learned my addr 172.21.15.77:0/4256327334 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda013640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd41006e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.508 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 -- 172.21.15.77:0/4256327334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 msgr2=0x7fcbd41006e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd41006e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 -- 172.21.15.77:0/4256327334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 msgr2=0x7fcbd419cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbd9812640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 0x7fcbd419cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.504+0000 7fcbda814640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 0x7fcbd419cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbda814640 1 -- 172.21.15.77:0/4256327334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbd419fb10 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbda013640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd41006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbda814640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00eb10 tx=0x7fcbcc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc004b20 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbd419fda0 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcbcc004cc0 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc010760 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.505+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbd41a0260 con 0x7fcbd4102030 2024-09-15T23:35:07.509 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.506+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbd4107e80 con 0x7fcbd4102030 2024-09-15T23:35:07.510 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.508+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fcbcc010900 con 0x7fcbd4102030 2024-09-15T23:35:07.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.508+0000 7fcbcb7fe640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 0x7fcbc00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.508+0000 7fcbda013640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 0x7fcbc00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.509+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7fcbcc0d0500 con 0x7fcbd4102030 2024-09-15T23:35:07.512 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.509+0000 7fcbda013640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 0x7fcbc00a5790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0000c00 tx=0x7fcbd0031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.513 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.512+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fcbcc0541b0 con 0x7fcbd4102030 2024-09-15T23:35:07.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.677+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcbd402da10 con 0x7fcbd4102030 2024-09-15T23:35:07.678 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.677+0000 7fcbcb7fe640 1 -- 172.21.15.77:0/4256327334 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) ==== 93+0+10 (secure 0 0 0) 0x7fcbcc09ce90 con 0x7fcbd4102030 2024-09-15T23:35:07.678 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 1 2024-09-15T23:35:07.680 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 msgr2=0x7fcbc00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 0x7fcbc00a5790 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fcbd0000c00 tx=0x7fcbd0031400 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 msgr2=0x7fcbd419f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00eb10 tx=0x7fcbcc00c2d0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 shutdown_connections 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fcbc00a32d0 0x7fcbc00a5790 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fcbd4102030 0x7fcbd419f200 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcbd4101640 0x7fcbd419cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 --2- 172.21.15.77:0/4256327334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd4100c80 0x7fcbd41006e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 >> 172.21.15.77:0/4256327334 conn(0x7fcbd40fb900 msgr2=0x7fcbd4105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 shutdown_connections 2024-09-15T23:35:07.681 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.679+0000 7fcbdc277640 1 -- 172.21.15.77:0/4256327334 wait complete. 2024-09-15T23:35:07.691 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T23:35:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 -- 172.21.15.77:0/3559220748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20101c00 msgr2=0x7f2a20102080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 --2- 172.21.15.77:0/3559220748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20101c00 0x7f2a20102080 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009900 tx=0x7f2a1402a410 comp rx=0 tx=0).stop 2024-09-15T23:35:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 -- 172.21.15.77:0/3559220748 shutdown_connections 2024-09-15T23:35:07.797 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 --2- 172.21.15.77:0/3559220748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 0x7f2a20108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 --2- 172.21.15.77:0/3559220748 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20101c00 0x7f2a20102080 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 --2- 172.21.15.77:0/3559220748 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20100a10 0x7f2a20100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.798 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 -- 172.21.15.77:0/3559220748 >> 172.21.15.77:0/3559220748 conn(0x7f2a200fc1b0 msgr2=0x7f2a200fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 -- 172.21.15.77:0/3559220748 shutdown_connections 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.793+0000 7f2a2497f640 1 -- 172.21.15.77:0/3559220748 wait complete. 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 Processor -- start 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 -- start start 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 0x7f2a20198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 0x7f2a2019f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010c710 con 0x7f2a20100a10 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010c590 con 0x7f2a201025c0 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a2497f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2a2010c890 con 0x7f2a20101c00 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56042/0 (socket says 172.21.15.77:56042) 2024-09-15T23:35:07.799 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 -- 172.21.15.77:0/1646153396 learned_addr learned my addr 172.21.15.77:0/1646153396 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1dd9b640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 0x7f2a20198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1ed9d640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 0x7f2a2019f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 -- 172.21.15.77:0/1646153396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 msgr2=0x7f2a20198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 0x7f2a20198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 -- 172.21.15.77:0/1646153396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 msgr2=0x7f2a2019f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 0x7f2a2019f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1e59c640 1 -- 172.21.15.77:0/1646153396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a2019faf0 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.794+0000 7f2a1dd9b640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 0x7f2a20198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a1e59c640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000d950 tx=0x7f2a1000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10017070 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a10009c30 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a2019fde0 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000f600 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.795+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201a0270 con 0x7f2a20100a10 2024-09-15T23:35:07.800 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.796+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a201a04a0 con 0x7f2a20100a10 2024-09-15T23:35:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.797+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2a1001a070 con 0x7f2a20100a10 2024-09-15T23:35:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.798+0000 7f2a0f7fe640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 0x7f2a080a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.798+0000 7f2a1dd9b640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 0x7f2a080a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:07.801 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.798+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f2a100cf760 con 0x7f2a20100a10 2024-09-15T23:35:07.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.798+0000 7f2a1dd9b640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 0x7f2a080a5710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a140095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:07.802 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.801+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f2a10009de0 con 0x7f2a20100a10 2024-09-15T23:35:07.967 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.966+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a201a0790 con 0x7f2a20100a10 2024-09-15T23:35:07.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.966+0000 7f2a0f7fe640 1 -- 172.21.15.77:0/1646153396 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) ==== 104+0+11 (secure 0 0 0) 0x7f2a1009c0f0 con 0x7f2a20100a10 2024-09-15T23:35:07.968 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.968+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 msgr2=0x7f2a080a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.968+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 0x7f2a080a5710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2a14000c00 tx=0x7f2a140095f0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.968+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 msgr2=0x7f2a20197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.968+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000d950 tx=0x7f2a1000de10 comp rx=0 tx=0).stop 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 shutdown_connections 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f2a080a3250 0x7f2a080a5710 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a201025c0 0x7f2a2019f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.970 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2a20101c00 0x7f2a20198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 --2- 172.21.15.77:0/1646153396 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f2a20100a10 0x7f2a20197ed0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:07.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 >> 172.21.15.77:0/1646153396 conn(0x7f2a200fc1b0 msgr2=0x7f2a2006a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:07.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 shutdown_connections 2024-09-15T23:35:07.971 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:07.969+0000 7f2a2497f640 1 -- 172.21.15.77:0/1646153396 wait complete. 2024-09-15T23:35:07.981 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 -- 172.21.15.77:0/1144878618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 msgr2=0x7efdd8109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 --2- 172.21.15.77:0/1144878618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd8109f50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7efdd0009ca0 tx=0x7efdd002a8c0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 -- 172.21.15.77:0/1144878618 shutdown_connections 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 --2- 172.21.15.77:0/1144878618 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd8109f50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 --2- 172.21.15.77:0/1144878618 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 --2- 172.21.15.77:0/1144878618 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 0x7efdd8101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 -- 172.21.15.77:0/1144878618 >> 172.21.15.77:0/1144878618 conn(0x7efdd80fd2b0 msgr2=0x7efdd80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 -- 172.21.15.77:0/1144878618 shutdown_connections 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.083+0000 7efddedc4640 1 -- 172.21.15.77:0/1144878618 wait complete. 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 Processor -- start 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 -- start start 2024-09-15T23:35:08.087 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 0x7efdd8197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7efdd810d810 con 0x7efdd81036c0 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdd810d690 con 0x7efdd8102d00 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddedc4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efdd810d990 con 0x7efdd8101b10 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56052/0 (socket says 172.21.15.77:56052) 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 -- 172.21.15.77:0/2043019225 learned_addr learned my addr 172.21.15.77:0/2043019225 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:08.088 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddcb60640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 0x7efdd8197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efdd7fff640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 -- 172.21.15.77:0/2043019225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 msgr2=0x7efdd8197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 0x7efdd8197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 -- 172.21.15.77:0/2043019225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 msgr2=0x7efdd8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 -- 172.21.15.77:0/2043019225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd819fae0 con 0x7efdd81036c0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efdd7fff640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efddd361640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098d0 tx=0x7efdd002f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.084+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd002fc30 con 0x7efdd81036c0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.085+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd0003e50 con 0x7efdd81036c0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.085+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd819fd70 con 0x7efdd81036c0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.085+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd00305c0 con 0x7efdd81036c0 2024-09-15T23:35:08.089 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.085+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd81a02e0 con 0x7efdd81036c0 2024-09-15T23:35:08.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.086+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd8108f00 con 0x7efdd81036c0 2024-09-15T23:35:08.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.087+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7efdd0004b40 con 0x7efdd81036c0 2024-09-15T23:35:08.090 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.088+0000 7efdd5ffb640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 0x7efdc80a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.088+0000 7efddcb60640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 0x7efdc80a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.088+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7efdd00f12b0 con 0x7efdd81036c0 2024-09-15T23:35:08.091 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.088+0000 7efddcb60640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 0x7efdc80a5710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efdd8102b60 tx=0x7efdcc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.092 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.091+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7efdd00bdc40 con 0x7efdd81036c0 2024-09-15T23:35:08.258 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.257+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efdd8062e90 con 0x7efdd81036c0 2024-09-15T23:35:08.259 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.258+0000 7efdd5ffb640 1 -- 172.21.15.77:0/2043019225 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) ==== 100+0+11 (secure 0 0 0) 0x7efdd00bd540 con 0x7efdd81036c0 2024-09-15T23:35:08.259 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 64 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.259+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 msgr2=0x7efdc80a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.259+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 0x7efdc80a5710 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7efdd8102b60 tx=0x7efdcc008040 comp rx=0 tx=0).stop 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.259+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 msgr2=0x7efdd819f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.259+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7efdd00098d0 tx=0x7efdd002f840 comp rx=0 tx=0).stop 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.259+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 shutdown_connections 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7efdc80a3250 0x7efdc80a5710 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7efdd81036c0 0x7efdd819f470 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.261 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdd8102d00 0x7efdd8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 --2- 172.21.15.77:0/2043019225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdd8101b10 0x7efdd8197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 >> 172.21.15.77:0/2043019225 conn(0x7efdd80fd2b0 msgr2=0x7efdd81060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:08.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 shutdown_connections 2024-09-15T23:35:08.262 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.260+0000 7efddedc4640 1 -- 172.21.15.77:0/2043019225 wait complete. 2024-09-15T23:35:08.271 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:07 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2236691660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:08.271 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:07 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4256327334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.271 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:07 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1646153396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.272 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T23:35:08.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:07 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2236691660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:08.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:07 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/4256327334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:07 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1646153396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- 172.21.15.77:0/3522800515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b901025c0 msgr2=0x7f0b90108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 --2- 172.21.15.77:0/3522800515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b901025c0 0x7f0b90108e50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009900 tx=0x7f0b8002a410 comp rx=0 tx=0).stop 2024-09-15T23:35:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- 172.21.15.77:0/3522800515 shutdown_connections 2024-09-15T23:35:08.376 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 --2- 172.21.15.77:0/3522800515 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b901025c0 0x7f0b90108e50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 --2- 172.21.15.77:0/3522800515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b90101c00 0x7f0b90102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 --2- 172.21.15.77:0/3522800515 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90100a10 0x7f0b90100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- 172.21.15.77:0/3522800515 >> 172.21.15.77:0/3522800515 conn(0x7f0b900fc190 msgr2=0x7f0b900fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- 172.21.15.77:0/3522800515 shutdown_connections 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- 172.21.15.77:0/3522800515 wait complete. 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 Processor -- start 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.373+0000 7f0b9840e640 1 -- start start 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 0x7f0b90198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b901025c0 0x7f0b9019f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010c690 con 0x7f0b90100a10 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010c510 con 0x7f0b90101c00 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9010c810 con 0x7f0b901025c0 2024-09-15T23:35:08.377 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56076/0 (socket says 172.21.15.77:56076) 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 -- 172.21.15.77:0/2310088606 learned_addr learned my addr 172.21.15.77:0/2310088606 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b959a9640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 0x7f0b90198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 -- 172.21.15.77:0/2310088606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b901025c0 msgr2=0x7f0b9019f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b969ab640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b901025c0 0x7f0b9019f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b901025c0 0x7f0b9019f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 -- 172.21.15.77:0/2310088606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 msgr2=0x7f0b90198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 0x7f0b90198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 -- 172.21.15.77:0/2310088606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9019fa60 con 0x7f0b90100a10 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b959a9640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 0x7f0b90198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b961aa640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ea80 tx=0x7f0b8800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800ce40 con 0x7f0b90100a10 2024-09-15T23:35:08.378 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0b88011950 con 0x7f0b90100a10 2024-09-15T23:35:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b8801ab80 con 0x7f0b90100a10 2024-09-15T23:35:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b9019fd50 con 0x7f0b90100a10 2024-09-15T23:35:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.374+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b901a01e0 con 0x7f0b90100a10 2024-09-15T23:35:08.379 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.375+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b901a0470 con 0x7f0b90100a10 2024-09-15T23:35:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.377+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f0b88011b00 con 0x7f0b90100a10 2024-09-15T23:35:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.377+0000 7f0b8f7fe640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 0x7f0b780a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.377+0000 7f0b959a9640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 0x7f0b780a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.377+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f0b880d05a0 con 0x7f0b90100a10 2024-09-15T23:35:08.380 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.378+0000 7f0b959a9640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 0x7f0b780a5710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84005ea0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.381 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.380+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f0b88016030 con 0x7f0b90100a10 2024-09-15T23:35:08.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:07 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2236691660' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:08.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:07 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/4256327334' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:07 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1646153396' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-15T23:35:08.547 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.546+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0b901a0800 con 0x7f0b90100a10 2024-09-15T23:35:08.548 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.546+0000 7f0b8f7fe640 1 -- 172.21.15.77:0/2310088606 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v91) ==== 103+0+11 (secure 0 0 0) 0x7f0b8809cf30 con 0x7f0b90100a10 2024-09-15T23:35:08.548 INFO:teuthology.orchestra.run.smithi077.stdout:pg_num: 32 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 msgr2=0x7f0b780a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 0x7f0b780a5710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0b84005fd0 tx=0x7f0b84005ea0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 msgr2=0x7f0b90197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ea80 tx=0x7f0b8800ef40 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 shutdown_connections 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f0b780a3250 0x7f0b780a5710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b901025c0 0x7f0b9019f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0b90101c00 0x7f0b90198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 --2- 172.21.15.77:0/2310088606 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0b90100a10 0x7f0b90197e40 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.550 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.548+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 >> 172.21.15.77:0/2310088606 conn(0x7f0b900fc190 msgr2=0x7f0b9006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.549+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 shutdown_connections 2024-09-15T23:35:08.551 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.549+0000 7f0b9840e640 1 -- 172.21.15.77:0/2310088606 wait complete. 2024-09-15T23:35:08.562 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-15T23:35:08.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 -- 172.21.15.77:0/2407217798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34102d20 msgr2=0x7f6a341031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 --2- 172.21.15.77:0/2407217798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34102d20 0x7f6a341031a0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6a24009900 tx=0x7f6a2402a410 comp rx=0 tx=0).stop 2024-09-15T23:35:08.662 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 -- 172.21.15.77:0/2407217798 shutdown_connections 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 --2- 172.21.15.77:0/2407217798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a341036e0 0x7f6a34109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 --2- 172.21.15.77:0/2407217798 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a34102d20 0x7f6a341031a0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 --2- 172.21.15.77:0/2407217798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 0x7f6a34101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 -- 172.21.15.77:0/2407217798 >> 172.21.15.77:0/2407217798 conn(0x7f6a340fd2b0 msgr2=0x7f6a340ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 -- 172.21.15.77:0/2407217798 shutdown_connections 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.659+0000 7f6a3b949640 1 -- 172.21.15.77:0/2407217798 wait complete. 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 Processor -- start 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 -- start start 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 0x7f6a34075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a34102d20 0x7f6a340745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d7b0 con 0x7f6a341036e0 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d630 con 0x7f6a34101b30 2024-09-15T23:35:08.663 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a3b949640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6a3410d930 con 0x7f6a34102d20 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56092/0 (socket says 172.21.15.77:56092) 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 -- 172.21.15.77:0/586121100 learned_addr learned my addr 172.21.15.77:0/586121100 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a396e5640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 0x7f6a34075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 -- 172.21.15.77:0/586121100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a34102d20 msgr2=0x7f6a340745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a34102d20 0x7f6a340745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 -- 172.21.15.77:0/586121100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 msgr2=0x7f6a34075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 0x7f6a34075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 -- 172.21.15.77:0/586121100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a340753b0 con 0x7f6a341036e0 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a39ee6640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00cad0 tx=0x7f6a2c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.660+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00ae20 con 0x7f6a341036e0 2024-09-15T23:35:08.664 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.661+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6a2c005020 con 0x7f6a341036e0 2024-09-15T23:35:08.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.661+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00f6f0 con 0x7f6a341036e0 2024-09-15T23:35:08.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.661+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a341a1fb0 con 0x7f6a341036e0 2024-09-15T23:35:08.665 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.661+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a341a2470 con 0x7f6a341036e0 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.661+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a34108f20 con 0x7f6a341036e0 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.663+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6a2c0051d0 con 0x7f6a341036e0 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.663+0000 7f6a2a7fc640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 0x7f6a200a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.663+0000 7f6a396e5640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 0x7f6a200a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.663+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6a2c0d0000 con 0x7f6a341036e0 2024-09-15T23:35:08.666 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.664+0000 7f6a396e5640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 0x7f6a200a5710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d00 tx=0x7f6a30005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:08.667 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.666+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6a2c014030 con 0x7f6a341036e0 2024-09-15T23:35:08.881 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.880+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f6a3402da10 con 0x7f6a341036e0 2024-09-15T23:35:08.888 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.887+0000 7f6a2a7fc640 1 -- 172.21.15.77:0/586121100 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+742340 (secure 0 0 0) 0x7f6a2c09c990 con 0x7f6a341036e0 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout:{ 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout: "epoch": 18, 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout: "active_gid": 14150, 2024-09-15T23:35:08.899 INFO:teuthology.orchestra.run.smithi077.stdout: "active_name": "x", 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "active_addrs": { 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6800", 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2029887224 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v1", 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:6801", 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2029887224 2024-09-15T23:35:08.900 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "active_addr": "172.21.15.77:6801/2029887224", 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "active_change": "2024-09-15T23:22:35.713181+0000", 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "active_mgr_features": 4540701547738038271, 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "available": true, 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "standbys": [ 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "gid": 24109, 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "z", 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: "available_modules": [ 2024-09-15T23:35:08.901 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "alerts", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.902 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.903 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:08.904 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.905 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.906 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.908 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_destination": { 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_destination", 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.909 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_from_name": { 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_from_name", 2024-09-15T23:35:08.910 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "Ceph", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email From: name", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_host": { 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_host", 2024-09-15T23:35:08.911 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP server", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.912 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_password": { 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_password", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Password to authenticate with", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.913 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_port": { 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_port", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "465", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP port", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.914 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_sender": { 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_sender", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.915 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_ssl": { 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_ssl", 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.916 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_user": { 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_user", 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.917 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "User to authenticate as", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "balancer", 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "active": { 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "active", 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.919 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.920 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_time": { 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_time", 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0000", 2024-09-15T23:35:08.921 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.922 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_weekday": { 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_weekday", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.923 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_max_iterations": { 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:35:08.924 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "25", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "250", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:35:08.925 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_metrics": { 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_metrics", 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.926 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:35:08.927 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_step": { 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_step", 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.928 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.5", 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0.001", 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "0.999", 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "end_time": { 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_time", 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2359", 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.930 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "end_weekday": { 2024-09-15T23:35:08.931 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_weekday", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:08.932 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:08.933 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.934 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.935 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:08.936 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.937 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.938 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "min_score": { 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_score", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.939 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.940 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "upmap", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-compat", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "none", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "read", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap-read" 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Balancer mode", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.941 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_ids": { 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_ids", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.942 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.943 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:35:08.943 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.944 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_deviation": { 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_deviation", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:08.945 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_optimizations": { 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.946 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:08.947 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_down_multiplier": { 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_down_multiplier", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.948 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_refresh_rate": { 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_refresh_rate", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "20", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.949 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_starting_port": { 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_starting_port", 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:08.950 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4721", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.951 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_ptrace": { 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_ptrace", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.952 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_interval": { 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_interval", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.953 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.7", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:35:08.954 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm_log_destination": { 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm_log_destination", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.955 INFO:teuthology.orchestra.run.smithi077.stdout: "file", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "file,syslog", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "syslog" 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "cgroups_split": { 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cgroups_split", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.956 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "config_checks_enabled": { 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_checks_enabled", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.957 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "config_dashboard": { 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_dashboard", 2024-09-15T23:35:08.958 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.959 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_alertmanager": { 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_alertmanager", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.960 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_base": { 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_base", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.961 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_elasticsearch": { 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.962 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "elasticsearch container image", 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_grafana": { 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_grafana", 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.963 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.964 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_haproxy": { 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_haproxy", 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.965 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "HAproxy container image", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_agent": { 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:35:08.966 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_collector": { 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.967 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_query": { 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:35:08.968 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger query container image", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_keepalived": { 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_keepalived", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Keepalived container image", 2024-09-15T23:35:08.970 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_loki": { 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_loki", 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:35:08.971 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Loki container image", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_node_exporter": { 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_node_exporter", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.972 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_nvmeof": { 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_nvmeof", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.973 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Nvme-of container image", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_prometheus": { 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_prometheus", 2024-09-15T23:35:08.974 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.975 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_promtail": { 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_promtail", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Promtail container image", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.976 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_samba": { 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_samba", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.977 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_snmp_gateway": { 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.978 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "container_init": { 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_init", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.979 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.980 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "daemon_cache_timeout": { 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.981 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "900", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.982 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "default_registry": { 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_registry", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.983 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "device_cache_timeout": { 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_cache_timeout", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1800", 2024-09-15T23:35:08.984 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "device_enhanced_scan": { 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_enhanced_scan", 2024-09-15T23:35:08.985 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.986 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "facts_cache_timeout": { 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "facts_cache_timeout", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.987 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "grafana_dashboards_path": { 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.988 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "host_check_interval": { 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "host_check_interval", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.989 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "hw_monitoring": { 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hw_monitoring", 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.990 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "inventory_list_all": { 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "inventory_list_all", 2024-09-15T23:35:08.991 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.992 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.993 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "log_refresh_metadata": { 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_refresh_metadata", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.994 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:08.995 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.996 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:08.997 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.998 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:08.999 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.000 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "*", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.001 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "max_count_per_host": { 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_count_per_host", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.002 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd_draining_count": { 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_osd_draining_count", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:35:09.003 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "migration_current": { 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "migration_current", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "internal - do not modify", 2024-09-15T23:35:09.004 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "root", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.005 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm-package", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "root" 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "oob_default_addr": { 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "oob_default_addr", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.006 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "169.254.1.1", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "prometheus_alerts_path": { 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.008 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_insecure": { 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_insecure", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.009 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_password": { 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_password", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.010 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_url": { 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_url", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.011 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_username": { 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_username", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.012 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "secure_monitoring_stack": { 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:35:09.013 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "service_discovery_port": { 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "service_discovery_port", 2024-09-15T23:35:09.014 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8765", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "ssh_config_file": { 2024-09-15T23:35:09.015 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssh_config_file", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.016 INFO:teuthology.orchestra.run.smithi077.stdout: "use_agent": { 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_agent", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "use_repo_digest": { 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_repo_digest", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.018 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_failed_host_check": { 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.019 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_daemons": { 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:35:09.020 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_hosts": { 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.021 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crash", 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.022 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.023 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.024 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.025 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.026 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.027 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "retain_interval": { 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retain_interval", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "31536000", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.028 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_recent_interval": { 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_recent_interval", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1209600", 2024-09-15T23:35:09.029 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dashboard", 2024-09-15T23:35:09.030 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.031 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.032 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.033 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.034 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.035 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.036 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.037 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.038 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.039 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.040 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.041 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.042 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.043 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.044 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.045 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.046 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.047 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_URL": { 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.048 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.049 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.050 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.051 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.052 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.053 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.053 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:35:09.053 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:35:09.053 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:35:09.054 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:35:09.055 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.056 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.057 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.058 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.059 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.060 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.061 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.063 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.064 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:35:09.065 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.066 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.067 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.068 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.069 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:35:09.070 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.071 INFO:teuthology.orchestra.run.smithi077.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "45", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.072 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.073 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.074 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.075 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.076 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.077 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.078 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.079 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.080 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "cross_origin_url": { 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cross_origin_url", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.081 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "crt_file": { 2024-09-15T23:35:09.082 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crt_file", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.083 INFO:teuthology.orchestra.run.smithi077.stdout: "debug": { 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "debug", 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.084 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "jwt_token_ttl": { 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "jwt_token_ttl", 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.086 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "28800", 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.087 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.088 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.090 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.091 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.092 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.093 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.094 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.095 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.096 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.097 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "motd": { 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "motd", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.098 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "The message of the day", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.099 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:09.100 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.101 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8080", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:09.102 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl_server_port": { 2024-09-15T23:35:09.103 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl_server_port", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8443", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "redirect", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect" 2024-09-15T23:35:09.105 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.106 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "url_prefix": { 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url_prefix", 2024-09-15T23:35:09.107 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.108 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "devicehealth", 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_monitoring": { 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_monitoring", 2024-09-15T23:35:09.109 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "monitor device health metrics", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.110 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.111 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.112 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.113 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.114 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.115 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "mark_out_threshold": { 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mark_out_threshold", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2419200", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.116 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": { 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_name", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "device_health_metrics", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.117 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "retention_period": { 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retention_period", 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.118 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15552000", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.119 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_frequency": { 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_frequency", 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.120 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.121 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "self_heal": { 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "self_heal", 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.122 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.123 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.124 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_threshold": { 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_threshold", 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.125 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7257600", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.126 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "diskprediction_local", 2024-09-15T23:35:09.127 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.128 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.129 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.130 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.131 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.132 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.133 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.134 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "predict_interval": { 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predict_interval", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.135 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "predictor_model": { 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predictor_model", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.136 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "prophetstor", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.137 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.138 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "influx", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": false, 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "batch_size": { 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "batch_size", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5000", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.139 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "database": { 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "database", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "ceph", 2024-09-15T23:35:09.140 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": { 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hostname", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.141 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.142 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "30", 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "5", 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.143 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.144 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.145 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.146 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.147 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.147 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.147 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.148 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.149 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "password": { 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "password", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.151 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "port": { 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "port", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8086", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server port", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.152 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "false", 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.153 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "threads": { 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threads", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.154 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "32", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "username": { 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "username", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.155 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "verify_ssl": { 2024-09-15T23:35:09.156 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "verify_ssl", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "true", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.157 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "insights", 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.158 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.159 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.160 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.161 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.162 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.163 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "iostat", 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.164 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.165 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.167 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.168 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.169 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.170 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "k8sevents", 2024-09-15T23:35:09.171 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_event_retention_days": { 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:35:09.172 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "config_check_secs": { 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_check_secs", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "10", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.173 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.174 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.175 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.176 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.177 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.178 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.179 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "localpool", 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "failure_domain": { 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "failure_domain", 2024-09-15T23:35:09.180 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "host", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.181 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.182 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.183 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.184 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.185 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.186 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.187 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": { 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_size", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "num_rep": { 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "num_rep", 2024-09-15T23:35:09.189 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.190 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": { 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_num", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "128", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.191 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "prefix": { 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prefix", 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.192 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "subtree": { 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "subtree", 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.193 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "rack", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.194 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mds_autoscaler", 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.195 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.196 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.197 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.198 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.199 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.200 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirroring", 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.201 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.202 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.203 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.204 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.205 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.206 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.207 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.208 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.209 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.210 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.211 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "nfs", 2024-09-15T23:35:09.211 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.211 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.211 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.211 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.212 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.213 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.214 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.215 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.215 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.215 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.215 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.216 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.217 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.218 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.219 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.220 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.221 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.222 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.223 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.224 INFO:teuthology.orchestra.run.smithi077.stdout: "fail_fs": { 2024-09-15T23:35:09.225 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "fail_fs", 2024-09-15T23:35:09.225 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.225 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.225 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.225 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.226 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.227 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.227 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.227 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.227 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.228 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.229 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.230 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.231 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.232 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.233 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.234 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.235 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.236 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.237 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.238 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.238 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.238 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.238 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator": { 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.239 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.240 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.240 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.240 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.240 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm", 2024-09-15T23:35:09.240 INFO:teuthology.orchestra.run.smithi077.stdout: "rook", 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: "test_orchestrator" 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Orchestrator backend", 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.241 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.242 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.242 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.242 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_perf_query", 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.243 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.244 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.245 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.247 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.247 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.247 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.247 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.247 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.248 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.249 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.249 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.249 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.250 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.251 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.252 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.252 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.252 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.252 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.252 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.253 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.254 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_support", 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.255 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.256 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.257 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.258 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.259 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.260 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.262 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.263 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_autoscaler", 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.265 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.266 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.267 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.268 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.269 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.270 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "threshold": { 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threshold", 2024-09-15T23:35:09.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1.0", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "scaling threshold", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.272 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "progress", 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_pg_recovery_event": { 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:35:09.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.274 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.275 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.276 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.277 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.278 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.279 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.280 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.281 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.282 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.283 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.284 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "max_completed_events": { 2024-09-15T23:35:09.285 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_completed_events", 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "50", 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.286 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.287 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.288 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.289 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus", 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "cache": { 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cache", 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.290 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "exclude_perf_counters": { 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "exclude_perf_counters", 2024-09-15T23:35:09.291 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.292 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.293 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.294 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.295 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.296 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.297 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools": { 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools", 2024-09-15T23:35:09.298 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "300", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.300 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_interval": { 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_interval", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15.0", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.301 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.302 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.303 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "9283", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "stale_cache_strategy": { 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stale_cache_strategy", 2024-09-15T23:35:09.304 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "log", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.305 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "default", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "default", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "error" 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.306 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.307 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_support", 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.308 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.309 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.310 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.311 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.312 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.313 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.314 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_snap_create": { 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.315 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.316 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "trash_purge_schedule": { 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "trash_purge_schedule", 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.318 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "restful", 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.319 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_auth": { 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_auth", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.320 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.321 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.322 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.322 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.323 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.324 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.325 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.326 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.327 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.328 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.329 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rgw", 2024-09-15T23:35:09.330 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.331 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.332 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.334 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.335 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.336 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.337 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rook", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.338 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.339 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.340 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.341 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.342 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "storage_class": { 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "storage_class", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "local", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.343 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "selftest", 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.344 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.345 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.346 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.347 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.348 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.349 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.350 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "roption1": { 2024-09-15T23:35:09.351 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption1", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.352 INFO:teuthology.orchestra.run.smithi077.stdout: "roption2": { 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption2", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "xyz", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption1": { 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption1", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.354 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption2": { 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption2", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.355 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption3": { 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption3", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.356 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption4": { 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption4", 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.357 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.358 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption5": { 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption5", 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.359 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.360 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption6": { 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption6", 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.361 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.362 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption7": { 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption7", 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.363 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "42", 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.364 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "testkey": { 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testkey", 2024-09-15T23:35:09.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.366 INFO:teuthology.orchestra.run.smithi077.stdout: "testlkey": { 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testlkey", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.367 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "testnewline": { 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testnewline", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.368 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snap_schedule", 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_m_granularity": { 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_m_granularity", 2024-09-15T23:35:09.369 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.370 INFO:teuthology.orchestra.run.smithi077.stdout: "dump_on_update": { 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dump_on_update", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.371 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.372 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.374 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.375 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.376 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.377 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.378 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.379 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stats", 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.381 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.382 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.383 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.384 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.385 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.386 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.387 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.388 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.389 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "status", 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.390 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.391 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.392 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.393 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.394 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.395 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.396 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.397 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telegraf", 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "address": { 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "address", 2024-09-15T23:35:09.398 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.399 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.400 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.401 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.402 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.403 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.404 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.405 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telemetry", 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.406 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_basic": { 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_basic", 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.407 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.408 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.408 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:35:09.408 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.408 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.408 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_crash": { 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_crash", 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.409 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.410 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.411 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_device": { 2024-09-15T23:35:09.411 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_device", 2024-09-15T23:35:09.411 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.411 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.411 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:35:09.412 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_ident": { 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_ident", 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.413 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_perf": { 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_perf", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.414 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "contact": { 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "contact", 2024-09-15T23:35:09.415 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "description": { 2024-09-15T23:35:09.416 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "description", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.417 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "device_url": { 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_url", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.418 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.419 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "24", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "8", 2024-09-15T23:35:09.420 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "last_opt_revision": { 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "last_opt_revision", 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.421 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.422 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard": { 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard", 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.423 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard_description": { 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard_description", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.424 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.425 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.426 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.427 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.428 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.429 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.430 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "organization": { 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "organization", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.431 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "proxy": { 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "proxy", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.432 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "url": { 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.433 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "test_orchestrator", 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.434 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.435 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.436 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.437 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.439 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "volumes", 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.440 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.441 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.442 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.443 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.444 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.446 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.447 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_clones": { 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_clones", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.448 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: "periodic_async_work": { 2024-09-15T23:35:09.449 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "periodic_async_work", 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.450 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Periodically check for async work", 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_delay": { 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.452 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:35:09.453 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.454 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix", 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "discovery_interval": { 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "discovery_interval", 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.455 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "100", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "identifier": { 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "identifier", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.456 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.457 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.458 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.459 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.460 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.461 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.462 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.463 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_host": { 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_host", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.464 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_port": { 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_port", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.465 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10051", 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.467 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_sender": { 2024-09-15T23:35:09.467 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_sender", 2024-09-15T23:35:09.467 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.467 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.467 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.468 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:35:09.468 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.468 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.468 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.468 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:09.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.470 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.470 INFO:teuthology.orchestra.run.smithi077.stdout: "gid": 24110, 2024-09-15T23:35:09.470 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "y", 2024-09-15T23:35:09.470 INFO:teuthology.orchestra.run.smithi077.stdout: "mgr_features": 4540701547738038271, 2024-09-15T23:35:09.470 INFO:teuthology.orchestra.run.smithi077.stdout: "available_modules": [ 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "alerts", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.471 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.472 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.473 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.474 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.475 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.476 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.477 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.478 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_destination": { 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_destination", 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.479 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_from_name": { 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_from_name", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.480 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "Ceph", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email From: name", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_host": { 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_host", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.481 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP server", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_password": { 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_password", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.482 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Password to authenticate with", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_port": { 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_port", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.483 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "465", 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP port", 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.484 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_sender": { 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_sender", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.485 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_ssl": { 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_ssl", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.486 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_user": { 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_user", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "User to authenticate as", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.487 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "balancer", 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "active": { 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "active", 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.488 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_time": { 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_time", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.489 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0000", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_weekday": { 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_weekday", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.490 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_max_iterations": { 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.491 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "25", 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "250", 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.492 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_metrics": { 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_metrics", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.493 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_step": { 2024-09-15T23:35:09.494 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_step", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.5", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0.001", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "0.999", 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.495 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "end_time": { 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_time", 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.496 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2359", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:09.497 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "end_weekday": { 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_weekday", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:09.498 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.499 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.500 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.501 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.502 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.503 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.504 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "min_score": { 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_score", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.505 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:35:09.506 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:09.507 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "upmap", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-compat", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "none", 2024-09-15T23:35:09.508 INFO:teuthology.orchestra.run.smithi077.stdout: "read", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap-read" 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Balancer mode", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_ids": { 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_ids", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.509 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.510 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.511 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_deviation": { 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_deviation", 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.512 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.513 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_optimizations": { 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.514 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.515 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm", 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_down_multiplier": { 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_down_multiplier", 2024-09-15T23:35:09.516 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.517 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_refresh_rate": { 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_refresh_rate", 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.518 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "20", 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.519 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_starting_port": { 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_starting_port", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4721", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.520 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_ptrace": { 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_ptrace", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.521 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_interval": { 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_interval", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.522 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.523 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.7", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm_log_destination": { 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm_log_destination", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.524 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "file", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "file,syslog", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "syslog" 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.525 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "cgroups_split": { 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cgroups_split", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.526 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "config_checks_enabled": { 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_checks_enabled", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.527 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "config_dashboard": { 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_dashboard", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.528 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_alertmanager": { 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_alertmanager", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.529 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_base": { 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_base", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.530 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_elasticsearch": { 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "elasticsearch container image", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.531 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_grafana": { 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_grafana", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.532 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_haproxy": { 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_haproxy", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "HAproxy container image", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.533 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_agent": { 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:35:09.534 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_collector": { 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:35:09.535 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_query": { 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.536 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger query container image", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_keepalived": { 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_keepalived", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.537 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Keepalived container image", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_loki": { 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_loki", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.538 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Loki container image", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_node_exporter": { 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_node_exporter", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.539 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_nvmeof": { 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_nvmeof", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.540 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Nvme-of container image", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_prometheus": { 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_prometheus", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:35:09.541 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_promtail": { 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_promtail", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.542 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Promtail container image", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_samba": { 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_samba", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.543 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_snmp_gateway": { 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.544 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "container_init": { 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_init", 2024-09-15T23:35:09.545 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "daemon_cache_timeout": { 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:35:09.546 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:35:09.547 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "900", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "default_registry": { 2024-09-15T23:35:09.548 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_registry", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.549 INFO:teuthology.orchestra.run.smithi077.stdout: "device_cache_timeout": { 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_cache_timeout", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1800", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.550 INFO:teuthology.orchestra.run.smithi077.stdout: "device_enhanced_scan": { 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_enhanced_scan", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.551 INFO:teuthology.orchestra.run.smithi077.stdout: "facts_cache_timeout": { 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "facts_cache_timeout", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.552 INFO:teuthology.orchestra.run.smithi077.stdout: "grafana_dashboards_path": { 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.553 INFO:teuthology.orchestra.run.smithi077.stdout: "host_check_interval": { 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "host_check_interval", 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.554 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.555 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.555 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "hw_monitoring": { 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hw_monitoring", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.556 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "inventory_list_all": { 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "inventory_list_all", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.557 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.558 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.559 INFO:teuthology.orchestra.run.smithi077.stdout: "log_refresh_metadata": { 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_refresh_metadata", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.560 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:35:09.561 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.562 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.563 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:35:09.564 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:35:09.565 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "*", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.566 INFO:teuthology.orchestra.run.smithi077.stdout: "max_count_per_host": { 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_count_per_host", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.567 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd_draining_count": { 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_osd_draining_count", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.568 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "migration_current": { 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "migration_current", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "internal - do not modify", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.569 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "root", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm-package", 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: "root" 2024-09-15T23:35:09.570 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "oob_default_addr": { 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "oob_default_addr", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "169.254.1.1", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.571 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "prometheus_alerts_path": { 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.572 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_insecure": { 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_insecure", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.573 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_password": { 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_password", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.574 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_url": { 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_url", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.575 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_username": { 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_username", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.576 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "secure_monitoring_stack": { 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.577 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "service_discovery_port": { 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "service_discovery_port", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8765", 2024-09-15T23:35:09.578 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "ssh_config_file": { 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssh_config_file", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.579 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "use_agent": { 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_agent", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.580 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "use_repo_digest": { 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_repo_digest", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.581 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_failed_host_check": { 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.582 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_daemons": { 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.583 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_hosts": { 2024-09-15T23:35:09.584 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.585 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crash", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.586 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.587 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.588 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.589 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.590 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "retain_interval": { 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retain_interval", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "31536000", 2024-09-15T23:35:09.591 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_recent_interval": { 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_recent_interval", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.592 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1209600", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dashboard", 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.593 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.594 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.595 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.596 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.597 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.598 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.599 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.600 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.601 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.602 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.603 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.604 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.605 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.606 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.607 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.608 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.609 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_URL": { 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.610 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.611 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.612 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.613 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.614 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.615 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.616 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.617 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.618 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.619 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.620 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.621 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.622 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.623 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:35:09.624 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:35:09.625 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:35:09.626 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.627 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:35:09.628 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:35:09.629 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "45", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.630 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:35:09.631 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:35:09.632 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:35:09.633 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.634 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.635 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.636 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.637 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "cross_origin_url": { 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cross_origin_url", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.638 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "crt_file": { 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crt_file", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.639 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "debug": { 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "debug", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.640 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "jwt_token_ttl": { 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "jwt_token_ttl", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "28800", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.641 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.642 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.643 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.644 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.645 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.646 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.647 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "motd": { 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "motd", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.648 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "The message of the day", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:35:09.649 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.650 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.651 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8080", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:09.652 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.653 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl_server_port": { 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl_server_port", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8443", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.654 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "redirect", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect" 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.655 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:09.656 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "url_prefix": { 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url_prefix", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.657 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "devicehealth", 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.658 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_monitoring": { 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_monitoring", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "monitor device health metrics", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.659 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.660 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.661 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.662 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.663 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.664 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "mark_out_threshold": { 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mark_out_threshold", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2419200", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.665 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": { 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_name", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "device_health_metrics", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.666 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "retention_period": { 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retention_period", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15552000", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.667 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_frequency": { 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_frequency", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:09.668 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "self_heal": { 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "self_heal", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.669 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.670 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_threshold": { 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_threshold", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.671 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7257600", 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.672 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "diskprediction_local", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.673 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.674 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.675 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.676 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.677 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "predict_interval": { 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predict_interval", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:09.678 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "predictor_model": { 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predictor_model", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.679 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "prophetstor", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.680 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "influx", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": false, 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:35:09.681 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "batch_size": { 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "batch_size", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5000", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.682 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "database": { 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "database", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "ceph", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.683 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": { 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hostname", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:35:09.684 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "30", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "5", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:35:09.685 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.686 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.687 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.688 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.689 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.690 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "password": { 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "password", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.691 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "port": { 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "port", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8086", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.692 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server port", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "false", 2024-09-15T23:35:09.693 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "threads": { 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threads", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.694 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "32", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "username": { 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "username", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.695 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "verify_ssl": { 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "verify_ssl", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.696 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "true", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.697 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "insights", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.698 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.699 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.700 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.701 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.702 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "iostat", 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.703 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.704 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.705 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.706 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.707 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.708 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "k8sevents", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_event_retention_days": { 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.709 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "config_check_secs": { 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_check_secs", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.710 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "10", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.711 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.712 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.713 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.714 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.715 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.716 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "localpool", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "failure_domain": { 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "failure_domain", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "host", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.717 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.718 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.719 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.720 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.721 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.722 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": { 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_size", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.723 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "num_rep": { 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "num_rep", 2024-09-15T23:35:09.724 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.725 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": { 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_num", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "128", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.726 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "prefix": { 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prefix", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.727 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "subtree": { 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "subtree", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "rack", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.728 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mds_autoscaler", 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.729 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.730 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.731 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.732 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.733 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.734 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirroring", 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.735 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.736 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.737 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.738 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.739 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.740 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "nfs", 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.741 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.742 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.743 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.744 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.745 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.746 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "fail_fs": { 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "fail_fs", 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.747 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.748 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.749 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.750 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.751 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.752 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.753 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator": { 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "rook", 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "test_orchestrator" 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.754 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Orchestrator backend", 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_perf_query", 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.755 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.756 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.757 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.758 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.759 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.760 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.761 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_support", 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.762 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.763 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.764 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.765 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.766 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.767 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_autoscaler", 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.768 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.769 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.770 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.771 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.772 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.773 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.774 INFO:teuthology.orchestra.run.smithi077.stdout: "threshold": { 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threshold", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1.0", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "scaling threshold", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.775 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "progress", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_pg_recovery_event": { 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.776 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.777 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.778 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.779 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.780 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.781 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.782 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.783 INFO:teuthology.orchestra.run.smithi077.stdout: "max_completed_events": { 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_completed_events", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "50", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.784 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.785 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus", 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "cache": { 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cache", 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.786 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "exclude_perf_counters": { 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "exclude_perf_counters", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.787 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.788 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.789 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.790 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.791 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.792 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.793 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools": { 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.794 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "300", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.795 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_interval": { 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_interval", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15.0", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.796 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.797 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "9283", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.798 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "stale_cache_strategy": { 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stale_cache_strategy", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.799 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "log", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.800 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "default", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "default", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "error" 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:09.801 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.802 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_support", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.803 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.804 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.805 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.806 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.807 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_snap_create": { 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.808 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.809 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "trash_purge_schedule": { 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "trash_purge_schedule", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.810 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "restful", 2024-09-15T23:35:09.811 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_auth": { 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_auth", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.812 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.813 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.814 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.815 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.816 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.817 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.818 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.819 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.820 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rgw", 2024-09-15T23:35:09.821 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.822 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.823 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.824 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.825 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.826 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.827 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rook", 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.828 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.829 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.830 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.831 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.832 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.833 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "storage_class": { 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "storage_class", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "local", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.834 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "selftest", 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.835 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.836 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.837 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.838 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.839 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.840 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "roption1": { 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption1", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.841 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "roption2": { 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption2", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "xyz", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.842 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption1": { 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption1", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.843 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption2": { 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption2", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.844 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption3": { 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption3", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.845 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption4": { 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption4", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.846 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption5": { 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption5", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.847 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption6": { 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption6", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.848 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption7": { 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption7", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.849 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "42", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "testkey": { 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testkey", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.850 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "testlkey": { 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testlkey", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.851 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "testnewline": { 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testnewline", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.852 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.853 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snap_schedule", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_m_granularity": { 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_m_granularity", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.854 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "dump_on_update": { 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dump_on_update", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.855 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.856 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.857 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.858 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.859 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.860 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stats", 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.861 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.862 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.863 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.864 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.865 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.866 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "status", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.867 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.868 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.869 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.870 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.871 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telegraf", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.872 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "address": { 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "address", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.873 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.874 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.875 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.876 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.877 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.878 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.879 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telemetry", 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_basic": { 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_basic", 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.880 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_crash": { 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_crash", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.881 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_device": { 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_device", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.882 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_ident": { 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_ident", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.883 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_perf": { 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_perf", 2024-09-15T23:35:09.884 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "contact": { 2024-09-15T23:35:09.885 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "contact", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.886 INFO:teuthology.orchestra.run.smithi077.stdout: "description": { 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "description", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.887 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "device_url": { 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_url", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.888 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.889 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "24", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "8", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.890 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "last_opt_revision": { 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "last_opt_revision", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.891 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard": { 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.892 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard_description": { 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard_description", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.893 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.894 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.895 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.896 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.897 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.898 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "organization": { 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "organization", 2024-09-15T23:35:09.899 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "proxy": { 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "proxy", 2024-09-15T23:35:09.900 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "url": { 2024-09-15T23:35:09.901 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.902 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "test_orchestrator", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.903 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.904 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.905 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.906 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.907 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.908 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "volumes", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.909 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.910 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.911 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.912 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.913 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_clones": { 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_clones", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.914 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "periodic_async_work": { 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "periodic_async_work", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.915 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Periodically check for async work", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_delay": { 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.916 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.917 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix", 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.918 INFO:teuthology.orchestra.run.smithi077.stdout: "discovery_interval": { 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "discovery_interval", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "100", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.919 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "identifier": { 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "identifier", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.920 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.921 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.922 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.923 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.924 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.925 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.926 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_host": { 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_host", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.927 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_port": { 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_port", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10051", 2024-09-15T23:35:09.928 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_sender": { 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_sender", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.929 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.930 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "modules": [ 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm", 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "dashboard", 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "iostat", 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "nfs", 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "restful" 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: "available_modules": [ 2024-09-15T23:35:09.931 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "alerts", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.932 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How frequently to reexamine health status", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.933 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.934 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.935 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.936 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.937 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_destination": { 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_destination", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.938 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email address to send alerts to", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_from_name": { 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_from_name", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "Ceph", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.939 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Email From: name", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_host": { 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_host", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.940 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP server", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_password": { 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_password", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.941 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Password to authenticate with", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_port": { 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_port", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "465", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.942 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP port", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_sender": { 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_sender", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.943 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SMTP envelope sender", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_ssl": { 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_ssl", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.944 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "smtp_user": { 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "smtp_user", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.945 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "User to authenticate as", 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "balancer", 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.946 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "active": { 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "active", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically balance PGs across cluster", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.947 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_time": { 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_time", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0000", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "beginning time of day to automatically balance", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.948 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "begin_weekday": { 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "begin_weekday", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:09.949 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_max_iterations": { 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_max_iterations", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "25", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "250", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-15T23:35:09.950 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_metrics": { 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_metrics", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "pgs,objects,bytes", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-15T23:35:09.951 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "crush_compat_step": { 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crush_compat_step", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.5", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0.001", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "0.999", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "aggressiveness of optimization", 2024-09-15T23:35:09.952 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "end_time": { 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_time", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2359", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.953 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ending time of day to automatically balance", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "end_weekday": { 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "end_weekday", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "0", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "6", 2024-09-15T23:35:09.954 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.955 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.956 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.957 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:09.958 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.959 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "min_score": { 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_score", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:09.960 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:09.961 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:09.963 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "upmap", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "crush-compat", 2024-09-15T23:35:09.964 INFO:teuthology.orchestra.run.smithi077.stdout: "none", 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "read", 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap", 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap-read" 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Balancer mode", 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.965 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_ids": { 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_ids", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.966 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.967 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_deviation": { 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_deviation", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:09.968 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "upmap_max_optimizations": { 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "upmap_max_optimizations", 2024-09-15T23:35:09.969 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.970 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm", 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_down_multiplier": { 2024-09-15T23:35:09.971 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_down_multiplier", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.972 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_refresh_rate": { 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_refresh_rate", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "20", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.973 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "agent_starting_port": { 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "agent_starting_port", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4721", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.974 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_ptrace": { 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_ptrace", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.975 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_interval": { 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_interval", 2024-09-15T23:35:09.976 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.977 INFO:teuthology.orchestra.run.smithi077.stdout: "autotune_memory_target_ratio": { 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "autotune_memory_target_ratio", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0.7", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.978 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm_log_destination": { 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cephadm_log_destination", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.979 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "file", 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "file,syslog", 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "syslog" 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "cgroups_split": { 2024-09-15T23:35:09.980 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cgroups_split", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.981 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "config_checks_enabled": { 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_checks_enabled", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.982 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "config_dashboard": { 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_dashboard", 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.983 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_alertmanager": { 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_alertmanager", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.984 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_base": { 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_base", 2024-09-15T23:35:09.985 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Container image name, without the tag", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.986 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_elasticsearch": { 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_elasticsearch", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.987 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "elasticsearch container image", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_grafana": { 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_grafana", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-15T23:35:09.988 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_haproxy": { 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_haproxy", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.989 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "HAproxy container image", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.990 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_agent": { 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_agent", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger agent container image", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.991 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_collector": { 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_collector", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.992 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger collector container image", 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_jaeger_query": { 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_jaeger_query", 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.993 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Jaeger query container image", 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_keepalived": { 2024-09-15T23:35:09.994 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_keepalived", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Keepalived container image", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.995 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_loki": { 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_loki", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.996 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Loki container image", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_node_exporter": { 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_node_exporter", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.997 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_nvmeof": { 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_nvmeof", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:09.998 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Nvme-of container image", 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:09.999 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_prometheus": { 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_prometheus", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Prometheus container image", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.000 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_promtail": { 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_promtail", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.001 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Promtail container image", 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_samba": { 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_samba", 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.002 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Samba/SMB container image", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "container_image_snmp_gateway": { 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_image_snmp_gateway", 2024-09-15T23:35:10.003 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "SNMP Gateway container image", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.004 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "container_init": { 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "container_init", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Run podman/docker with `--init`", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.005 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "daemon_cache_timeout": { 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "daemon_cache_timeout", 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:10.006 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "default_cephadm_command_timeout": { 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_cephadm_command_timeout", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.007 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "900", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.008 INFO:teuthology.orchestra.run.smithi077.stdout: "default_registry": { 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "default_registry", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "docker.io", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.009 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "device_cache_timeout": { 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_cache_timeout", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1800", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.010 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache device inventory", 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "device_enhanced_scan": { 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_enhanced_scan", 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.011 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "facts_cache_timeout": { 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "facts_cache_timeout", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.012 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "seconds to cache host facts data", 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "grafana_dashboards_path": { 2024-09-15T23:35:10.013 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "grafana_dashboards_path", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.014 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "host_check_interval": { 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "host_check_interval", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.015 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to perform a host check", 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "hw_monitoring": { 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hw_monitoring", 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.016 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.017 INFO:teuthology.orchestra.run.smithi077.stdout: "inventory_list_all": { 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "inventory_list_all", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.018 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.019 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.020 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "log_refresh_metadata": { 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_refresh_metadata", 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.021 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.022 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.023 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.024 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.025 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.026 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.027 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.028 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "*", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.029 INFO:teuthology.orchestra.run.smithi077.stdout: "max_count_per_host": { 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_count_per_host", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of daemons per service per host", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.030 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "max_osd_draining_count": { 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_osd_draining_count", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-15T23:35:10.031 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "migration_current": { 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "migration_current", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.032 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "internal - do not modify", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "mode": { 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mode", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.033 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "root", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm-package", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "root" 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "mode for remote execution of cephadm", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.034 INFO:teuthology.orchestra.run.smithi077.stdout: "oob_default_addr": { 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "oob_default_addr", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "169.254.1.1", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.035 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "prometheus_alerts_path": { 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus_alerts_path", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.036 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_insecure": { 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_insecure", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.037 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_password": { 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_password", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.038 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_url": { 2024-09-15T23:35:10.039 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_url", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.040 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "registry_username": { 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "registry_username", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-15T23:35:10.041 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "secure_monitoring_stack": { 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secure_monitoring_stack", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.042 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "service_discovery_port": { 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "service_discovery_port", 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.043 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8765", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "cephadm service discovery port", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "ssh_config_file": { 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssh_config_file", 2024-09-15T23:35:10.044 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.045 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "use_agent": { 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_agent", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.046 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "use_repo_digest": { 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "use_repo_digest", 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.047 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_failed_host_check": { 2024-09-15T23:35:10.048 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_failed_host_check", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if the host check fails", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.049 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_daemons": { 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_daemons", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.050 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_on_stray_hosts": { 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_on_stray_hosts", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.051 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.052 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crash", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.053 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.054 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.055 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.056 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.057 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.058 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.059 INFO:teuthology.orchestra.run.smithi077.stdout: "retain_interval": { 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retain_interval", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "31536000", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.060 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_recent_interval": { 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_recent_interval", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1209600", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.061 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dashboard", 2024-09-15T23:35:10.062 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.063 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_HOST": { 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.064 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.065 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_ENABLED": { 2024-09-15T23:35:10.066 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_ENABLED", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.067 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.068 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "ENABLE_BROWSABLE_API": { 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.069 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.070 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-15T23:35:10.071 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-15T23:35:10.072 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.073 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.074 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.075 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.076 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.077 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.078 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.079 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_PASSWORD": { 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.080 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.081 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.082 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_URL": { 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_URL", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.083 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_API_USERNAME": { 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:10.084 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.085 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.086 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.087 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.088 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.089 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_HOST": { 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.090 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-15T23:35:10.091 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.092 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.093 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.094 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.095 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.096 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-15T23:35:10.097 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.098 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.099 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.100 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_ENABLED": { 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.101 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-15T23:35:10.102 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.103 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.104 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.105 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.106 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "45", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ACCESS_KEY": { 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-15T23:35:10.107 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.108 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "admin", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.109 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SECRET_KEY": { 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.110 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "RGW_API_SSL_VERIFY": { 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.111 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-15T23:35:10.112 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.113 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.114 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.115 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "cross_origin_url": { 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cross_origin_url", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.116 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "crt_file": { 2024-09-15T23:35:10.117 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "crt_file", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.118 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "debug": { 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "debug", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Enable/disable debug options", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.119 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "jwt_token_ttl": { 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "jwt_token_ttl", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "28800", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.120 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.121 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.122 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.123 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.124 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.125 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.126 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.127 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "motd": { 2024-09-15T23:35:10.128 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "motd", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "The message of the day", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.129 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect_resolve_ip_addr": { 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "redirect_resolve_ip_addr", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.130 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.131 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8080", 2024-09-15T23:35:10.132 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:10.133 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.134 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl_server_port": { 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl_server_port", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8443", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.135 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "redirect", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.136 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "redirect" 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.137 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.138 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "url_prefix": { 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url_prefix", 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.139 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.140 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "devicehealth", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_monitoring": { 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_monitoring", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.141 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "monitor device health metrics", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.142 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.143 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.144 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.145 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.146 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.147 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "mark_out_threshold": { 2024-09-15T23:35:10.148 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mark_out_threshold", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "2419200", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.149 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "pool_name": { 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pool_name", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "device_health_metrics", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-15T23:35:10.150 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "retention_period": { 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "retention_period", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15552000", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.151 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long to retain device health metrics", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_frequency": { 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_frequency", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.152 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "self_heal": { 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "self_heal", 2024-09-15T23:35:10.153 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.154 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how frequently to wake up and check device health", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.155 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "warn_threshold": { 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "warn_threshold", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7257600", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.156 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "diskprediction_local", 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.157 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.158 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.159 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.160 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.161 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.162 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.163 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.164 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "predict_interval": { 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predict_interval", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "86400", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.165 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.166 INFO:teuthology.orchestra.run.smithi077.stdout: "predictor_model": { 2024-09-15T23:35:10.167 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "predictor_model", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "prophetstor", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.168 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "600", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.169 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "influx", 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": false, 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "influxdb python module not found", 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.170 INFO:teuthology.orchestra.run.smithi077.stdout: "batch_size": { 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "batch_size", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5000", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.171 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "database": { 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "database", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "ceph", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.172 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "hostname": { 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "hostname", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.173 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server hostname", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.174 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "30", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "5", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.175 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.176 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.177 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.178 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.179 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.180 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.181 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "password": { 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "password", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "password of InfluxDB server user", 2024-09-15T23:35:10.182 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "port": { 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "port", 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "8086", 2024-09-15T23:35:10.183 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "InfluxDB server port", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "ssl": { 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ssl", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.184 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "false", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "threads": { 2024-09-15T23:35:10.185 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threads", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "32", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.186 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "username": { 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "username", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "username of InfluxDB server user", 2024-09-15T23:35:10.187 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "verify_ssl": { 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "verify_ssl", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "true", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.188 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "insights", 2024-09-15T23:35:10.189 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.190 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.191 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.192 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.193 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.194 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.195 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "iostat", 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.196 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.197 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.198 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.199 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.200 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.201 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.202 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "k8sevents", 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "ceph_event_retention_days": { 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "ceph_event_retention_days", 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.203 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "7", 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "config_check_secs": { 2024-09-15T23:35:10.204 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "config_check_secs", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "10", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.205 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.206 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.207 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.208 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.209 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.210 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.211 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "localpool", 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.212 INFO:teuthology.orchestra.run.smithi077.stdout: "failure_domain": { 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "failure_domain", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "host", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "failure domain for any created local pool", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.213 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.214 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.215 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.216 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.217 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.218 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.219 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "min_size": { 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "min_size", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.220 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default min_size for any created local pool", 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "num_rep": { 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "num_rep", 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.221 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default replica count for any created local pool", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.222 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_num": { 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_num", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "128", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "default pg_num for any created local pool", 2024-09-15T23:35:10.223 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "prefix": { 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prefix", 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.224 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "name prefix for any created local pool", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "subtree": { 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "subtree", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.225 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "rack", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.226 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mds_autoscaler", 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.227 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.228 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.229 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.230 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.231 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.232 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirroring", 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.233 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.234 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.235 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.236 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.237 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.238 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.239 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "nfs", 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.240 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.241 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.242 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.243 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.244 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.245 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.246 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.247 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "fail_fs": { 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "fail_fs", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.248 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.249 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.250 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.251 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.252 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.253 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.254 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.255 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator": { 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "orchestrator", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "cephadm", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "rook", 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: "test_orchestrator" 2024-09-15T23:35:10.256 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Orchestrator backend", 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_perf_query", 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.257 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.258 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.259 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.260 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.261 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.262 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.263 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "osd_support", 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.264 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.265 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.266 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.267 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.268 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.269 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "pg_autoscaler", 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.270 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.271 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.272 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.273 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.274 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.275 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.276 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.277 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "threshold": { 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "threshold", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.278 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "3.0", 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1.0", 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "scaling threshold", 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.279 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "progress", 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_pg_recovery_event": { 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_pg_recovery_event", 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.280 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:10.281 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.282 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.283 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.284 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.285 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.286 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.287 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.288 INFO:teuthology.orchestra.run.smithi077.stdout: "max_completed_events": { 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_completed_events", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "50", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "number of past completed events to remember", 2024-09-15T23:35:10.289 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "sleep_interval": { 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "sleep_interval", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.290 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "how long the module is going to sleep", 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "prometheus", 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.291 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "cache": { 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "cache", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.292 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "exclude_perf_counters": { 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "exclude_perf_counters", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.293 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.294 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.295 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.296 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.297 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.298 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.299 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools": { 2024-09-15T23:35:10.300 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.301 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "300", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.302 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "scrape_interval": { 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "scrape_interval", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15.0", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.303 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.304 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "::", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:10.305 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "9283", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.306 INFO:teuthology.orchestra.run.smithi077.stdout: "stale_cache_strategy": { 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stale_cache_strategy", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "log", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.307 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_behaviour": { 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_behaviour", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "default", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.308 INFO:teuthology.orchestra.run.smithi077.stdout: "default", 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "error" 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "standby_error_status_code": { 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "standby_error_status_code", 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.309 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "500", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "400", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "599", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.310 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_support", 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.311 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.312 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.313 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.314 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.315 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.316 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.317 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.318 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_snap_create": { 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_snap_create", 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.319 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10", 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.320 INFO:teuthology.orchestra.run.smithi077.stdout: "mirror_snapshot_schedule": { 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "mirror_snapshot_schedule", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.321 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "trash_purge_schedule": { 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "trash_purge_schedule", 2024-09-15T23:35:10.322 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.323 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "restful", 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.324 INFO:teuthology.orchestra.run.smithi077.stdout: "enable_auth": { 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enable_auth", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.325 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "key_file": { 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "key_file", 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.326 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.327 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.328 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.329 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.330 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.331 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.332 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.333 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "server_addr": { 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_addr", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.334 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "server_port": { 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "server_port", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.335 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.336 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rgw", 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.337 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.338 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.339 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.340 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.341 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.342 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.343 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.344 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "secondary_zone_period_retry_limit": { 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.345 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "5", 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.346 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rook", 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.347 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.348 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.349 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.350 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.351 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.352 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.353 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.354 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "storage_class": { 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "storage_class", 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.355 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "local", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.356 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "selftest", 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.357 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.358 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.359 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.360 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.361 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.362 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.363 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "roption1": { 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption1", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.364 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "roption2": { 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "roption2", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "xyz", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.365 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption1": { 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption1", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.366 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption2": { 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption2", 2024-09-15T23:35:10.367 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.368 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption3": { 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption3", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "float", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.369 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption4": { 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption4", 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.370 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.371 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption5": { 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption5", 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.372 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption6": { 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption6", 2024-09-15T23:35:10.373 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.374 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "rwoption7": { 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rwoption7", 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.375 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "1", 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "42", 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "testkey": { 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testkey", 2024-09-15T23:35:10.376 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.377 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "testlkey": { 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testlkey", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.378 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "testnewline": { 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "testnewline", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.379 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snap_schedule", 2024-09-15T23:35:10.380 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "allow_m_granularity": { 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "allow_m_granularity", 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.381 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "allow minute scheduled snapshots", 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.382 INFO:teuthology.orchestra.run.smithi077.stdout: "dump_on_update": { 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "dump_on_update", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.383 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "dump database to debug log on update", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.384 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.385 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.386 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.387 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.388 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.389 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.390 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "stats", 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.391 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.392 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.393 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.394 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.395 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.396 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.397 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "status", 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.398 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.399 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.400 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.401 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.402 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.403 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.404 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.405 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telegraf", 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "address": { 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "address", 2024-09-15T23:35:10.406 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.407 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "15", 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.408 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.409 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.410 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.411 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.412 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.413 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.414 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.415 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "telemetry", 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.416 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_basic": { 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_basic", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-15T23:35:10.417 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_crash": { 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_crash", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.418 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_device": { 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_device", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.419 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_ident": { 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_ident", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.420 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "channel_perf": { 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "channel_perf", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.421 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "contact": { 2024-09-15T23:35:10.422 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "contact", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.423 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "description": { 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "description", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.424 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "device_url": { 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "device_url", 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.425 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.426 INFO:teuthology.orchestra.run.smithi077.stdout: "enabled": { 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "enabled", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.427 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "24", 2024-09-15T23:35:10.428 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "8", 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "last_opt_revision": { 2024-09-15T23:35:10.429 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "last_opt_revision", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "1", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.430 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard": { 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard", 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.431 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.432 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "leaderboard_description": { 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "leaderboard_description", 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.433 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.434 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.435 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.436 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.437 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.438 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.439 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.440 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.441 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "organization": { 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "organization", 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.442 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "proxy": { 2024-09-15T23:35:10.443 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "proxy", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.444 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "url": { 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "url", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.445 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "test_orchestrator", 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.446 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.447 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.448 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.449 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.450 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.451 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.452 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "volumes", 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.453 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.454 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.455 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.458 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.459 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "max_concurrent_clones": { 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "max_concurrent_clones", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "4", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-15T23:35:10.460 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "periodic_async_work": { 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "periodic_async_work", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.461 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Periodically check for async work", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_delay": { 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_delay", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "0", 2024-09-15T23:35:10.462 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "snapshot_clone_no_wait": { 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "snapshot_clone_no_wait", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.463 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "True", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.464 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix", 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "can_run": true, 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "error_string": "", 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "module_options": { 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "discovery_interval": { 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "discovery_interval", 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "uint", 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.465 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "100", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "identifier": { 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "identifier", 2024-09-15T23:35:10.466 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.467 INFO:teuthology.orchestra.run.smithi077.stdout: "interval": { 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "interval", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "secs", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "60", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.468 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "log_level": { 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_level", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.469 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.470 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster": { 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster", 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.471 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.472 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_cluster_level": { 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_cluster_level", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "info", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [ 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "", 2024-09-15T23:35:10.473 INFO:teuthology.orchestra.run.smithi077.stdout: "critical", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "debug", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "error", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "info", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "warning" 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.474 INFO:teuthology.orchestra.run.smithi077.stdout: "log_to_file": { 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "log_to_file", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "bool", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 1, 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "False", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.475 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_host": { 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_host", 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "", 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.476 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_port": { 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_port", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "int", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.477 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "10051", 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.478 INFO:teuthology.orchestra.run.smithi077.stdout: "zabbix_sender": { 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "zabbix_sender", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "str", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "level": "advanced", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "flags": 0, 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "min": "", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "max": "", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "enum_allowed": [], 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "desc": "", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "long_desc": "", 2024-09-15T23:35:10.479 INFO:teuthology.orchestra.run.smithi077.stdout: "tags": [], 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "see_also": [] 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "services": { 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "dashboard": "https://172.21.15.77:8443/" 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "always_on_modules": { 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "octopus": [ 2024-09-15T23:35:10.480 INFO:teuthology.orchestra.run.smithi077.stdout: "balancer", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "devicehealth", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscaler", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "progress", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_support", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "status", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "telemetry", 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "volumes" 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.481 INFO:teuthology.orchestra.run.smithi077.stdout: "pacific": [ 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "balancer", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "devicehealth", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscaler", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "progress", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_support", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "status", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "telemetry", 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: "volumes" 2024-09-15T23:35:10.482 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "quincy": [ 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "balancer", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "devicehealth", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscaler", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "progress", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_support", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "status", 2024-09-15T23:35:10.483 INFO:teuthology.orchestra.run.smithi077.stdout: "telemetry", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "volumes" 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "reef": [ 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "balancer", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "devicehealth", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscaler", 2024-09-15T23:35:10.484 INFO:teuthology.orchestra.run.smithi077.stdout: "progress", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_support", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "status", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "telemetry", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "volumes" 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: ], 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "squid": [ 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "balancer", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "crash", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "devicehealth", 2024-09-15T23:35:10.485 INFO:teuthology.orchestra.run.smithi077.stdout: "orchestrator", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "pg_autoscaler", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "progress", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "rbd_support", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "status", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "telemetry", 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "volumes" 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "last_failure_osd_epoch": 3, 2024-09-15T23:35:10.486 INFO:teuthology.orchestra.run.smithi077.stdout: "active_clients": [ 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "devicehealth", 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:0", 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 4130067691 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.487 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "libcephsqlite", 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:0", 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 885637672 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.488 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "rbd_support", 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:0", 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2061299221 2024-09-15T23:35:10.489 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: }, 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: "name": "volumes", 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: "addrvec": [ 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: { 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: "type": "v2", 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: "addr": "172.21.15.77:0", 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: "nonce": 2698479441 2024-09-15T23:35:10.490 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.491 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.491 INFO:teuthology.orchestra.run.smithi077.stdout: } 2024-09-15T23:35:10.491 INFO:teuthology.orchestra.run.smithi077.stdout: ] 2024-09-15T23:35:10.491 INFO:teuthology.orchestra.run.smithi077.stdout:} 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:08 smithi159 ceph-mon[35472]: pgmap v457: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2043019225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2310088606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:08 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/586121100' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:08 smithi155 ceph-mon[35631]: pgmap v457: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:35:10.493 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2043019225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.494 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2310088606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.494 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:08 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/586121100' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:35:10.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 msgr2=0x7f6a200a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:10.494 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 0x7f6a200a5710 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6a30005d00 tx=0x7f6a30005c50 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 msgr2=0x7f6a34074b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00cad0 tx=0x7f6a2c00cf90 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 shutdown_connections 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6a200a3250 0x7f6a200a5710 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6a341036e0 0x7f6a34074b20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a34102d20 0x7f6a340745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 --2- 172.21.15.77:0/586121100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6a34101b30 0x7f6a34075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 >> 172.21.15.77:0/586121100 conn(0x7f6a340fd2b0 msgr2=0x7f6a341060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:10.495 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 shutdown_connections 2024-09-15T23:35:10.496 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:08.893+0000 7f6a3b949640 1 -- 172.21.15.77:0/586121100 wait complete. 2024-09-15T23:35:10.502 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T23:35:10.512 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T23:35:10.513 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:35:10.513 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:35:10.513 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:08 smithi077 ceph-mon[30968]: pgmap v457: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s rd, 597 B/s wr, 2 op/s 2024-09-15T23:35:10.513 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2043019225' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.513 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2310088606' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-09-15T23:35:10.514 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:08 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/586121100' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-15T23:35:10.534 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-15T23:35:10.534 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T23:35:10.595 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-15T23:35:10.890 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:11.314 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:10 smithi077 ceph-mon[30968]: pgmap v458: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:11.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:10 smithi155 ceph-mon[35631]: pgmap v458: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 -- 172.21.15.77:0/4158325165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880100a80 msgr2=0x7f9880100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 --2- 172.21.15.77:0/4158325165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880100a80 0x7f9880100ee0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9868009930 tx=0x7f986802a420 comp rx=0 tx=0).stop 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 -- 172.21.15.77:0/4158325165 shutdown_connections 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 --2- 172.21.15.77:0/4158325165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880101420 0x7f988010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 --2- 172.21.15.77:0/4158325165 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880100a80 0x7f9880100ee0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.407 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 --2- 172.21.15.77:0/4158325165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880106a80 0x7f9880106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 -- 172.21.15.77:0/4158325165 >> 172.21.15.77:0/4158325165 conn(0x7f98800fc7a0 msgr2=0x7f98800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 -- 172.21.15.77:0/4158325165 shutdown_connections 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.394+0000 7f9885db5640 1 -- 172.21.15.77:0/4158325165 wait complete. 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 Processor -- start 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 -- start start 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880100a80 0x7f98801984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 0x7f988019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f9880110e80 con 0x7f9880101420 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9880110d00 con 0x7f9880106a80 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9885db5640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9880111000 con 0x7f9880100a80 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9877fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:11.408 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9877fff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56112/0 (socket says 172.21.15.77:56112) 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.395+0000 7f9877fff640 1 -- 172.21.15.77:0/148430673 learned_addr learned my addr 172.21.15.77:0/148430673 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987f7fe640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880100a80 0x7f98801984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987ffff640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 0x7f988019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 -- 172.21.15.77:0/148430673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880100a80 msgr2=0x7f98801984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880100a80 0x7f98801984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 -- 172.21.15.77:0/148430673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 msgr2=0x7f988019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 0x7f988019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 -- 172.21.15.77:0/148430673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f988019d470 con 0x7f9880101420 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987ffff640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 0x7f988019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9877fff640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9868009230 tx=0x7f9868004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:11.409 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f986803f030 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9868003ad0 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f988019d700 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9868035070 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.396+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98801a5040 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.397+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9880100ee0 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.398+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f9868042030 con 0x7f9880101420 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.399+0000 7f987d7fa640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 0x7f986c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.399+0000 7f987f7fe640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 0x7f986c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:11.410 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.399+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f98680f0590 con 0x7f9880101420 2024-09-15T23:35:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.400+0000 7f987f7fe640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 0x7f986c0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9870005fd0 tx=0x7f987000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:11.411 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.402+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f98680bcf20 con 0x7f9880101420 2024-09-15T23:35:11.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:10 smithi159 ceph-mon[35472]: pgmap v458: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:11.583 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.582+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f988010a000 con 0x7f9880101420 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.582+0000 7f987d7fa640 1 -- 172.21.15.77:0/148430673 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v91) ==== 81+0+583 (secure 0 0 0) 0x7f98680bc820 con 0x7f9880101420 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/21470712 2024-09-16T23:22:35.713071+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/301680494 2024-09-16T23:22:35.713071+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/152076836 2024-09-16T23:22:35.713071+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6801/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1758888302 2024-09-16T23:22:35.713071+0000 2024-09-15T23:35:11.584 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:6800/85632469 2024-09-16T23:22:13.033320+0000 2024-09-15T23:35:11.585 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/3827072978 2024-09-16T23:22:13.033320+0000 2024-09-15T23:35:11.585 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1375913164 2024-09-16T23:22:13.033320+0000 2024-09-15T23:35:11.585 INFO:teuthology.orchestra.run.smithi077.stdout:172.21.15.77:0/1069420314 2024-09-16T23:22:13.033320+0000 2024-09-15T23:35:11.585 INFO:teuthology.orchestra.run.smithi077.stderr:listed 10 entries 2024-09-15T23:35:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 msgr2=0x7f986c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 0x7f986c0a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9870005fd0 tx=0x7f987000b390 comp rx=0 tx=0).stop 2024-09-15T23:35:11.586 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 msgr2=0x7f9880198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f9868009230 tx=0x7f9868004270 comp rx=0 tx=0).stop 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 shutdown_connections 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.584+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f986c0a3240 0x7f986c0a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9880106a80 0x7f988019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f9880101420 0x7f9880198a00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 --2- 172.21.15.77:0/148430673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9880100a80 0x7f98801984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 >> 172.21.15.77:0/148430673 conn(0x7f98800fc7a0 msgr2=0x7f988006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 shutdown_connections 2024-09-15T23:35:11.587 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:11.585+0000 7f9885db5640 1 -- 172.21.15.77:0/148430673 wait complete. 2024-09-15T23:35:12.354 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:12 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/148430673' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:35:12.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:12 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/148430673' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:35:12.381 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T23:35:12.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:35:12.382 DEBUG:teuthology.orchestra.run.smithi077:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T23:35:12.419 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:35:12.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:35:12.420 DEBUG:teuthology.orchestra.run.smithi077:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T23:35:12.464 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:12 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/148430673' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-15T23:35:12.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:35:12.476 DEBUG:teuthology.orchestra.run.smithi077:> ip netns list 2024-09-15T23:35:12.532 INFO:teuthology.orchestra.run.smithi077.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T23:35:12.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:35:12.532 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T23:35:12.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T23:35:12.598 DEBUG:teuthology.orchestra.run.smithi077:> sudo ip link delete ceph-brx 2024-09-15T23:35:12.694 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-15T23:35:12.706 INFO:tasks.cephadm:Teardown begin 2024-09-15T23:35:12.706 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T23:35:12.706 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:35:12.954 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:13.266 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:13 smithi077 ceph-mon[30968]: pgmap v459: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:13.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:13 smithi155 ceph-mon[35631]: pgmap v459: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:13.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:13 smithi159 ceph-mon[35472]: pgmap v459: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 170 B/s wr, 2 op/s 2024-09-15T23:35:13.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 -- 172.21.15.77:0/3018132492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 msgr2=0x7f8018100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:13.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3018132492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f8018100860 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8014009900 tx=0x7f801402a410 comp rx=0 tx=0).stop 2024-09-15T23:35:13.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 -- 172.21.15.77:0/3018132492 shutdown_connections 2024-09-15T23:35:13.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3018132492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 0x7f801810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.468 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3018132492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f8018104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3018132492 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f8018100860 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 -- 172.21.15.77:0/3018132492 >> 172.21.15.77:0/3018132492 conn(0x7f8018077210 msgr2=0x7f80180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:13.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 -- 172.21.15.77:0/3018132492 shutdown_connections 2024-09-15T23:35:13.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.447+0000 7f801f4f2640 1 -- 172.21.15.77:0/3018132492 wait complete. 2024-09-15T23:35:13.469 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 Processor -- start 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 -- start start 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f801810ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 0x7f801810f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8018112030 con 0x7f8018100480 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8018111eb0 con 0x7f80181055b0 2024-09-15T23:35:13.470 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801f4f2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f80181121b0 con 0x7f8018100e30 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56138/0 (socket says 172.21.15.77:56138) 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 -- 172.21.15.77:0/3722233420 learned_addr learned my addr 172.21.15.77:0/3722233420 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801da8f640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 0x7f801810f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801ca8d640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f801810ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:13.471 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 -- 172.21.15.77:0/3722233420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 msgr2=0x7f801810ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f801810ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 -- 172.21.15.77:0/3722233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 msgr2=0x7f801810f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 0x7f801810f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801d28e640 1 -- 172.21.15.77:0/3722233420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80181a6a40 con 0x7f8018100480 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.448+0000 7f801ca8d640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f801810ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:13.472 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f801d28e640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8014005ab0 tx=0x7f80140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801403f030 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80181a6cd0 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8014003ce0 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014035070 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.449+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80181a71b0 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.450+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80181008e0 con 0x7f8018100480 2024-09-15T23:35:13.473 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.451+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8014042030 con 0x7f8018100480 2024-09-15T23:35:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.452+0000 7f800a7fc640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 0x7f80040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.452+0000 7f801ca8d640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 0x7f80040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.452+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f80140f0550 con 0x7f8018100480 2024-09-15T23:35:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.452+0000 7f801ca8d640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 0x7f80040a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f800c006fd0 tx=0x7f800c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:13.474 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.456+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f80140bcee0 con 0x7f8018100480 2024-09-15T23:35:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.656+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8018108790 con 0x7f8018100480 2024-09-15T23:35:13.657 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.656+0000 7f800a7fc640 1 -- 172.21.15.77:0/3722233420 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f80140bc7e0 con 0x7f8018100480 2024-09-15T23:35:13.658 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:13.658 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:35:13.658 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 msgr2=0x7f80040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 0x7f80040a5700 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f800c006fd0 tx=0x7f800c008040 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 msgr2=0x7f801810e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8014005ab0 tx=0x7f80140042f0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 shutdown_connections 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f80040a3240 0x7f80040a5700 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80181055b0 0x7f801810f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8018100e30 0x7f801810ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 --2- 172.21.15.77:0/3722233420 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8018100480 0x7f801810e850 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.658+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 >> 172.21.15.77:0/3722233420 conn(0x7f8018077210 msgr2=0x7f80180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.659+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 shutdown_connections 2024-09-15T23:35:13.660 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:13.659+0000 7f801f4f2640 1 -- 172.21.15.77:0/3722233420 wait complete. 2024-09-15T23:35:14.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:14 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3722233420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:14.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:14 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3722233420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:14.445 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-15T23:35:14.464 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:14 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3722233420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:14.692 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:15.129 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:15 smithi077 ceph-mon[30968]: pgmap v460: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 -- 172.21.15.77:0/3970766081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 msgr2=0x7f680c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 --2- 172.21.15.77:0/3970766081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c10ea90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f6804009ca0 tx=0x7f680402a8c0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 -- 172.21.15.77:0/3970766081 shutdown_connections 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 --2- 172.21.15.77:0/3970766081 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c10ea90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 --2- 172.21.15.77:0/3970766081 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 0x7f680c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 --2- 172.21.15.77:0/3970766081 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 0x7f680c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.221 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 -- 172.21.15.77:0/3970766081 >> 172.21.15.77:0/3970766081 conn(0x7f680c0fd8c0 msgr2=0x7f680c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 -- 172.21.15.77:0/3970766081 shutdown_connections 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.207+0000 7f6811856640 1 -- 172.21.15.77:0/3970766081 wait complete. 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 Processor -- start 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 -- start start 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 0x7f680c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 0x7f680c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f680c111f70 con 0x7f680c106f10 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f680c111df0 con 0x7f680c102790 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f6811856640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f680c1120f0 con 0x7f680c101de0 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f680b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.208+0000 7f680b7fe640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:56160/0 (socket says 172.21.15.77:56160) 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 -- 172.21.15.77:0/3711492637 learned_addr learned my addr 172.21.15.77:0/3711492637 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:15.222 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680affd640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 0x7f680c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 -- 172.21.15.77:0/3711492637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 msgr2=0x7f680c1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 0x7f680c1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 -- 172.21.15.77:0/3711492637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 msgr2=0x7f680c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f68027fc640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 0x7f680c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 0x7f680c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 -- 172.21.15.77:0/3711492637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c19d380 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f680b7fe640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6804031a20 tx=0x7f6804031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804003c30 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6804003dd0 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c19d610 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680402fcf0 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.209+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c1a4f50 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.210+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c1021c0 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.211+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6804004050 con 0x7f680c106f10 2024-09-15T23:35:15.223 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.212+0000 7f6810854640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 0x7f67f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.212+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f68040f11d0 con 0x7f680c106f10 2024-09-15T23:35:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.212+0000 7f680affd640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 0x7f67f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.213+0000 7f680affd640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 0x7f67f80a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67fc005fd0 tx=0x7f67fc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:15.224 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.215+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f68040bdbf0 con 0x7f680c106f10 2024-09-15T23:35:15.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:15 smithi155 ceph-mon[35631]: pgmap v460: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:35:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.415+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f680c199730 con 0x7f680c106f10 2024-09-15T23:35:15.416 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.415+0000 7f6810854640 1 -- 172.21.15.77:0/3711492637 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+11860 (secure 0 0 0) 0x7f680c199730 con 0x7f680c106f10 2024-09-15T23:35:15.417 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:15.417 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":21,"btime":"2024-09-15T23:30:13:893908+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14535,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6835/2999536599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6834","nonce":2999536599},{"type":"v1","addr":"172.21.15.77:6835","nonce":2999536599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6837/1486038623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6836","nonce":1486038623},{"type":"v1","addr":"172.21.15.77:6837","nonce":1486038623}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14592,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6839/1197951857","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6838","nonce":1197951857},{"type":"v1","addr":"172.21.15.77:6839","nonce":1197951857}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14598,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.77:6841/1286272134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6840","nonce":1286272134},{"type":"v1","addr":"172.21.15.77:6841","nonce":1286272134}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24383,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/2847751419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":2847751419},{"type":"v1","addr":"172.21.15.155:6833","nonce":2847751419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24407,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/31263925","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":31263925},{"type":"v1","addr":"172.21.15.155:6835","nonce":31263925}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24421,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/1148226209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":1148226209},{"type":"v1","addr":"172.21.15.159:6833","nonce":1148226209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24428,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/1039901701","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":1039901701},{"type":"v1","addr":"172.21.15.155:6837","nonce":1039901701}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24439,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/3015432739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":3015432739},{"type":"v1","addr":"172.21.15.159:6835","nonce":3015432739}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6837/2654057278","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6836","nonce":2654057278},{"type":"v1","addr":"172.21.15.159:6837","nonce":2654057278}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-15T23:29:31.287245+0000","modified":"2024-09-15T23:30:13.582797+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24460},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24455":{"gid":24455,"name":"b","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6839/1912555419","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1912555419},{"type":"v1","addr":"172.21.15.155:6839","nonce":1912555419}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24460":{"gid":24460,"name":"i","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.159:6839/2481115545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6838","nonce":2481115545},{"type":"v1","addr":"172.21.15.159:6839","nonce":2481115545}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24460,"qdb_cluster":[24460]},"id":1}]} 2024-09-15T23:35:15.417 INFO:teuthology.orchestra.run.smithi077.stderr:dumped fsmap epoch 21 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 msgr2=0x7f67f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 0x7f67f80a5700 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67fc005fd0 tx=0x7f67fc00b390 comp rx=0 tx=0).stop 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 msgr2=0x7f680c19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6804031a20 tx=0x7f6804031a50 comp rx=0 tx=0).stop 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 shutdown_connections 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f67f80a3240 0x7f67f80a5700 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f680c106f10 0x7f680c19cca0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.419 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f680c102790 0x7f680c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 --2- 172.21.15.77:0/3711492637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f680c101de0 0x7f680c1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.417+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 >> 172.21.15.77:0/3711492637 conn(0x7f680c0fd8c0 msgr2=0x7f680c0feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.418+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 shutdown_connections 2024-09-15T23:35:15.420 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:15.418+0000 7f6811856640 1 -- 172.21.15.77:0/3711492637 wait complete. 2024-09-15T23:35:15.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:15 smithi159 ceph-mon[35472]: pgmap v460: 129 pgs: 129 active+clean; 695 KiB data, 626 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 1 op/s 2024-09-15T23:35:16.285 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:16 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/3711492637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:16.321 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-15T23:35:16.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:16 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/3711492637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:16.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:16 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/3711492637' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-15T23:35:16.574 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 -- 172.21.15.77:0/2695088292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468102790 msgr2=0x7f84681067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 --2- 172.21.15.77:0/2695088292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468102790 0x7f84681067e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8458009900 tx=0x7f845802a410 comp rx=0 tx=0).stop 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 -- 172.21.15.77:0/2695088292 shutdown_connections 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 --2- 172.21.15.77:0/2695088292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468106f10 0x7f846810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 --2- 172.21.15.77:0/2695088292 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468102790 0x7f84681067e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 --2- 172.21.15.77:0/2695088292 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 0x7f84681021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.050+0000 7f846f2ed640 1 -- 172.21.15.77:0/2695088292 >> 172.21.15.77:0/2695088292 conn(0x7f84680fd8c0 msgr2=0x7f84680ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- 172.21.15.77:0/2695088292 shutdown_connections 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- 172.21.15.77:0/2695088292 wait complete. 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 Processor -- start 2024-09-15T23:35:17.081 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- start start 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 0x7f8468198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 0x7f84681988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f8468111f30 con 0x7f8468106f10 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8468111db0 con 0x7f8468101de0 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846f2ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f84681120b0 con 0x7f8468102790 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846d88a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846d88a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54276/0 (socket says 172.21.15.77:54276) 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.051+0000 7f846d88a640 1 -- 172.21.15.77:0/4147831462 learned_addr learned my addr 172.21.15.77:0/4147831462 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d089640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 0x7f8468198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846c888640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 0x7f84681988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 -- 172.21.15.77:0/4147831462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 msgr2=0x7f84681988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:17.082 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 0x7f84681988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 -- 172.21.15.77:0/4147831462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 msgr2=0x7f8468198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 0x7f8468198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 -- 172.21.15.77:0/4147831462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f846819d330 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846c888640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 0x7f84681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846d88a640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f846000d750 tx=0x7f846000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460017070 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f846819d620 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8460005500 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8460004d90 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.052+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84681a4f00 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.053+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84681021c0 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.054+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f8460004f30 con 0x7f8468106f10 2024-09-15T23:35:17.083 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.055+0000 7f845e7fc640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 0x7f84540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.055+0000 7f846d089640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 0x7f84540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.055+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f84600cf610 con 0x7f8468106f10 2024-09-15T23:35:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.055+0000 7f846d089640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 0x7f84540a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8464007ec0 tx=0x7f84640075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:17.084 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.059+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f846009bfa0 con 0x7f8468106f10 2024-09-15T23:35:17.227 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.226+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f846810a0f0 con 0x7f8468106f10 2024-09-15T23:35:17.227 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:17 smithi077 ceph-mon[30968]: pgmap v461: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:17.228 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.227+0000 7f845e7fc640 1 -- 172.21.15.77:0/4147831462 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24847 (secure 0 0 0) 0x7f846009b8a0 con 0x7f8468106f10 2024-09-15T23:35:17.229 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-15T23:35:17.229 INFO:teuthology.orchestra.run.smithi077.stdout:{"epoch":91,"fsid":"1be60238-73b9-11ef-bceb-c7b262605968","created":"2024-09-15T23:21:49.385550+0000","modified":"2024-09-15T23:30:37.982445+0000","last_up_change":"2024-09-15T23:28:40.179008+0000","last_in_change":"2024-09-15T23:28:15.837935+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T23:24:50.012656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T23:29:26.912021+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T23:29:29.489806+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T23:29:35.970801+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee3b4da9-83a7-4c4c-80f6-f57a4e5d20af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6803","nonce":1105167923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6805","nonce":1105167923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6809","nonce":1105167923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":1105167923},{"type":"v1","addr":"172.21.15.77:6807","nonce":1105167923}]},"public_addr":"172.21.15.77:6803/1105167923","cluster_addr":"172.21.15.77:6805/1105167923","heartbeat_back_addr":"172.21.15.77:6809/1105167923","heartbeat_front_addr":"172.21.15.77:6807/1105167923","state":["exists","up"]},{"osd":1,"uuid":"0c74b13c-72a8-46ce-8a2d-e59a12ca72e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6801","nonce":3752689492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6803","nonce":3752689492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6807","nonce":3752689492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":3752689492},{"type":"v1","addr":"172.21.15.155:6805","nonce":3752689492}]},"public_addr":"172.21.15.155:6801/3752689492","cluster_addr":"172.21.15.155:6803/3752689492","heartbeat_back_addr":"172.21.15.155:6807/3752689492","heartbeat_front_addr":"172.21.15.155:6805/3752689492","state":["exists","up"]},{"osd":2,"uuid":"8d6d28da-532b-4afd-ba6b-116531ce058a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6801","nonce":1459216762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6803","nonce":1459216762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6807","nonce":1459216762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1459216762},{"type":"v1","addr":"172.21.15.159:6805","nonce":1459216762}]},"public_addr":"172.21.15.159:6801/1459216762","cluster_addr":"172.21.15.159:6803/1459216762","heartbeat_back_addr":"172.21.15.159:6807/1459216762","heartbeat_front_addr":"172.21.15.159:6805/1459216762","state":["exists","up"]},{"osd":3,"uuid":"507a52c1-e858-4adb-97e8-073b33f574aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6811","nonce":3522993793}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6813","nonce":3522993793}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6817","nonce":3522993793}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":3522993793},{"type":"v1","addr":"172.21.15.77:6815","nonce":3522993793}]},"public_addr":"172.21.15.77:6811/3522993793","cluster_addr":"172.21.15.77:6813/3522993793","heartbeat_back_addr":"172.21.15.77:6817/3522993793","heartbeat_front_addr":"172.21.15.77:6815/3522993793","state":["exists","up"]},{"osd":4,"uuid":"7b175e86-d9a2-41a5-872e-9b979b709070","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6809","nonce":1067866253}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6811","nonce":1067866253}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6815","nonce":1067866253}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":1067866253},{"type":"v1","addr":"172.21.15.155:6813","nonce":1067866253}]},"public_addr":"172.21.15.155:6809/1067866253","cluster_addr":"172.21.15.155:6811/1067866253","heartbeat_back_addr":"172.21.15.155:6815/1067866253","heartbeat_front_addr":"172.21.15.155:6813/1067866253","state":["exists","up"]},{"osd":5,"uuid":"2bd1fb3c-9799-4ce9-9284-28ab5ce04d1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6809","nonce":1369347099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6811","nonce":1369347099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6815","nonce":1369347099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":1369347099},{"type":"v1","addr":"172.21.15.159:6813","nonce":1369347099}]},"public_addr":"172.21.15.159:6809/1369347099","cluster_addr":"172.21.15.159:6811/1369347099","heartbeat_back_addr":"172.21.15.159:6815/1369347099","heartbeat_front_addr":"172.21.15.159:6813/1369347099","state":["exists","up"]},{"osd":6,"uuid":"a70f9349-8a28-4915-a236-68f7a4ba7045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6819","nonce":2986107738}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6821","nonce":2986107738}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6825","nonce":2986107738}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":2986107738},{"type":"v1","addr":"172.21.15.77:6823","nonce":2986107738}]},"public_addr":"172.21.15.77:6819/2986107738","cluster_addr":"172.21.15.77:6821/2986107738","heartbeat_back_addr":"172.21.15.77:6825/2986107738","heartbeat_front_addr":"172.21.15.77:6823/2986107738","state":["exists","up"]},{"osd":7,"uuid":"49b06105-0357-42ce-8a9e-a322dc8a07bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6817","nonce":649069233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6819","nonce":649069233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6823","nonce":649069233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":649069233},{"type":"v1","addr":"172.21.15.155:6821","nonce":649069233}]},"public_addr":"172.21.15.155:6817/649069233","cluster_addr":"172.21.15.155:6819/649069233","heartbeat_back_addr":"172.21.15.155:6823/649069233","heartbeat_front_addr":"172.21.15.155:6821/649069233","state":["exists","up"]},{"osd":8,"uuid":"0f0baf0c-70da-4e75-a6ee-018aba7a4232","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6817","nonce":2918585527}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6819","nonce":2918585527}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6823","nonce":2918585527}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":2918585527},{"type":"v1","addr":"172.21.15.159:6821","nonce":2918585527}]},"public_addr":"172.21.15.159:6817/2918585527","cluster_addr":"172.21.15.159:6819/2918585527","heartbeat_back_addr":"172.21.15.159:6823/2918585527","heartbeat_front_addr":"172.21.15.159:6821/2918585527","state":["exists","up"]},{"osd":9,"uuid":"8c4453cd-f940-4154-a304-1c0d4631e409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6827","nonce":1779757892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6829","nonce":1779757892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6833","nonce":1779757892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":1779757892},{"type":"v1","addr":"172.21.15.77:6831","nonce":1779757892}]},"public_addr":"172.21.15.77:6827/1779757892","cluster_addr":"172.21.15.77:6829/1779757892","heartbeat_back_addr":"172.21.15.77:6833/1779757892","heartbeat_front_addr":"172.21.15.77:6831/1779757892","state":["exists","up"]},{"osd":10,"uuid":"2041bfe6-5aff-493b-be41-ece230318b08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6825","nonce":3242099303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6827","nonce":3242099303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6831","nonce":3242099303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":3242099303},{"type":"v1","addr":"172.21.15.155:6829","nonce":3242099303}]},"public_addr":"172.21.15.155:6825/3242099303","cluster_addr":"172.21.15.155:6827/3242099303","heartbeat_back_addr":"172.21.15.155:6831/3242099303","heartbeat_front_addr":"172.21.15.155:6829/3242099303","state":["exists","up"]},{"osd":11,"uuid":"d887c196-e9e9-4265-99c6-63bf61151831","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":77,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6825","nonce":296038473}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6827","nonce":296038473}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6831","nonce":296038473}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":296038473},{"type":"v1","addr":"172.21.15.159:6829","nonce":296038473}]},"public_addr":"172.21.15.159:6825/296038473","cluster_addr":"172.21.15.159:6827/296038473","heartbeat_back_addr":"172.21.15.159:6831/296038473","heartbeat_front_addr":"172.21.15.159:6829/296038473","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:23:58.277368+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:23.054295+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:24:47.300381+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:12.420078+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:25:38.042809+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:03.881401+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:29.303976+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:26:55.097876+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:20.237375+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:27:46.402935+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:12.144796+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T23:28:37.924222+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.2","mappings":[{"from":3,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":6}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.37","mappings":[{"from":5,"to":7}]},{"pgid":"4.2","mappings":[{"from":9,"to":1}]},{"pgid":"4.6","mappings":[{"from":5,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.77:0/21470712":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/301680494":"2024-09-16T23:22:35.713071+0000","172.21.15.77:0/152076836":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6801/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1758888302":"2024-09-16T23:22:35.713071+0000","172.21.15.77:6800/85632469":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/3827072978":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1375913164":"2024-09-16T23:22:13.033320+0000","172.21.15.77:0/1069420314":"2024-09-16T23:22:13.033320+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 msgr2=0x7f84540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 0x7f84540a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8464007ec0 tx=0x7f84640075b0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 msgr2=0x7f846819cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f846000d750 tx=0x7f846000dc10 comp rx=0 tx=0).stop 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 shutdown_connections 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f84540a3240 0x7f84540a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f8468106f10 0x7f846819cc50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.231 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8468102790 0x7f84681988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 --2- 172.21.15.77:0/4147831462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8468101de0 0x7f8468198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:17.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.229+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 >> 172.21.15.77:0/4147831462 conn(0x7f84680fd8c0 msgr2=0x7f84680fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:17.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.230+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 shutdown_connections 2024-09-15T23:35:17.232 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:17.230+0000 7f846f2ed640 1 -- 172.21.15.77:0/4147831462 wait complete. 2024-09-15T23:35:17.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:17 smithi155 ceph-mon[35631]: pgmap v461: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:17.366 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:17 smithi159 ceph-mon[35472]: pgmap v461: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:18.020 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-15T23:35:18.267 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:18.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:18 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/4147831462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:18.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:18 smithi155 ceph-mon[35631]: pgmap v462: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:18.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:18 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/4147831462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:18.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:18 smithi077 ceph-mon[30968]: pgmap v462: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:18.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/4147831462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-15T23:35:18.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-mon[35472]: pgmap v462: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s rd, 255 B/s wr, 2 op/s 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 -- 172.21.15.77:0/1793730142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8101de0 msgr2=0x7f6be81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/1793730142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8101de0 0x7f6be81021c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8009900 tx=0x7f6bd802a410 comp rx=0 tx=0).stop 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 -- 172.21.15.77:0/1793730142 shutdown_connections 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/1793730142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8106f10 0x7f6be810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/1793730142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/1793730142 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8101de0 0x7f6be81021c0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 -- 172.21.15.77:0/1793730142 >> 172.21.15.77:0/1793730142 conn(0x7f6be80fd8c0 msgr2=0x7f6be80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 -- 172.21.15.77:0/1793730142 shutdown_connections 2024-09-15T23:35:18.724 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.719+0000 7f6bee8e9640 1 -- 172.21.15.77:0/1793730142 wait complete. 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 Processor -- start 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 -- start start 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 0x7f6be8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8111f70 con 0x7f6be8106f10 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6be8111df0 con 0x7f6be8102790 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bee8e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6be81120f0 con 0x7f6be8101de0 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bece86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bece86640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54288/0 (socket says 172.21.15.77:54288) 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6bece86640 1 -- 172.21.15.77:0/2932693997 learned_addr learned my addr 172.21.15.77:0/2932693997 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.720+0000 7f6be77fe640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:18.725 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be7fff640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 0x7f6be8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 -- 172.21.15.77:0/2932693997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 msgr2=0x7f6be8198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 0x7f6be8198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 -- 172.21.15.77:0/2932693997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 msgr2=0x7f6be8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 -- 172.21.15.77:0/2932693997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6be819d3b0 con 0x7f6be8106f10 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be7fff640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 0x7f6be8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be77fe640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bece86640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6be000cad0 tx=0x7f6be000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be000ae20 con 0x7f6be8106f10 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6be0005020 con 0x7f6be8106f10 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6be819d6a0 con 0x7f6be8106f10 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be000f6f0 con 0x7f6be8106f10 2024-09-15T23:35:18.726 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.721+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6be81a4f80 con 0x7f6be8106f10 2024-09-15T23:35:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.722+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6be81021c0 con 0x7f6be8106f10 2024-09-15T23:35:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.723+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6be00051d0 con 0x7f6be8106f10 2024-09-15T23:35:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.724+0000 7f6be57fa640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 0x7f6bd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.724+0000 7f6be7fff640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 0x7f6bd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:18.727 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.724+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9150+0+0 (secure 0 0 0) 0x7f6be00d0040 con 0x7f6be8106f10 2024-09-15T23:35:18.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.724+0000 7f6be7fff640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 0x7f6bd40a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:18.728 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.727+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f6be0014030 con 0x7f6be8106f10 2024-09-15T23:35:18.929 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.928+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6be8109b60 con 0x7f6be8106f10 2024-09-15T23:35:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.931+0000 7f6be57fa640 1 -- 172.21.15.77:0/2932693997 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f6be009c9d0 con 0x7f6be8106f10 2024-09-15T23:35:18.932 INFO:teuthology.orchestra.run.smithi077.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T23:35:18.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 msgr2=0x7f6bd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:18.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 0x7f6bd40a5700 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8000c00 tx=0x7f6bd8032c70 comp rx=0 tx=0).stop 2024-09-15T23:35:18.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 msgr2=0x7f6be819ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:18.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6be000cad0 tx=0x7f6be000cf90 comp rx=0 tx=0).stop 2024-09-15T23:35:18.934 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 shutdown_connections 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f6bd40a3240 0x7f6bd40a5700 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f6be8106f10 0x7f6be819ccd0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6be8102790 0x7f6be8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 --2- 172.21.15.77:0/2932693997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6be8101de0 0x7f6be8198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 >> 172.21.15.77:0/2932693997 conn(0x7f6be80fd8c0 msgr2=0x7f6be80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 shutdown_connections 2024-09-15T23:35:18.935 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:18.933+0000 7f6bee8e9640 1 -- 172.21.15.77:0/2932693997 wait complete. 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:18 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a[30962]: 2024-09-15T23:35:18.929+0000 7f5eb0ef9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:35:19.253 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:19 smithi077 ceph-mon[30968]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:35:19.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:19 smithi155 ceph-mon[35631]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2932693997' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: osdmap e92: 12 total, 12 up, 12 in 2024-09-15T23:35:19.465 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:19 smithi159 ceph-mon[35472]: fsmap cephfs:0/1 10 up:standby, 1 failed 2024-09-15T23:35:19.466 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: ignoring --setuser ceph since I am not root 2024-09-15T23:35:19.466 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: ignoring --setgroup ceph since I am not root 2024-09-15T23:35:19.466 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-mds[66012]: -- 172.21.15.159:0/1355575598 <== mon.1 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d37599860 con 0x556d37577000 2024-09-15T23:35:19.466 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:35:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: starting mds.i at 2024-09-15T23:35:19.693 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T23:35:19.939 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 -- 172.21.15.77:0/1255969548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50101400 msgr2=0x7f1c5010d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 --2- 172.21.15.77:0/1255969548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50101400 0x7f1c5010d930 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009cd0 tx=0x7f1c4802a8e0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 -- 172.21.15.77:0/1255969548 shutdown_connections 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 --2- 172.21.15.77:0/1255969548 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50101400 0x7f1c5010d930 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 --2- 172.21.15.77:0/1255969548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50100a60 0x7f1c50100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.426 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 --2- 172.21.15.77:0/1255969548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 0x7f1c50106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 -- 172.21.15.77:0/1255969548 >> 172.21.15.77:0/1255969548 conn(0x7f1c500fc780 msgr2=0x7f1c500feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 -- 172.21.15.77:0/1255969548 shutdown_connections 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 -- 172.21.15.77:0/1255969548 wait complete. 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.404+0000 7f1c5551a640 1 Processor -- start 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 -- start start 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50101400 0x7f1c500fd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 0x7f1c500fd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110e60 con 0x7f1c50100a60 2024-09-15T23:35:20.427 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110ce0 con 0x7f1c50106a60 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c5551a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110fe0 con 0x7f1c50101400 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54300/0 (socket says 172.21.15.77:54300) 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 -- 172.21.15.77:0/966492886 learned_addr learned my addr 172.21.15.77:0/966492886 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4f7fe640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 0x7f1c500fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4e7fc640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50101400 0x7f1c500fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 -- 172.21.15.77:0/966492886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50101400 msgr2=0x7f1c500fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50101400 0x7f1c500fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 -- 172.21.15.77:0/966492886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 msgr2=0x7f1c500fd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 0x7f1c500fd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.405+0000 7f1c4effd640 1 -- 172.21.15.77:0/966492886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c501a6800 con 0x7f1c50100a60 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c4effd640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800d950 tx=0x7f1c3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:20.428 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c38017070 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1c38009c30 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c501a6af0 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3800f6b0 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.406+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501a7030 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.407+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c50100ec0 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.408+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f1c380109d0 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.409+0000 7f1c47fff640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.409+0000 7f1c4e7fc640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.409+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9236+0+0 (secure 0 0 0) 0x7f1c380cf8a0 con 0x7f1c50100a60 2024-09-15T23:35:20.429 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.409+0000 7f1c4e7fc640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005e10 tx=0x7f1c40005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:20.430 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.413+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f1c38009de0 con 0x7f1c50100a60 2024-09-15T23:35:20.616 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:20.615+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f1c50109a50 con 0x7f1c50100a60 2024-09-15T23:35:21.030 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.029+0000 7f1c47fff640 1 -- 172.21.15.77:0/966492886 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) ==== 104+0+0 (secure 0 0 0) 0x7f1c38084e20 con 0x7f1c50100a60 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 msgr2=0x7f1c3c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1c40005e10 tx=0x7f1c40005da0 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 msgr2=0x7f1c500fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800d950 tx=0x7f1c3800de10 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 shutdown_connections 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f1c3c0a3240 0x7f1c3c0a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1c50106a60 0x7f1c500fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c50101400 0x7f1c500fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 --2- 172.21.15.77:0/966492886 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f1c50100a60 0x7f1c500fce10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 >> 172.21.15.77:0/966492886 conn(0x7f1c500fc780 msgr2=0x7f1c5006aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:21.034 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.032+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 shutdown_connections 2024-09-15T23:35:21.035 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:21.033+0000 7f1c5551a640 1 -- 172.21.15.77:0/966492886 wait complete. 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: pgmap v464: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.155:6838/3734229081,v1:172.21.15.155:6839/3734229081] up:boot 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: mds.? [v2:172.21.15.159:6838/2522984688,v1:172.21.15.159:6839/2522984688] up:boot 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:35:21.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:20 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: pgmap v464: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.155:6838/3734229081,v1:172.21.15.155:6839/3734229081] up:boot 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: mds.? [v2:172.21.15.159:6838/2522984688,v1:172.21.15.159:6839/2522984688] up:boot 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:35:21.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:20 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:35:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: pgmap v464: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.155:6838/3734229081,v1:172.21.15.155:6839/3734229081] up:boot 2024-09-15T23:35:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: mds.? [v2:172.21.15.159:6838/2522984688,v1:172.21.15.159:6839/2522984688] up:boot 2024-09-15T23:35:21.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: fsmap cephfs:0/1 12 up:standby, 1 failed 2024-09-15T23:35:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-15T23:35:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: from='mgr.14150 172.21.15.77:0/4069954665' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-15T23:35:21.384 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:20 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-15T23:35:22.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T23:35:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:21 smithi159 ceph-mon[35472]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:35:22.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:21 smithi159 ceph-mon[35472]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:35:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:21 smithi159 ceph-mon[35472]: Cluster is now healthy 2024-09-15T23:35:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:21 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:35:22.216 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:21 smithi159 ceph-mon[35472]: fsmap 12 up:standby 2024-09-15T23:35:22.283 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:21 smithi155 ceph-mon[35631]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:35:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:21 smithi155 ceph-mon[35631]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:35:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:21 smithi155 ceph-mon[35631]: Cluster is now healthy 2024-09-15T23:35:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:21 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:35:22.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:21 smithi155 ceph-mon[35631]: fsmap 12 up:standby 2024-09-15T23:35:22.382 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:21 smithi077 ceph-mon[30968]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-15T23:35:22.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:21 smithi077 ceph-mon[30968]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-15T23:35:22.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:21 smithi077 ceph-mon[30968]: Cluster is now healthy 2024-09-15T23:35:22.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:21 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/966492886' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-15T23:35:22.383 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:21 smithi077 ceph-mon[30968]: fsmap 12 up:standby 2024-09-15T23:35:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 -- 172.21.15.77:0/1289003835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c100a80 msgr2=0x7fc87c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 --2- 172.21.15.77:0/1289003835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c100a80 0x7fc87c100ee0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc864009930 tx=0x7fc86402a420 comp rx=0 tx=0).stop 2024-09-15T23:35:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 -- 172.21.15.77:0/1289003835 shutdown_connections 2024-09-15T23:35:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 --2- 172.21.15.77:0/1289003835 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c101420 0x7fc87c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:22.812 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 --2- 172.21.15.77:0/1289003835 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c100a80 0x7fc87c100ee0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 --2- 172.21.15.77:0/1289003835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c106a80 0x7fc87c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 -- 172.21.15.77:0/1289003835 >> 172.21.15.77:0/1289003835 conn(0x7fc87c0fc7a0 msgr2=0x7fc87c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 -- 172.21.15.77:0/1289003835 shutdown_connections 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.795+0000 7fc880adc640 1 -- 172.21.15.77:0/1289003835 wait complete. 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 Processor -- start 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 -- start start 2024-09-15T23:35:22.813 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c100a80 0x7fc87c10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 0x7fc87c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c111fa0 con 0x7fc87c101420 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c111e20 con 0x7fc87c106a80 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc880adc640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc87c112120 con 0x7fc87c100a80 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.796+0000 7fc871d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54318/0 (socket says 172.21.15.77:54318) 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 -- 172.21.15.77:0/260075586 learned_addr learned my addr 172.21.15.77:0/260075586 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:22.814 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc87a59c640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c100a80 0x7fc87c10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc87ad9d640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 0x7fc87c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 -- 172.21.15.77:0/260075586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c100a80 msgr2=0x7fc87c10e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c100a80 0x7fc87c10e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 -- 172.21.15.77:0/260075586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 msgr2=0x7fc87c10ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:22.815 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 0x7fc87c10ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 -- 172.21.15.77:0/260075586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc87c1a68f0 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc87ad9d640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 0x7fc87c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc871d9b640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc864009230 tx=0x7fc864004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86403f030 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc87c1a6b80 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc864003ad0 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc864035070 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.797+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc87c1a7060 con 0x7fc87c101420 2024-09-15T23:35:22.816 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.798+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc87c100ee0 con 0x7fc87c101420 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.799+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc864042030 con 0x7fc87c101420 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.800+0000 7fc873fff640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 0x7fc8680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.800+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9236+0+0 (secure 0 0 0) 0x7fc8640f05b0 con 0x7fc87c101420 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.800+0000 7fc87a59c640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 0x7fc8680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.801+0000 7fc87a59c640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 0x7fc8680a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005fd0 tx=0x7fc86c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:22.817 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.803+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7fc8640bcee0 con 0x7fc87c101420 2024-09-15T23:35:22.972 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:22.971+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc87c108ff0 con 0x7fc87c101420 2024-09-15T23:35:22.972 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:22 smithi077 ceph-mon[30968]: pgmap v465: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:23.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:22 smithi159 ceph-mon[35472]: pgmap v465: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:23.265 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:22 smithi155 ceph-mon[35631]: pgmap v465: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:23.946 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.945+0000 7fc873fff640 1 -- 172.21.15.77:0/260075586 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) ==== 181+0+0 (secure 0 0 0) 0x7fc8640bc7e0 con 0x7fc87c101420 2024-09-15T23:35:23.947 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_metadata' removed 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 msgr2=0x7fc8680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 0x7fc8680a5700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc86c005fd0 tx=0x7fc86c00b390 comp rx=0 tx=0).stop 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 msgr2=0x7fc87c10e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc864009230 tx=0x7fc864004270 comp rx=0 tx=0).stop 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 shutdown_connections 2024-09-15T23:35:23.950 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7fc8680a3240 0x7fc8680a5700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc87c106a80 0x7fc87c10ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7fc87c101420 0x7fc87c10e920 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 --2- 172.21.15.77:0/260075586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc87c100a80 0x7fc87c10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.948+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 >> 172.21.15.77:0/260075586 conn(0x7fc87c0fc7a0 msgr2=0x7fc87c0fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.949+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 shutdown_connections 2024-09-15T23:35:23.951 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:23.949+0000 7fc880adc640 1 -- 172.21.15.77:0/260075586 wait complete. 2024-09-15T23:35:24.015 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:23 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:24.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:23 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:24.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:23 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:24.704 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T23:35:24.963 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:25.212 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:24 smithi077 ceph-mon[30968]: pgmap v466: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:25.212 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:24 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:25.212 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:24 smithi077 ceph-mon[30968]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:35:25.214 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:24 smithi159 ceph-mon[35472]: pgmap v466: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:24 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:25.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:24 smithi159 ceph-mon[35472]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:35:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:24 smithi155 ceph-mon[35631]: pgmap v466: 129 pgs: 129 active+clean; 696 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 307 B/s wr, 2 op/s 2024-09-15T23:35:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:24 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/260075586' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:25.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:24 smithi155 ceph-mon[35631]: osdmap e93: 12 total, 12 up, 12 in 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- 172.21.15.77:0/269647957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840101de0 msgr2=0x7f08401021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 --2- 172.21.15.77:0/269647957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840101de0 0x7f08401021c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0838009900 tx=0x7f083802a410 comp rx=0 tx=0).stop 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- 172.21.15.77:0/269647957 shutdown_connections 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 --2- 172.21.15.77:0/269647957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840106f10 0x7f084010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 --2- 172.21.15.77:0/269647957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f08401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 --2- 172.21.15.77:0/269647957 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840101de0 0x7f08401021c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.432 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- 172.21.15.77:0/269647957 >> 172.21.15.77:0/269647957 conn(0x7f08400fd8c0 msgr2=0x7f08400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- 172.21.15.77:0/269647957 shutdown_connections 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- 172.21.15.77:0/269647957 wait complete. 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 Processor -- start 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.429+0000 7f0846e4f640 1 -- start start 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840101de0 0x7f08401985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f0840198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f0840112010 con 0x7f0840106f10 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0840111e90 con 0x7f0840101de0 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0840112190 con 0x7f0840102790 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:54338/0 (socket says 172.21.15.77:54338) 2024-09-15T23:35:25.433 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 -- 172.21.15.77:0/1872958453 learned_addr learned my addr 172.21.15.77:0/1872958453 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0844beb640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840101de0 0x7f08401985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f083ffff640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f0840198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 -- 172.21.15.77:0/1872958453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 msgr2=0x7f0840198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f0840198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 -- 172.21.15.77:0/1872958453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840101de0 msgr2=0x7f08401985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840101de0 0x7f08401985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 -- 172.21.15.77:0/1872958453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084019d560 con 0x7f0840106f10 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f083ffff640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f0840198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f08453ec640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828011830 con 0x7f0840106f10 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0828016070 con 0x7f0840106f10 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f084019d850 con 0x7f0840106f10 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.430+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082800f2e0 con 0x7f0840106f10 2024-09-15T23:35:25.434 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.431+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08401a5130 con 0x7f0840106f10 2024-09-15T23:35:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.432+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0840102240 con 0x7f0840106f10 2024-09-15T23:35:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.433+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f08280119d0 con 0x7f0840106f10 2024-09-15T23:35:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.433+0000 7f083dffb640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 0x7f082c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:25.435 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.433+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8740+0+0 (secure 0 0 0) 0x7f08280cf240 con 0x7f0840106f10 2024-09-15T23:35:25.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.433+0000 7f0844beb640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 0x7f082c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:25.436 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.434+0000 7f0844beb640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 0x7f082c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f08380096c0 tx=0x7f0838031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:25.439 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.437+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f082809bd60 con 0x7f0840106f10 2024-09-15T23:35:25.606 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.604+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f084010a150 con 0x7f0840106f10 2024-09-15T23:35:25.957 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.954+0000 7f083dffb640 1 -- 172.21.15.77:0/1872958453 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) ==== 169+0+0 (secure 0 0 0) 0x7f082809b660 con 0x7f0840106f10 2024-09-15T23:35:25.957 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data' removed 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 msgr2=0x7f082c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 0x7f082c0a5700 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f08380096c0 tx=0x7f0838031490 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 msgr2=0x7f084019ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b8e0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 shutdown_connections 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f082c0a3240 0x7f082c0a5700 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f0840106f10 0x7f084019ce80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0840102790 0x7f0840198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 --2- 172.21.15.77:0/1872958453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0840101de0 0x7f08401985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:25.959 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 >> 172.21.15.77:0/1872958453 conn(0x7f08400fd8c0 msgr2=0x7f08400fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:25.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 shutdown_connections 2024-09-15T23:35:25.960 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:25.957+0000 7f0846e4f640 1 -- 172.21.15.77:0/1872958453 wait complete. 2024-09-15T23:35:26.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:25 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:26.274 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:25 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:26.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:25 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:26.666 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc shell --fsid 1be60238-73b9-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T23:35:26.914 INFO:teuthology.orchestra.run.smithi077.stderr:Inferring config /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/mon.a/config 2024-09-15T23:35:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:26 smithi159 ceph-mon[35472]: pgmap v468: 97 pgs: 97 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:26 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:27.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:26 smithi159 ceph-mon[35472]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:35:27.313 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:26 smithi077 ceph-mon[30968]: pgmap v468: 97 pgs: 97 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:27.313 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:26 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:27.313 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:26 smithi077 ceph-mon[30968]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:35:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:26 smithi155 ceph-mon[35631]: pgmap v468: 97 pgs: 97 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:26 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/1872958453' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:27.364 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:26 smithi155 ceph-mon[35631]: osdmap e94: 12 total, 12 up, 12 in 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 -- 172.21.15.77:0/1408263524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 msgr2=0x7f24d410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 --2- 172.21.15.77:0/1408263524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d410d950 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f24cc009cd0 tx=0x7f24cc02a8e0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 -- 172.21.15.77:0/1408263524 shutdown_connections 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 --2- 172.21.15.77:0/1408263524 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d410d950 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 --2- 172.21.15.77:0/1408263524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 --2- 172.21.15.77:0/1408263524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 0x7f24d4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 -- 172.21.15.77:0/1408263524 >> 172.21.15.77:0/1408263524 conn(0x7f24d40fc7a0 msgr2=0x7f24d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:27.422 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 -- 172.21.15.77:0/1408263524 shutdown_connections 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.396+0000 7f24d8fda640 1 -- 172.21.15.77:0/1408263524 wait complete. 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 Processor -- start 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 -- start start 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d41993f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 0x7f24d41a4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 -- --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4110f20 con 0x7f24d4101420 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f24d4110da0 con 0x7f24d4100a80 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24d8fda640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f24d41110a0 con 0x7f24d4106a80 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24cbfff640 1 --2- >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.77:3300/0 says I am v2:172.21.15.77:51796/0 (socket says 172.21.15.77:51796) 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.397+0000 7f24cbfff640 1 -- 172.21.15.77:0/2692731853 learned_addr learned my addr 172.21.15.77:0/2692731853 (peer_addr_for_me v2:172.21.15.77:0/0) 2024-09-15T23:35:27.423 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24d2d9d640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 0x7f24d41a4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24d259c640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d41993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 -- 172.21.15.77:0/2692731853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 msgr2=0x7f24d41a4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 0x7f24d41a4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 -- 172.21.15.77:0/2692731853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 msgr2=0x7f24d41993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d41993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 -- 172.21.15.77:0/2692731853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d41a49b0 con 0x7f24d4101420 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24d259c640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cbfff640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b4a0 tx=0x7f24bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc014070 con 0x7f24d4101420 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24bc010af0 con 0x7f24d4101420 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d41a4b80 con 0x7f24d4101420 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24bc017d10 con 0x7f24d4101420 2024-09-15T23:35:27.424 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.398+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d41a5090 con 0x7f24d4101420 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.399+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d4100f60 con 0x7f24d4101420 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.400+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f24bc017070 con 0x7f24d4101420 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.401+0000 7f24cb7fe640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 0x7f24c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.401+0000 7f24d259c640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 0x7f24c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.401+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8152+0+0 (secure 0 0 0) 0x7f24bc0cebe0 con 0x7f24d4101420 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.401+0000 7f24d259c640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 0x7f24c00a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009930 tx=0x7f24c4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T23:35:27.425 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.405+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188821 (secure 0 0 0) 0x7f24bc09b9a0 con 0x7f24d4101420 2024-09-15T23:35:27.573 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.572+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 --> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24d4109010 con 0x7f24d4101420 2024-09-15T23:35:27.964 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.963+0000 7f24cb7fe640 1 -- 172.21.15.77:0/2692731853 <== mon.0 v2:172.21.15.77:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v95) ==== 178+0+0 (secure 0 0 0) 0x7f24bc09b2a0 con 0x7f24d4101420 2024-09-15T23:35:27.965 INFO:teuthology.orchestra.run.smithi077.stderr:pool 'cephfs_data_ec' removed 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 msgr2=0x7f24c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 0x7f24c00a5700 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f24c4009930 tx=0x7f24c4008040 comp rx=0 tx=0).stop 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 msgr2=0x7f24d4199930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00b4a0 tx=0x7f24bc00b960 comp rx=0 tx=0).stop 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 shutdown_connections 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:6800/2029887224,v1:172.21.15.77:6801/2029887224] conn(0x7f24c00a3240 0x7f24c00a5700 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24d4106a80 0x7f24d41a4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.968 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] conn(0x7f24d4101420 0x7f24d4199930 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 --2- 172.21.15.77:0/2692731853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24d4100a80 0x7f24d41993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T23:35:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.966+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 >> 172.21.15.77:0/2692731853 conn(0x7f24d40fc7a0 msgr2=0x7f24d40fd010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T23:35:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.967+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 shutdown_connections 2024-09-15T23:35:27.969 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-15T23:35:27.967+0000 7f24d8fda640 1 -- 172.21.15.77:0/2692731853 wait complete. 2024-09-15T23:35:28.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:27 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:28.317 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:27 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:28.363 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:27 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-15T23:35:28.785 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:35:28.813 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:35:28.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:35:28.879 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-15T23:35:28.879 DEBUG:teuthology.orchestra.run.smithi077:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:35:28.895 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:35:28.913 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-15T23:35:28.935 INFO:tasks.cephadm:Stopping all daemons... 2024-09-15T23:35:28.936 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-15T23:35:28.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a 2024-09-15T23:35:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:28 smithi155 ceph-mon[35631]: pgmap v470: 33 pgs: 33 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:28 smithi155 ceph-mon[35631]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:29.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:28 smithi155 ceph-mon[35631]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:35:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:28 smithi077 ceph-mon[30968]: pgmap v470: 33 pgs: 33 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:28 smithi077 ceph-mon[30968]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:28 smithi077 ceph-mon[30968]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:35:29.133 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:28 smithi077 systemd[1]: Stopping Ceph mon.a for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:28 smithi159 ceph-mon[35472]: pgmap v470: 33 pgs: 33 active+clean; 577 KiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-15T23:35:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:28 smithi159 ceph-mon[35472]: from='client.? 172.21.15.77:0/2692731853' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-15T23:35:29.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:28 smithi159 ceph-mon[35472]: osdmap e95: 12 total, 12 up, 12 in 2024-09-15T23:35:29.583 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a[30962]: 2024-09-15T23:35:29.239+0000 7f5eb6704640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:29.583 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a[30962]: 2024-09-15T23:35:29.239+0000 7f5eb6704640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-15T23:35:29.583 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:29 smithi077 podman[95218]: 2024-09-15 23:35:29.290857479 +0000 UTC m=+0.169012222 container died 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731) 2024-09-15T23:35:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:29 smithi077 podman[95218]: 2024-09-15 23:35:29.664790239 +0000 UTC m=+0.542944982 container cleanup 2d1a8069c95d5b4501f93b8b6b1c149384f2b76daa9124693051f752e04ba03b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-15T23:35:29.883 INFO:journalctl@ceph.mon.a.smithi077.stdout:Sep 15 23:35:29 smithi077 bash[95218]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-a 2024-09-15T23:35:30.090 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.a.service' 2024-09-15T23:35:30.139 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:30.140 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-15T23:35:30.140 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-15T23:35:30.140 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.b 2024-09-15T23:35:30.481 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 systemd[1]: Stopping Ceph mon.b for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:30.798 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b[35627]: 2024-09-15T23:35:30.478+0000 7fbb2d26f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:30.799 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b[35627]: 2024-09-15T23:35:30.478+0000 7fbb2d26f640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:35:30.799 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 podman[68066]: 2024-09-15 23:35:30.51079811 +0000 UTC m=+0.164394236 container died e914e615484968cb278d5083754f1482df3eaeaef9e3c958a001d1b8e59309f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b, ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T23:35:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 podman[68066]: 2024-09-15 23:35:30.9975458 +0000 UTC m=+0.651141922 container cleanup e914e615484968cb278d5083754f1482df3eaeaef9e3c958a001d1b8e59309f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T23:35:31.114 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:30 smithi155 bash[68066]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b 2024-09-15T23:35:31.489 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 15 23:35:31 smithi155 podman[68078]: 2024-09-15 23:35:31.232585989 +0000 UTC m=+0.718110603 container remove e914e615484968cb278d5083754f1482df3eaeaef9e3c958a001d1b8e59309f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T23:35:31.493 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.b.service' 2024-09-15T23:35:31.542 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:31.543 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-15T23:35:31.543 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-15T23:35:31.543 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.c 2024-09-15T23:35:31.857 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:31 smithi159 systemd[1]: Stopping Ceph mon.c for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c[35468]: 2024-09-15T23:35:31.855+0000 7fc449557640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c[35468]: 2024-09-15T23:35:31.855+0000 7fc449557640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-15T23:35:32.215 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:32 smithi159 podman[68446]: 2024-09-15 23:35:32.100777989 +0000 UTC m=+0.360553376 container died 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:35:32.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:32 smithi159 podman[68446]: 2024-09-15 23:35:32.657087475 +0000 UTC m=+0.916862902 container cleanup 443ac49a2963713632caed30e51c91ef468498afd72f2c067d2259b2bf2b9987 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T23:35:32.715 INFO:journalctl@ceph.mon.c.smithi159.stdout:Sep 15 23:35:32 smithi159 bash[68446]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mon-c 2024-09-15T23:35:33.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mon.c.service' 2024-09-15T23:35:33.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:33.191 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-15T23:35:33.191 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-15T23:35:33.191 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x 2024-09-15T23:35:33.540 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:33 smithi077 systemd[1]: Stopping Ceph mgr.x for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:33.855 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:35:33.536+0000 7f7710824640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:33.856 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x[31198]: 2024-09-15T23:35:33.536+0000 7f7710824640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-15T23:35:33.856 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:33 smithi077 podman[95338]: 2024-09-15 23:35:33.567784418 +0000 UTC m=+0.179059586 container died 050d268db99dc5cd61e69089aeceef3ff3fdf70565ee20177799a3c4c2088796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731) 2024-09-15T23:35:34.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 podman[95338]: 2024-09-15 23:35:34.079036732 +0000 UTC m=+0.690311898 container cleanup 050d268db99dc5cd61e69089aeceef3ff3fdf70565ee20177799a3c4c2088796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-15T23:35:34.133 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 bash[95338]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x 2024-09-15T23:35:34.512 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-15T23:35:34.533 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 podman[95350]: 2024-09-15 23:35:34.281022754 +0000 UTC m=+0.710885234 container remove 050d268db99dc5cd61e69089aeceef3ff3fdf70565ee20177799a3c4c2088796 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:8921c8ef947807b717db041d85f0761b7914d5fc, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-x, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-15T23:35:34.533 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-15T23:35:34.533 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 systemd[1]: Stopped Ceph mgr.x for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:35:34.533 INFO:journalctl@ceph.mgr.x.smithi077.stdout:Sep 15 23:35:34 smithi077 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.x.service: Consumed 37.092s CPU time. 2024-09-15T23:35:34.546 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:34.546 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-15T23:35:34.546 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-15T23:35:34.546 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.y 2024-09-15T23:35:34.864 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:35:34 smithi155 systemd[1]: Stopping Ceph mgr.y for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:35.196 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:35:34 smithi155 podman[68191]: 2024-09-15 23:35:34.88193676 +0000 UTC m=+0.146387421 container died 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-15T23:35:35.530 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:35:35 smithi155 podman[68191]: 2024-09-15 23:35:35.294967971 +0000 UTC m=+0.559418632 container cleanup 068e27337b1787496e8f3a01335099cba2a9d7b69aaaae235ffb4d709dba30dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T23:35:35.530 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 15 23:35:35 smithi155 bash[68191]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-y 2024-09-15T23:35:35.666 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-15T23:35:35.700 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:35.700 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-15T23:35:35.701 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-15T23:35:35.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.z 2024-09-15T23:35:36.159 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:35 smithi159 systemd[1]: Stopping Ceph mgr.z for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:36.465 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:36 smithi159 podman[68571]: 2024-09-15 23:35:36.158653027 +0000 UTC m=+0.258083625 container died 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-15T23:35:36.899 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:36 smithi159 podman[68571]: 2024-09-15 23:35:36.58870972 +0000 UTC m=+0.688140319 container cleanup 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T23:35:36.899 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:36 smithi159 bash[68571]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z 2024-09-15T23:35:37.154 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:36 smithi159 podman[68584]: 2024-09-15 23:35:36.898382681 +0000 UTC m=+0.730705216 container remove 8267f6261036c647c5dee8e379ddbe1f4b0b2eaab3eb5bf1cae147d56c31ed2c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-15T23:35:37.154 INFO:journalctl@ceph.mgr.z.smithi159.stdout:Sep 15 23:35:36 smithi159 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-09-15T23:35:37.169 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-15T23:35:37.204 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:37.204 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-15T23:35:37.204 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-15T23:35:37.204 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.0 2024-09-15T23:35:37.509 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:37 smithi077 systemd[1]: Stopping Ceph osd.0 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:37.883 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:35:37.508+0000 7f281c40c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:37.883 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:35:37.508+0000 7f281c40c640 -1 osd.0 95 *** Got signal Terminated *** 2024-09-15T23:35:37.883 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0[45393]: 2024-09-15T23:35:37.508+0000 7f281c40c640 -1 osd.0 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:35:43.219 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:42 smithi077 podman[95460]: 2024-09-15 23:35:42.912977554 +0000 UTC m=+5.519916017 container died 26328b44314e96b791ed71b4ddb047d6fea18ab79ec6cef68655fce123d7cf2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:35:43.633 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:43 smithi077 podman[95460]: 2024-09-15 23:35:43.426161959 +0000 UTC m=+6.033100411 container cleanup 26328b44314e96b791ed71b4ddb047d6fea18ab79ec6cef68655fce123d7cf2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T23:35:43.633 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:43 smithi077 bash[95460]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0 2024-09-15T23:35:44.092 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:43 smithi077 podman[95476]: 2024-09-15 23:35:43.669629273 +0000 UTC m=+0.753551651 container remove 26328b44314e96b791ed71b4ddb047d6fea18ab79ec6cef68655fce123d7cf2a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-15T23:35:44.383 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:43.994120784 +0000 UTC m=+0.015933590 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:35:44.383 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:44.140104098 +0000 UTC m=+0.161916888 container create 7e8fb25d565a52687f61961f967c2465f5c400e57d8b33e12e10ff6187a351f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux ) 2024-09-15T23:35:44.883 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:44.424179998 +0000 UTC m=+0.445992788 container init 7e8fb25d565a52687f61961f967c2465f5c400e57d8b33e12e10ff6187a351f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-15T23:35:44.883 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:44.427956618 +0000 UTC m=+0.449769419 container start 7e8fb25d565a52687f61961f967c2465f5c400e57d8b33e12e10ff6187a351f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-15T23:35:44.884 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:44.523981694 +0000 UTC m=+0.545794485 container attach 7e8fb25d565a52687f61961f967c2465f5c400e57d8b33e12e10ff6187a351f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:35:44.884 INFO:journalctl@ceph.osd.0.smithi077.stdout:Sep 15 23:35:44 smithi077 podman[95568]: 2024-09-15 23:35:44.61353046 +0000 UTC m=+0.635343263 container died 7e8fb25d565a52687f61961f967c2465f5c400e57d8b33e12e10ff6187a351f5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:35:45.397 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.0.service' 2024-09-15T23:35:45.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:45.440 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-15T23:35:45.441 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-15T23:35:45.441 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.1 2024-09-15T23:35:45.767 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:45 smithi155 systemd[1]: Stopping Ceph osd.1 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:46.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:35:45.765+0000 7f9dbe154640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:46.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:35:45.765+0000 7f9dbe154640 -1 osd.1 95 *** Got signal Terminated *** 2024-09-15T23:35:46.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1[40080]: 2024-09-15T23:35:45.765+0000 7f9dbe154640 -1 osd.1 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:35:51.518 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:51 smithi155 podman[68316]: 2024-09-15 23:35:51.212830715 +0000 UTC m=+5.578679370 container died 3e051f21ee017cddc3d920e86985c81bcc1a589840e410972963a7d01eb53f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T23:35:51.864 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:51 smithi155 podman[68316]: 2024-09-15 23:35:51.624850617 +0000 UTC m=+5.990699269 container cleanup 3e051f21ee017cddc3d920e86985c81bcc1a589840e410972963a7d01eb53f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T23:35:51.864 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:51 smithi155 bash[68316]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1 2024-09-15T23:35:52.364 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:51 smithi155 podman[68331]: 2024-09-15 23:35:51.893130489 +0000 UTC m=+0.682042986 container remove 3e051f21ee017cddc3d920e86985c81bcc1a589840e410972963a7d01eb53f17 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:35:52.697 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.292337601 +0000 UTC m=+0.016051076 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:35:52.698 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.427503601 +0000 UTC m=+0.151217105 container create eb973c3d6c764a996679b2635d20703f029964ed8f9ed9b72fd364388137a8e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T23:35:53.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.697058231 +0000 UTC m=+0.420771700 container init eb973c3d6c764a996679b2635d20703f029964ed8f9ed9b72fd364388137a8e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-15T23:35:53.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.700860879 +0000 UTC m=+0.424574350 container start eb973c3d6c764a996679b2635d20703f029964ed8f9ed9b72fd364388137a8e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:35:53.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.79688571 +0000 UTC m=+0.520599173 container attach eb973c3d6c764a996679b2635d20703f029964ed8f9ed9b72fd364388137a8e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=) 2024-09-15T23:35:53.114 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 15 23:35:52 smithi155 podman[68421]: 2024-09-15 23:35:52.890903379 +0000 UTC m=+0.614616851 container died eb973c3d6c764a996679b2635d20703f029964ed8f9ed9b72fd364388137a8e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:35:53.550 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.1.service' 2024-09-15T23:35:53.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:35:53.591 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-15T23:35:53.591 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-15T23:35:53.591 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.2 2024-09-15T23:35:53.901 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:53 smithi159 systemd[1]: Stopping Ceph osd.2 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:35:54.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:35:53.899+0000 7f9a51f69640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:35:54.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:35:53.899+0000 7f9a51f69640 -1 osd.2 95 *** Got signal Terminated *** 2024-09-15T23:35:54.215 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2[40448]: 2024-09-15T23:35:53.899+0000 7f9a51f69640 -1 osd.2 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:35:59.654 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:59 smithi159 podman[68695]: 2024-09-15 23:35:59.358561288 +0000 UTC m=+5.576764671 container died 2fb8c0e14a50bc6a23682c7af2cd180f60d82834392aa3a7607b8830067f45a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:35:59.965 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:59 smithi159 podman[68695]: 2024-09-15 23:35:59.751033883 +0000 UTC m=+5.969237267 container cleanup 2fb8c0e14a50bc6a23682c7af2cd180f60d82834392aa3a7607b8830067f45a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T23:35:59.965 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:35:59 smithi159 bash[68695]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2 2024-09-15T23:36:00.368 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68722]: 2024-09-15 23:36:00.019396687 +0000 UTC m=+0.658494339 container remove 2fb8c0e14a50bc6a23682c7af2cd180f60d82834392aa3a7607b8830067f45a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:36:00.682 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.270668444 +0000 UTC m=+0.016107585 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:00.683 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.41242096 +0000 UTC m=+0.157860088 container create 7b0c28e14c840b97424ae821cbfd3fb1a6ae8f5932eb735ee3e07ab6fc583473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e) 2024-09-15T23:36:00.683 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.68231912 +0000 UTC m=+0.427758247 container init 7b0c28e14c840b97424ae821cbfd3fb1a6ae8f5932eb735ee3e07ab6fc583473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-15T23:36:00.965 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.685818727 +0000 UTC m=+0.431257870 container start 7b0c28e14c840b97424ae821cbfd3fb1a6ae8f5932eb735ee3e07ab6fc583473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2) 2024-09-15T23:36:00.965 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.765506031 +0000 UTC m=+0.510945180 container attach 7b0c28e14c840b97424ae821cbfd3fb1a6ae8f5932eb735ee3e07ab6fc583473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-15T23:36:00.965 INFO:journalctl@ceph.osd.2.smithi159.stdout:Sep 15 23:36:00 smithi159 podman[68810]: 2024-09-15 23:36:00.872790182 +0000 UTC m=+0.618229322 container died 7b0c28e14c840b97424ae821cbfd3fb1a6ae8f5932eb735ee3e07ab6fc583473 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:01.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.2.service' 2024-09-15T23:36:01.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:01.636 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-15T23:36:01.636 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-15T23:36:01.636 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.3 2024-09-15T23:36:01.941 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:01 smithi077 systemd[1]: Stopping Ceph osd.3 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:02.383 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:01.939+0000 7f9734560640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:02.383 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:01.939+0000 7f9734560640 -1 osd.3 95 *** Got signal Terminated *** 2024-09-15T23:36:02.383 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:01 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:01.939+0000 7f9734560640 -1 osd.3 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:03.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:03 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:03.563+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:04.383 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:04 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:04.298+0000 7f972cb6e640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.679171+0000 front 2024-09-15T23:35:41.679147+0000 (oldest deadline 2024-09-15T23:36:03.379354+0000) 2024-09-15T23:36:04.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:04 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:04.601+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:05.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:04.814+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:05.633 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:05 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:05.250+0000 7f972cb6e640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.679171+0000 front 2024-09-15T23:35:41.679147+0000 (oldest deadline 2024-09-15T23:36:03.379354+0000) 2024-09-15T23:36:05.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:05 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:05.339+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:05.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:05.356+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:05.863 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:05 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:05.612+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:06.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:05.778+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:06.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:06 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:06.316+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:06.633 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:06 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3[52275]: 2024-09-15T23:36:06.204+0000 7f972cb6e640 -1 osd.3 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.679171+0000 front 2024-09-15T23:35:41.679147+0000 (oldest deadline 2024-09-15T23:36:03.379354+0000) 2024-09-15T23:36:06.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:06.308+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:06.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:06 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:06.581+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:07.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:06.744+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:07.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:07 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:07.339+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:07.633 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:07 smithi077 podman[95672]: 2024-09-15 23:36:07.391722761 +0000 UTC m=+5.563537736 container died 15fe49ed4d9c7fc495813e8bec6d045ba06027a1e797774f5d450833f3f81cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-15T23:36:07.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:07.260+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:07.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:07 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:07.545+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:08.133 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:07 smithi077 podman[95672]: 2024-09-15 23:36:07.923322584 +0000 UTC m=+6.095137561 container cleanup 15fe49ed4d9c7fc495813e8bec6d045ba06027a1e797774f5d450833f3f81cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:08.133 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:07 smithi077 bash[95672]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3 2024-09-15T23:36:08.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:07.714+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:08.591 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:08 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:08.327+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:08.592 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95700]: 2024-09-15 23:36:08.155728627 +0000 UTC m=+0.764876714 container remove 15fe49ed4d9c7fc495813e8bec6d045ba06027a1e797774f5d450833f3f81cf4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0) 2024-09-15T23:36:08.714 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:08.235+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:08.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:08 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:08.516+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:08.883 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95790]: 2024-09-15 23:36:08.493997374 +0000 UTC m=+0.015915117 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:08.883 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95790]: 2024-09-15 23:36:08.63421689 +0000 UTC m=+0.156134619 container create 1ca903a1161920ebb2a3638a72b636f9cf6c3b1db2aa3a5e55799120970870e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:08.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:08.713+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:09.309 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95790]: 2024-09-15 23:36:08.911781632 +0000 UTC m=+0.433699361 container init 1ca903a1161920ebb2a3638a72b636f9cf6c3b1db2aa3a5e55799120970870e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-15T23:36:09.309 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95790]: 2024-09-15 23:36:08.915096486 +0000 UTC m=+0.437014221 container start 1ca903a1161920ebb2a3638a72b636f9cf6c3b1db2aa3a5e55799120970870e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T23:36:09.309 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:08 smithi077 podman[95790]: 2024-09-15 23:36:08.986688076 +0000 UTC m=+0.508605807 container attach 1ca903a1161920ebb2a3638a72b636f9cf6c3b1db2aa3a5e55799120970870e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:09.309 INFO:journalctl@ceph.osd.3.smithi077.stdout:Sep 15 23:36:09 smithi077 podman[95790]: 2024-09-15 23:36:09.106334702 +0000 UTC m=+0.628252448 container died 1ca903a1161920ebb2a3638a72b636f9cf6c3b1db2aa3a5e55799120970870e1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:09.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:09 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:09.307+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:09.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:09.259+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:09.826 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.3.service' 2024-09-15T23:36:09.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:09 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:09.555+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:09.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:09.865 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-15T23:36:09.865 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-15T23:36:09.865 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.4 2024-09-15T23:36:10.187 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:09 smithi155 systemd[1]: Stopping Ceph osd.4 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:10.214 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:09.716+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:10.590 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:10 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:36:10.185+0000 7f6fe82f7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:10.590 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:10 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:36:10.185+0000 7f6fe82f7640 -1 osd.4 95 *** Got signal Terminated *** 2024-09-15T23:36:10.590 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:10 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:36:10.185+0000 7f6fe82f7640 -1 osd.4 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:10.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:10 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:10.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:10.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:10.251+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:10.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:10 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:10.588+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:11.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:10.746+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:11.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:11 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:11.272+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:11.644 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:11 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:11.295+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:11.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:11 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:11.576+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:11.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:11 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:11.731+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:12.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:12.296+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:12.689 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:12 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:12.309+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:12.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:12 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:12.584+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:12.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:12 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:12.688+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:12.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:12 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:12.688+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:12.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:12 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:12.911+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:13.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:12 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:12.760+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:13.596 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:13.257+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:13.596 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:13.257+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:13.690 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:13 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:13.344+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:13.690 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:13 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:13.344+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:13.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:13 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:13.587+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:13.864 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:13 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:36:13.557+0000 7f6fe0905640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.039014+0000 front 2024-09-15T23:35:49.039038+0000 (oldest deadline 2024-09-15T23:36:13.139061+0000) 2024-09-15T23:36:13.883 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:13.712+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:13.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:13 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:13.689+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:13.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:13 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:13.689+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:13.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:13 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:13.867+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:14.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:14.241+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:14.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:14.241+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:14.704 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:14 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:14.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:14.704 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:14 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:14.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:14.864 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:14 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4[46985]: 2024-09-15T23:36:14.564+0000 7f6fe0905640 -1 osd.4 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.039014+0000 front 2024-09-15T23:35:49.039038+0000 (oldest deadline 2024-09-15T23:36:13.139061+0000) 2024-09-15T23:36:14.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:14 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:14.586+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:14.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:14 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:14.845+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:14.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:14 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:14.703+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:14.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:14 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:14.703+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:15.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:14 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:14.728+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:15.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:15.194+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:15.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:15.194+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:15.664 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:15 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:15.298+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:15.664 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:15 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:15.298+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:15.864 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:15 smithi155 podman[68535]: 2024-09-15 23:36:15.567153083 +0000 UTC m=+5.507358023 container died c8945bdb197b093433359a264b47e74de35af67a9f38368d6904c240daa32198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-09-15T23:36:15.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:15 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:15.589+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:15.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:15 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:15.589+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:15.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:15 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:15.880+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:15.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:15 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:15.663+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:15.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:15 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:15.663+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:16.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:15 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:15.769+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:16.239 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:15 smithi155 podman[68535]: 2024-09-15 23:36:15.995152386 +0000 UTC m=+5.935357315 container cleanup c8945bdb197b093433359a264b47e74de35af67a9f38368d6904c240daa32198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T23:36:16.239 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:15 smithi155 bash[68535]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4 2024-09-15T23:36:16.614 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:16 smithi155 podman[68552]: 2024-09-15 23:36:16.238508068 +0000 UTC m=+0.666035834 container remove c8945bdb197b093433359a264b47e74de35af67a9f38368d6904c240daa32198 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4, ceph=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-15T23:36:16.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:16 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:16.173+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:16.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:16 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:16.173+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:16.712 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:16 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:16.278+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:16.712 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:16 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:16.278+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:16.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:16 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:16.852+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:16.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:16 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:16.711+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:16.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:16 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:16.711+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:16.975 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:16 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:16.646+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:16.975 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:16 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:16.612+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:16.976 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:16 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:16.612+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:16.976 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:16 smithi155 podman[68643]: 2024-09-15 23:36:16.568983752 +0000 UTC m=+0.015836213 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:16.976 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:16 smithi155 podman[68643]: 2024-09-15 23:36:16.689348966 +0000 UTC m=+0.136201462 container create 75ab115a8fb19a431f2764b927ed3dd029812724ca0240ca915b09131c8811f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-15T23:36:16.976 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:16 smithi155 podman[68643]: 2024-09-15 23:36:16.97535945 +0000 UTC m=+0.422211903 container init 75ab115a8fb19a431f2764b927ed3dd029812724ca0240ca915b09131c8811f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-15T23:36:17.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:16 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:16.764+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:17.364 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:16 smithi155 podman[68643]: 2024-09-15 23:36:16.978625028 +0000 UTC m=+0.425477494 container start 75ab115a8fb19a431f2764b927ed3dd029812724ca0240ca915b09131c8811f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:36:17.364 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:17 smithi155 podman[68643]: 2024-09-15 23:36:17.075501786 +0000 UTC m=+0.522354248 container attach 75ab115a8fb19a431f2764b927ed3dd029812724ca0240ca915b09131c8811f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-15T23:36:17.364 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 15 23:36:17 smithi155 podman[68643]: 2024-09-15 23:36:17.169244406 +0000 UTC m=+0.616096876 container died 75ab115a8fb19a431f2764b927ed3dd029812724ca0240ca915b09131c8811f7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T23:36:17.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:17.154+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:17.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:17.154+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:17.702 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:17 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:17.229+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:17.703 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:17 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:17.229+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:17.838 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:17 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:17.667+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:17.838 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:17 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:17.604+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:17.839 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:17 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:17.604+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:17.868 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.4.service' 2024-09-15T23:36:17.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:17.913 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-15T23:36:17.914 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-15T23:36:17.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.5 2024-09-15T23:36:17.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:17 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:17.827+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:17.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:17 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:17.702+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:17.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:17 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:17.702+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:18.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:17 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:17.740+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:18.240 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:17 smithi159 systemd[1]: Stopping Ceph osd.5 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:18.240 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:18.181+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:18.240 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:18.181+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:18.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:18 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:18.163+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:18.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:18 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:18.163+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:18.660 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:18.238+0000 7fe542b2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:18.660 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:18.238+0000 7fe542b2b640 -1 osd.5 95 *** Got signal Terminated *** 2024-09-15T23:36:18.660 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:18.238+0000 7fe542b2b640 -1 osd.5 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:18.660 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:18.658+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:18.660 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:18.658+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:18.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:18 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:18.654+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:18.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:18 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:18.563+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:18.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:18 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:18.563+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:18.965 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:18 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:18.863+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:19.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:18 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:18.709+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:19.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:19.141+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:19.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:19.141+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:19.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:19 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:19.144+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:19.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:19 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:19.144+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:19.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:19 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:19.672+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:19.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:19 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:19.581+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:19.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:19 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:19.581+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:19.906 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:19.621+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:19.906 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:19.621+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:20.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:19 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:19.732+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:20.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:19.904+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:20.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:19 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:19.904+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:20.215 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:20.102+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:20.216 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:20.102+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:20.216 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:20.102+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:20.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:20 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:20.157+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:20.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:20 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:20.157+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:20.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:20 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:20.652+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:20.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:20 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:20.584+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:20.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:20 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:20.584+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:20.954 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:20.585+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:20.954 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:20.585+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:21.123 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:20 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:20.716+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:21.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:20.953+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:21.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:20 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:20.953+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:21.215 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:21.150+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:21.215 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:21.150+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:21.216 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:21.150+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:21.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:21 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:21.122+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:21.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:21 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:21.122+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:21.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:21 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:21.122+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:21.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:21.578+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:21.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:21.578+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:22.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:21 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:21.652+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:22.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:21 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:21.632+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:22.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:21 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:21.632+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:22.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:21 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:21.632+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:22.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:21 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:21.725+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:22.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:21.977+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:22.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:21 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:21.977+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:22.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:22.127+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:22.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:22.127+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:22.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:22.127+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:22.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:22 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:22.145+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:22.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:22 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:22.145+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:22.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:22 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:22.145+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:22.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:22 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:22.669+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:22.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:22 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:22.599+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:22.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:22 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:22.599+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:22.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:22 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:22.599+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:22.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:22.536+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.113398+0000 front 2024-09-15T23:35:41.113459+0000 (oldest deadline 2024-09-15T23:36:04.013481+0000) 2024-09-15T23:36:22.965 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5[46909]: 2024-09-15T23:36:22.536+0000 7fe53b139640 -1 osd.5 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.115697+0000 front 2024-09-15T23:35:49.115505+0000 (oldest deadline 2024-09-15T23:36:12.015511+0000) 2024-09-15T23:36:23.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:22 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:22.718+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:23.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:22.994+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:23.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:22 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:22.994+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:23.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:23 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:23.146+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:23.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:23 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:23.146+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:23.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:23 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:23.146+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:23.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:23.166+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:23.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:23.166+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:23.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:23.166+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:23.742 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:23 smithi159 podman[68913]: 2024-09-15 23:36:23.669433891 +0000 UTC m=+5.551331055 container died d8b19189e3425ec1626c02745ac9990a8a289e5f6bd6e3202a3a07e32f73a39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-15T23:36:24.036 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:23.711+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:24.037 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:23.711+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:24.037 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:23.637+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:24.037 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:23.637+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:24.037 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:23 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:23.637+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:24.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:23.669+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:24.013+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:24.013+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:24.155+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:24.155+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:24.155+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:24.325 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[68913]: 2024-09-15 23:36:24.081182016 +0000 UTC m=+5.963079170 container cleanup d8b19189e3425ec1626c02745ac9990a8a289e5f6bd6e3202a3a07e32f73a39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:36:24.326 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 bash[68913]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5 2024-09-15T23:36:24.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:24 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:24.187+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:24.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:24 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:24.187+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:24.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:24 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:24.187+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:24.655 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[68929]: 2024-09-15 23:36:24.324455226 +0000 UTC m=+0.653760403 container remove d8b19189e3425ec1626c02745ac9990a8a289e5f6bd6e3202a3a07e32f73a39f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:36:24.953 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[69027]: 2024-09-15 23:36:24.557753888 +0000 UTC m=+0.016709814 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:24.953 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[69027]: 2024-09-15 23:36:24.692454193 +0000 UTC m=+0.151410112 container create 4b958ac8a9b3d1237a272536a529055f7d6e78b82156200b2408c9e61a181c95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:36:24.954 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[69027]: 2024-09-15 23:36:24.953381248 +0000 UTC m=+0.412337158 container init 4b958ac8a9b3d1237a272536a529055f7d6e78b82156200b2408c9e61a181c95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-15T23:36:24.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:24 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:24.683+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:24.987 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:24 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:24.683+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:24 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:24.642+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:24.987 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:24 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:24.642+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:24.988 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:24 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:24.642+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:25.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:24 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:24.656+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:25.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:24 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:24.656+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:25.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:24 smithi159 podman[69027]: 2024-09-15 23:36:24.956793673 +0000 UTC m=+0.415749594 container start 4b958ac8a9b3d1237a272536a529055f7d6e78b82156200b2408c9e61a181c95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-15T23:36:25.215 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:25 smithi159 podman[69027]: 2024-09-15 23:36:25.061970765 +0000 UTC m=+0.520926700 container attach 4b958ac8a9b3d1237a272536a529055f7d6e78b82156200b2408c9e61a181c95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-8921c8e) 2024-09-15T23:36:25.216 INFO:journalctl@ceph.osd.5.smithi159.stdout:Sep 15 23:36:25 smithi159 podman[69027]: 2024-09-15 23:36:25.14920075 +0000 UTC m=+0.608156671 container died 4b958ac8a9b3d1237a272536a529055f7d6e78b82156200b2408c9e61a181c95 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-15T23:36:25.216 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:24.978+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:25.216 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:24 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:24.978+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:25.216 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:25 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:25.184+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:25.216 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:25 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:25.184+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:25.217 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:25 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:25.184+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:25.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:25 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:25.225+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:25.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:25 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:25.225+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:25.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:25 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:25.225+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:25.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.5.service' 2024-09-15T23:36:25.897 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:25.897 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-15T23:36:25.897 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-15T23:36:25.897 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.6 2024-09-15T23:36:26.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:25 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:25.709+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:26.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:25 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:25.709+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:26.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:25 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:25.625+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:26.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:25 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:25.625+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:26.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:25 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:25.625+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:26.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:25 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:25.694+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:26.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:25 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:25.694+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:26.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:25 smithi077 systemd[1]: Stopping Ceph osd.6 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:26.178 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:25 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:25.995+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:26.178 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:25 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:25.995+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:26.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:26 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:26.178+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:26.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:26 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:26.178+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:26.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:26 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:26.178+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:26.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:26.218+0000 7f18beeec640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:26.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:26.218+0000 7f18beeec640 -1 osd.6 95 *** Got signal Terminated *** 2024-09-15T23:36:26.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:26.218+0000 7f18beeec640 -1 osd.6 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:26.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:26.240+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:26.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:26.240+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:26.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:26.240+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:27.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:26 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:26.681+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:27.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:26 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:26.681+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:27.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:26 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:26.626+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:27.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:26 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:26.626+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:27.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:26 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:26.626+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:27.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:26.731+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:27.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:26 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:26.731+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:27.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:26 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:26.967+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:27.465 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:26 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:26.967+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:27.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:27 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:27.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:27.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:27 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:27.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:27.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:27 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:27.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:27.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:27 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:27.263+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:27.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:27 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:27.263+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:27.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:27 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:27.263+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:27.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:27 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:27.651+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:27.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:27 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:27.651+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:27.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:27 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:27.603+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:27.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:27 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:27.603+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:27.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:27 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:27.603+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:28.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:27 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:27.755+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:28.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:27 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:27.755+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:28.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:27 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:27.948+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:28.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:27 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:27.949+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:28.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:28.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:28.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:28.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:28.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:28.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:28.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:28.248+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:28.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:28.248+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:28.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:28.248+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:28.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:28.695+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:28.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:28.695+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:28.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:28.695+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:28.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:28.582+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:28.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:28.582+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:28.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:28 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:28.582+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:29.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:28.708+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:29.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:28.708+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:29.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:28.708+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.985220+0000 front 2024-09-15T23:36:03.985167+0000 (oldest deadline 2024-09-15T23:36:28.685242+0000) 2024-09-15T23:36:29.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:28.935+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:29.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:28.935+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:29.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:28 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:28.935+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:29.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:29.213+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:29.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:29.213+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:29.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:29.213+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:29.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:29.213+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:29.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:29.290+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:29.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:29.290+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:29.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:29.290+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:29.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:29.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:29.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:29.593+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:29.593+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:29.593+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:29.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:29 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:29.593+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:30.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:29.755+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:30.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:29.755+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:30.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:29 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:29.755+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.985220+0000 front 2024-09-15T23:36:03.985167+0000 (oldest deadline 2024-09-15T23:36:28.685242+0000) 2024-09-15T23:36:30.315 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:29.979+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:30.316 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:29.979+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:30.316 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:29 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:29.979+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:30.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:30.169+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:30.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:30.169+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:30.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:30.169+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:30.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:30.169+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:30.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:30 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:30.314+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:30.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:30 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:30.314+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:30.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:30 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:30.314+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:30.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:30.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:30.728+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:30.549+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:30.549+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:30.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:30.549+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:30.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:30 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:30.549+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:31.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:30.750+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:46.383324+0000 front 2024-09-15T23:35:46.383462+0000 (oldest deadline 2024-09-15T23:36:12.283361+0000) 2024-09-15T23:36:31.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:30.750+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.384423+0000 front 2024-09-15T23:35:56.384396+0000 (oldest deadline 2024-09-15T23:36:23.984886+0000) 2024-09-15T23:36:31.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:30 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6[58777]: 2024-09-15T23:36:30.750+0000 7f18b74fa640 -1 osd.6 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.985220+0000 front 2024-09-15T23:36:03.985167+0000 (oldest deadline 2024-09-15T23:36:28.685242+0000) 2024-09-15T23:36:31.279 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.016+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:31.279 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.016+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:31.279 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.016+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:31.408 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:31.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:31.408 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:31.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:31.408 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:31.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:31.408 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:31 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:31.219+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:31.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:31.278+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:31.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:31.278+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:31.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:31.278+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:31.564+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:31.564+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:31.564+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:31.564+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:31.710+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:31.710+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:31.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:31 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:31.710+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:32.133 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:31 smithi077 podman[95891]: 2024-09-15 23:36:31.779032772 +0000 UTC m=+5.689772939 container died 5618ce7e33addddf4156c1f4209c4e79fe7a71b929e6f122230f459da8dbbf3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True) 2024-09-15T23:36:32.310 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.999+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:32.310 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.999+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:32.310 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:31 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:31.999+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:32.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:32 smithi077 podman[95891]: 2024-09-15 23:36:32.235409213 +0000 UTC m=+6.146149372 container cleanup 5618ce7e33addddf4156c1f4209c4e79fe7a71b929e6f122230f459da8dbbf3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-15T23:36:32.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:32 smithi077 bash[95891]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6 2024-09-15T23:36:32.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:32 smithi077 podman[95916]: 2024-09-15 23:36:32.470413526 +0000 UTC m=+0.694740150 container remove 5618ce7e33addddf4156c1f4209c4e79fe7a71b929e6f122230f459da8dbbf3e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-8921c8e, ceph=True) 2024-09-15T23:36:32.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:32 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:32.247+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:32.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:32 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:32.247+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:32.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:32 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:32.247+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:32.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:32 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:32.247+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:32.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:32.309+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:32.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:32.309+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:32.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:32.309+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:32.750+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:32.750+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:32.750+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:32.557+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:32.557+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:32.557+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:32.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:32 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:32.557+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:33.216 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:32 smithi077 podman[96007]: 2024-09-15 23:36:32.790099776 +0000 UTC m=+0.015795152 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:33.216 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:32 smithi077 podman[96007]: 2024-09-15 23:36:32.904693416 +0000 UTC m=+0.130388844 container create f6b7f307f82de8bba68900c9e757fc2f25b978435d29e5e6f36f4eb8a95a49d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-15T23:36:33.216 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:33 smithi077 podman[96007]: 2024-09-15 23:36:33.106893001 +0000 UTC m=+0.332588369 container init f6b7f307f82de8bba68900c9e757fc2f25b978435d29e5e6f36f4eb8a95a49d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-15T23:36:33.216 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:33 smithi077 podman[96007]: 2024-09-15 23:36:33.110368331 +0000 UTC m=+0.336063703 container start f6b7f307f82de8bba68900c9e757fc2f25b978435d29e5e6f36f4eb8a95a49d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-15T23:36:33.216 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:33 smithi077 podman[96007]: 2024-09-15 23:36:33.215275523 +0000 UTC m=+0.440970893 container attach f6b7f307f82de8bba68900c9e757fc2f25b978435d29e5e6f36f4eb8a95a49d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T23:36:33.307 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:32.994+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:33.308 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:32.994+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:33.308 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:32 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:32.994+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:33.633 INFO:journalctl@ceph.osd.6.smithi077.stdout:Sep 15 23:36:33 smithi077 podman[96007]: 2024-09-15 23:36:33.302172944 +0000 UTC m=+0.527868313 container died f6b7f307f82de8bba68900c9e757fc2f25b978435d29e5e6f36f4eb8a95a49d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, io.buildah.version=1.37.2) 2024-09-15T23:36:33.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:33.223+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:33.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:33.223+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:33.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:33.223+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:33.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:33 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:33.223+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:33.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:33.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:33.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:33.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:33.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:33.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:33.789 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:33.530+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:33.789 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:33.530+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:33.789 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:33.530+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:33.789 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:33.530+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:34.069 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.6.service' 2024-09-15T23:36:34.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:34.111 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-15T23:36:34.112 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-15T23:36:34.112 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.7 2024-09-15T23:36:34.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:33.787+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:34.115 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:33.787+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:34.115 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:33 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:33.787+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:34.355 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:33.989+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:34.356 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:33.989+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:34.356 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:33 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:33.989+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:34.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:34.236+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:34.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:34.236+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:34.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:34.236+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:34.383 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:34 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:34.236+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:34.433 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 systemd[1]: Stopping Ceph osd.7 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:34.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:34.354+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:34.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:34.354+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:34.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:34.354+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.432+0000 7f74f5b63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.432+0000 7f74f5b63640 -1 osd.7 95 *** Got signal Terminated *** 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.432+0000 7f74f5b63640 -1 osd.7 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:34.551+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:34.551+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:34.551+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:34.794 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:34.551+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:35.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.793+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:35.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.793+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:35.055 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:34 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:34.793+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:35.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:34.990+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:35.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:34.990+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:35.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:34 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:34.990+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:35.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:35 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:35.250+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:35.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:35 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:35.250+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:35.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:35 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:35.250+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:35.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:35 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:35.250+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:35.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:35.323+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:35.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:35.323+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:35.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:35.323+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:35.784 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:35.512+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:35.784 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:35.512+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:35.784 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:35.512+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:35.784 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:35.512+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:36.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:35.783+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:36.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:35.783+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:36.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:35 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:35.783+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:36.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:35.951+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:36.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:35.951+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:36.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:35 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:35.951+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:36.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:36 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:36.286+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:36.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:36 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:36.286+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:36.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:36 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:36.286+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:36.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:36 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:36.286+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:36.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:36.283+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:36.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:36.283+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:36.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:36.283+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:36.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:36.283+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:36.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:36.743+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:36.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:36.743+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:36.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:36.743+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:36.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:36.561+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:36.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:36.561+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:36.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:36.561+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:36.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:36.561+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:37.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:36.926+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:37.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:36.926+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:37.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:36.926+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:37.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:36 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:36.926+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:37.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:37.297+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:37.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:37.297+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:37.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:37.297+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:37.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:37 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:37.297+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:37.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:37.277+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:37.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:37.277+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:37.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:37.277+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:37.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:37.277+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:37.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:37.782+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:37.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:37.782+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:37.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:37.782+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:37.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:37.577+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:37.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:37.577+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:37.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:37.577+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:37.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:37 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:37.577+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:38.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:37.936+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:38.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:37.936+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:38.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:37.936+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:38.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:37 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:37.936+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:38.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:38 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:38.289+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:38.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:38 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:38.289+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:38.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:38 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:38.289+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:38.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:38 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:38.289+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:38.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:38 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:38.289+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:38.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:38.267+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:38.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:38.267+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:38.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:38.267+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:38.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:38.267+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:38.799 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:38.532+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:38.799 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:38.532+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:38.799 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:38.532+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:38.799 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:38.532+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:39.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:38.798+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:49.782056+0000 front 2024-09-15T23:35:49.782111+0000 (oldest deadline 2024-09-15T23:36:15.682200+0000) 2024-09-15T23:36:39.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:38.798+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.583241+0000 front 2024-09-15T23:35:58.583203+0000 (oldest deadline 2024-09-15T23:36:23.183665+0000) 2024-09-15T23:36:39.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:38.798+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:03.184067+0000 front 2024-09-15T23:36:03.184222+0000 (oldest deadline 2024-09-15T23:36:28.484119+0000) 2024-09-15T23:36:39.114 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7[53511]: 2024-09-15T23:36:38.798+0000 7f74ee171640 -1 osd.7 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.285237+0000 front 2024-09-15T23:36:14.285272+0000 (oldest deadline 2024-09-15T23:36:38.385459+0000) 2024-09-15T23:36:39.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:38.905+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:39.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:38.905+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:39.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:38.905+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:39.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:38 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:38.905+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:39.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:39 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:39.260+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:39.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:39 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:39.260+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:39.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:39 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:39.260+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:39.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:39 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:39.260+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:39.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:39 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:39.260+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:39.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:39.274+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:39.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:39.274+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:39.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:39.274+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:39.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:39.274+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:39.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:39.538+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:39.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:39.538+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:39.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:39.538+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:39.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:39.538+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:39.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:39 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:39.538+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:40.208 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:39 smithi155 podman[68757]: 2024-09-15 23:36:39.917773721 +0000 UTC m=+5.609002970 container died 3b6fd7b44141913bda674265fd9c5150f088c42a03f28f169ac2c3cc699cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-15T23:36:40.214 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:39.907+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:40.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:39.907+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:40.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:39.907+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:40.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:39 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:39.907+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:40.525 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:40 smithi155 podman[68757]: 2024-09-15 23:36:40.306960851 +0000 UTC m=+5.998190094 container cleanup 3b6fd7b44141913bda674265fd9c5150f088c42a03f28f169ac2c3cc699cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T23:36:40.525 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:40 smithi155 bash[68757]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7 2024-09-15T23:36:40.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:40 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:40.268+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:40.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:40 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:40.268+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:40.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:40 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:40.268+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:40.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:40 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:40.268+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:40.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:40 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:40.268+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:40.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:40.299+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:40.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:40.299+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:40.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:40.299+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:40.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:40.299+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:40.864 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:40 smithi155 podman[68775]: 2024-09-15 23:36:40.583413513 +0000 UTC m=+0.663506056 container remove 3b6fd7b44141913bda674265fd9c5150f088c42a03f28f169ac2c3cc699cd4e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-15T23:36:40.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:40 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:40.524+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:40.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:40 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:40.524+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:40.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:40 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:40.524+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:40.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:40 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:40.524+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:40.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:40 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:40.524+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:41.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:40.895+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:41.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:40.895+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:41.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:40.895+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:41.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:40 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:40.895+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:41.220 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:40 smithi155 podman[68864]: 2024-09-15 23:36:40.797181485 +0000 UTC m=+0.015943312 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:41.220 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:40 smithi155 podman[68864]: 2024-09-15 23:36:40.900766697 +0000 UTC m=+0.119528521 container create c50a13d0798216a63ab127b08a5c4cd1fe0e8d71e1939bd5e51fb6972df231f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:36:41.220 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:41 smithi155 podman[68864]: 2024-09-15 23:36:41.128513469 +0000 UTC m=+0.347275288 container init c50a13d0798216a63ab127b08a5c4cd1fe0e8d71e1939bd5e51fb6972df231f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-15T23:36:41.220 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:41 smithi155 podman[68864]: 2024-09-15 23:36:41.131776206 +0000 UTC m=+0.350538040 container start c50a13d0798216a63ab127b08a5c4cd1fe0e8d71e1939bd5e51fb6972df231f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:36:41.220 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:41 smithi155 podman[68864]: 2024-09-15 23:36:41.220134524 +0000 UTC m=+0.438896356 container attach c50a13d0798216a63ab127b08a5c4cd1fe0e8d71e1939bd5e51fb6972df231f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-15T23:36:41.501 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 15 23:36:41 smithi155 podman[68864]: 2024-09-15 23:36:41.327517979 +0000 UTC m=+0.546279801 container died c50a13d0798216a63ab127b08a5c4cd1fe0e8d71e1939bd5e51fb6972df231f6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-15T23:36:41.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:41 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:41.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:41.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:41 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:41.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:41.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:41 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:41.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:41.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:41 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:41.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:41.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:41 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:41.293+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:41.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:41.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:41.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:41.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:41.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:41.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:41.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:41.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:41.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:41 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:41.500+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:41.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:41 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:41.500+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:41.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:41 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:41.500+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:41.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:41 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:41.500+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:41.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:41 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:41.500+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:42.027 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.7.service' 2024-09-15T23:36:42.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:42.068 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-15T23:36:42.068 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-15T23:36:42.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.8 2024-09-15T23:36:42.115 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:41.852+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:42.115 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:41.852+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:42.115 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:41.852+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:42.115 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:41 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:41.852+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:42.428 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 systemd[1]: Stopping Ceph osd.8 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:42.429 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:42.253+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:42.429 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:42.253+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:42.429 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:42.253+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:42.429 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:42.253+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:42.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:42.521+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:42.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:42.521+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:42.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:42.521+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:42.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:42.521+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:42.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:42.521+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:42.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:42 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:42.341+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:42.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:42 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:42.341+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:42.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:42 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:42.341+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:42.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:42 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:42.341+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:42.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:42 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:42.341+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:42.715 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.427+0000 7f4de254f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:42.715 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.427+0000 7f4de254f640 -1 osd.8 95 *** Got signal Terminated *** 2024-09-15T23:36:42.715 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.427+0000 7f4de254f640 -1 osd.8 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:43.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.882+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:43.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.882+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:43.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.882+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:43.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:42 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:42.882+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:43.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:43 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:43.369+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:43.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:43 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:43.369+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:43.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:43 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:43.369+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:43.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:43 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:43.369+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:43.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:43 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:43.369+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:43.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:43.275+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:43.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:43.275+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:43.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:43.275+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:43.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:43.275+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:43.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:43 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:43.531+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:43.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:43 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:43.531+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:43.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:43 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:43.531+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:43.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:43 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:43.531+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:43.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:43 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:43.531+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:44.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:43.887+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:44.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:43.887+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:44.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:43.887+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:44.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:43 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:43.887+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:44.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:44 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:44.367+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:44.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:44 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:44.367+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:44.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:44 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:44.367+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:44.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:44 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:44.367+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:44.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:44 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:44.367+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:44.717 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:44.297+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:44.717 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:44.297+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:44.717 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:44.297+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:44.717 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:44.297+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:44.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:44 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:44.510+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:45.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:44.901+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:45.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:44.901+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:45.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:44.901+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:45.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:44 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:44.901+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:45.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:45.350+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:45.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:45.350+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:45.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:45.350+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:45.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:45.350+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:45.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:45 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:45.350+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:45.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:45.286+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:45.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:45.286+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:45.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:45.286+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:45.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:45.286+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:45.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:45 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:45.508+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:46.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:45.912+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:46.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:45.912+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:46.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:45.912+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:46.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:45.912+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:46.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:46.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:46.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:46.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:46.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:46.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:46 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:46.321+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:46.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:46.285+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:46.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:46.285+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:46.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:46.285+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:46.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:46.285+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:46.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:46 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:46.519+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:47.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:46.868+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.931021+0000 front 2024-09-15T23:35:47.931136+0000 (oldest deadline 2024-09-15T23:36:12.531740+0000) 2024-09-15T23:36:47.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:46.868+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:53.632640+0000 front 2024-09-15T23:35:53.632710+0000 (oldest deadline 2024-09-15T23:36:19.532857+0000) 2024-09-15T23:36:47.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:46.868+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:04.134322+0000 front 2024-09-15T23:36:04.134304+0000 (oldest deadline 2024-09-15T23:36:28.834158+0000) 2024-09-15T23:36:47.215 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:46 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8[53852]: 2024-09-15T23:36:46.868+0000 7f4ddab5d640 -1 osd.8 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.035883+0000 front 2024-09-15T23:36:14.035930+0000 (oldest deadline 2024-09-15T23:36:36.335934+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:47.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:47 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:47.314+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:47.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:47.269+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:47.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:47.269+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:47.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:47.269+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:47.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:47.269+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:47.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:47 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:47.543+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:48.053 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:47 smithi159 podman[69133]: 2024-09-15 23:36:47.756250138 +0000 UTC m=+5.496028763 container died 8c25e13928d4cea684cb1951dd422b7a9272d91f2862d5193801008a7305d599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-15T23:36:48.304 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69133]: 2024-09-15 23:36:48.152026083 +0000 UTC m=+5.891804699 container cleanup 8c25e13928d4cea684cb1951dd422b7a9272d91f2862d5193801008a7305d599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-15T23:36:48.304 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 bash[69133]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:48.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:48 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:48.348+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:48.715 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69148]: 2024-09-15 23:36:48.411738102 +0000 UTC m=+0.658988149 container remove 8c25e13928d4cea684cb1951dd422b7a9272d91f2862d5193801008a7305d599 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T23:36:48.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:48 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:48.302+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:48.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:48 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:48.302+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:48.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:48 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:48.302+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:48.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:48 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:48.302+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:48.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:48.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:48.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:48.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:48.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:48.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:48 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:48.523+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:48.982 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69235]: 2024-09-15 23:36:48.62530976 +0000 UTC m=+0.016300826 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:48.982 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69235]: 2024-09-15 23:36:48.754140605 +0000 UTC m=+0.145131657 container create bed03efd1aca8d33b87b2173421b48d3a02a0ae6e1a4a7e28c56d220c83b4e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:36:48.982 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69235]: 2024-09-15 23:36:48.982031293 +0000 UTC m=+0.373022349 container init bed03efd1aca8d33b87b2173421b48d3a02a0ae6e1a4a7e28c56d220c83b4e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:36:49.261 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:48 smithi159 podman[69235]: 2024-09-15 23:36:48.985472657 +0000 UTC m=+0.376463711 container start bed03efd1aca8d33b87b2173421b48d3a02a0ae6e1a4a7e28c56d220c83b4e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-15T23:36:49.261 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:49 smithi159 podman[69235]: 2024-09-15 23:36:49.073737247 +0000 UTC m=+0.464728301 container attach bed03efd1aca8d33b87b2173421b48d3a02a0ae6e1a4a7e28c56d220c83b4e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:36:49.261 INFO:journalctl@ceph.osd.8.smithi159.stdout:Sep 15 23:36:49 smithi159 podman[69235]: 2024-09-15 23:36:49.170409135 +0000 UTC m=+0.561400201 container died bed03efd1aca8d33b87b2173421b48d3a02a0ae6e1a4a7e28c56d220c83b4e2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-8-deactivate, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-15T23:36:49.262 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:49.258+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:49.262 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:49.258+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:49.262 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:49.258+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:49.262 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:49.258+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:49.262 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:49 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:49.258+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:49.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:49.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:49.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:49.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:49.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:49.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:49.320+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:49.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.8.service' 2024-09-15T23:36:49.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:49.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:49.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:49.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:49.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:49.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:49 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:49.476+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:49.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:49.899 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-15T23:36:49.899 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-15T23:36:49.900 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.9 2024-09-15T23:36:50.214 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:49 smithi077 systemd[1]: Stopping Ceph osd.9 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.212+0000 7fb330940640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.212+0000 7fb330940640 -1 osd.9 95 *** Got signal Terminated *** 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.212+0000 7fb330940640 -1 osd.9 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:50.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:50.634 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:50 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:50.356+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:50.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:50 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:50.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:50.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:50 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:50.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:50.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:50 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:50.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:50.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:50 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:50.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:50.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:50 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:50.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:50.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:50 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:50.428+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:51.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:51 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:51.254+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:51.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:51 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:51.254+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:51.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:51 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:51.254+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:51.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:51 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:51.254+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:51.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:51 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:51.254+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:51.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:51 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:51.389+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:51.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:51 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:51.400+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:52.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:52 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:52.252+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:52.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:52 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:52.252+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:52.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:52 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:52.252+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:52.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:52 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:52.252+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:52.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:52 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:52.252+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:52.752 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:52.752 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:52.752 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:52.752 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:52.753 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:52.753 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:52 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:52.433+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:52.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:52 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:52.442+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:53.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:53 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:53.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:53.616 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:53.232+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:53.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:53 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:53.476+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:54.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:54.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:54.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:54.717 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:54.720 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:54.723 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:54 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:54.237+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:54.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:54.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:54.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:54.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:54.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:54.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:54 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:54.402+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:41.382826+0000 front 2024-09-15T23:35:41.382775+0000 (oldest deadline 2024-09-15T23:36:04.882877+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:47.085154+0000 front 2024-09-15T23:35:47.084833+0000 (oldest deadline 2024-09-15T23:36:12.384822+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:58.086574+0000 front 2024-09-15T23:35:58.086548+0000 (oldest deadline 2024-09-15T23:36:20.986626+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:06.287547+0000 front 2024-09-15T23:36:06.287600+0000 (oldest deadline 2024-09-15T23:36:28.587751+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:12.688952+0000 front 2024-09-15T23:36:12.689024+0000 (oldest deadline 2024-09-15T23:36:37.388817+0000) 2024-09-15T23:36:54.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:54 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9[65604]: 2024-09-15T23:36:54.475+0000 7fb32cf56640 -1 osd.9 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:21.390112+0000 front 2024-09-15T23:36:21.390287+0000 (oldest deadline 2024-09-15T23:36:45.489952+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:55.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:55 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:55.247+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.383+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.383+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.384+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.384+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.384+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:55.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:55 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:55.384+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:56.133 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:55 smithi077 podman[96110]: 2024-09-15 23:36:55.76932181 +0000 UTC m=+5.674152650 container died b771b7a25e252841f712c22e8347f6347bdc7dbeeac503f706ad054e37af6072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-15T23:36:56.506 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:56 smithi077 podman[96110]: 2024-09-15 23:36:56.345893949 +0000 UTC m=+6.250724789 container cleanup b771b7a25e252841f712c22e8347f6347bdc7dbeeac503f706ad054e37af6072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-15T23:36:56.506 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:56 smithi077 bash[96110]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:56.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:56 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:56.341+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:56.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:56.218+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:56.883 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:56 smithi077 podman[96125]: 2024-09-15 23:36:56.505394159 +0000 UTC m=+0.734315134 container remove b771b7a25e252841f712c22e8347f6347bdc7dbeeac503f706ad054e37af6072 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:36:57.176 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:56 smithi077 podman[96211]: 2024-09-15 23:36:56.819754825 +0000 UTC m=+0.015885737 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:36:57.176 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:56 smithi077 podman[96211]: 2024-09-15 23:36:56.93962672 +0000 UTC m=+0.135757664 container create d3b2aea92966d3f4050f021ef6dd127a886509d3c0f5d3c45b1cd70873cb38d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-15T23:36:57.176 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:57 smithi077 podman[96211]: 2024-09-15 23:36:57.175674625 +0000 UTC m=+0.371805524 container init d3b2aea92966d3f4050f021ef6dd127a886509d3c0f5d3c45b1cd70873cb38d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:57.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:57 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:57.208+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:57.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:57.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:57.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:57.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:57.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:57.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:57.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:57 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:57.340+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:36:57.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:57 smithi077 podman[96211]: 2024-09-15 23:36:57.179382786 +0000 UTC m=+0.375513686 container start d3b2aea92966d3f4050f021ef6dd127a886509d3c0f5d3c45b1cd70873cb38d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-15T23:36:57.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:57 smithi077 podman[96211]: 2024-09-15 23:36:57.259004795 +0000 UTC m=+0.455135707 container attach d3b2aea92966d3f4050f021ef6dd127a886509d3c0f5d3c45b1cd70873cb38d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:36:57.633 INFO:journalctl@ceph.osd.9.smithi077.stdout:Sep 15 23:36:57 smithi077 podman[96211]: 2024-09-15 23:36:57.362395231 +0000 UTC m=+0.558526141 container died d3b2aea92966d3f4050f021ef6dd127a886509d3c0f5d3c45b1cd70873cb38d9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:36:57.992 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.9.service' 2024-09-15T23:36:58.031 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:36:58.032 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-15T23:36:58.032 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-15T23:36:58.032 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.10 2024-09-15T23:36:58.319 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 systemd[1]: Stopping Ceph osd.10 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.318+0000 7f129b39f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.318+0000 7f129b39f640 -1 osd.10 95 *** Got signal Terminated *** 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.318+0000 7f129b39f640 -1 osd.10 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:58.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:58.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:58.615 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:58 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:58.349+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:36:58.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:58.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:58.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:58.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:58.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:58.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:58 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:58.256+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:36:59.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:36:59 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:36:59.231+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:36:59.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:36:59.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:36:59.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:36:59.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:36:59.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:36:59.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:36:59.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:36:59 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:36:59.391+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:00.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:00 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:00.280+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:00.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:37:00.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:37:00.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:37:00.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:37:00.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:37:00.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:37:00.865 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:00 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:00.409+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:01.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:01 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:01.273+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:37:01.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:01 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:01.446+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:02.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:02 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:02.307+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.008031+0000 front 2024-09-15T23:35:40.008083+0000 (oldest deadline 2024-09-15T23:36:03.508117+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:45.209249+0000 front 2024-09-15T23:35:45.209212+0000 (oldest deadline 2024-09-15T23:36:15.210187+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:55.210926+0000 front 2024-09-15T23:35:55.210715+0000 (oldest deadline 2024-09-15T23:36:21.110725+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6814 osd.3 since back 2024-09-15T23:36:05.211681+0000 front 2024-09-15T23:36:05.211829+0000 (oldest deadline 2024-09-15T23:36:28.711612+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:15.112939+0000 front 2024-09-15T23:36:15.112966+0000 (oldest deadline 2024-09-15T23:36:38.613051+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:18.613776+0000 front 2024-09-15T23:36:18.613790+0000 (oldest deadline 2024-09-15T23:36:44.414087+0000) 2024-09-15T23:37:02.864 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:02 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10[60473]: 2024-09-15T23:37:02.481+0000 7f12979b5640 -1 osd.10 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:30.815434+0000 front 2024-09-15T23:36:30.815402+0000 (oldest deadline 2024-09-15T23:36:56.115267+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:03.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:03 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:03.265+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:03.970 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:03 smithi155 podman[68979]: 2024-09-15 23:37:03.711936716 +0000 UTC m=+5.484257140 container died 6ec6dee72db1e5c9236e043c9a32976b94a8c9a391c7acac968fec00d16c5c41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T23:37:04.361 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[68979]: 2024-09-15 23:37:04.059214015 +0000 UTC m=+5.831534448 container cleanup 6ec6dee72db1e5c9236e043c9a32976b94a8c9a391c7acac968fec00d16c5c41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True) 2024-09-15T23:37:04.361 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 bash[68979]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10 2024-09-15T23:37:04.614 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[68993]: 2024-09-15 23:37:04.36051007 +0000 UTC m=+0.648722795 container remove 6ec6dee72db1e5c9236e043c9a32976b94a8c9a391c7acac968fec00d16c5c41 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:04.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:04 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:04.217+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:04.947 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[69083]: 2024-09-15 23:37:04.576160794 +0000 UTC m=+0.016339761 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:37:04.947 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[69083]: 2024-09-15 23:37:04.694572235 +0000 UTC m=+0.134751191 container create 5cd0ceea52c6dd895775ca6afad5fd6db4f50e482ee3fec6c8a4072671a7ea31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-8921c8e) 2024-09-15T23:37:04.948 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[69083]: 2024-09-15 23:37:04.947019298 +0000 UTC m=+0.387198253 container init 5cd0ceea52c6dd895775ca6afad5fd6db4f50e482ee3fec6c8a4072671a7ea31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-15T23:37:05.364 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:04 smithi155 podman[69083]: 2024-09-15 23:37:04.950567985 +0000 UTC m=+0.390746943 container start 5cd0ceea52c6dd895775ca6afad5fd6db4f50e482ee3fec6c8a4072671a7ea31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-15T23:37:05.364 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:05 smithi155 podman[69083]: 2024-09-15 23:37:05.030086111 +0000 UTC m=+0.470265067 container attach 5cd0ceea52c6dd895775ca6afad5fd6db4f50e482ee3fec6c8a4072671a7ea31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS) 2024-09-15T23:37:05.364 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 15 23:37:05 smithi155 podman[69083]: 2024-09-15 23:37:05.13623609 +0000 UTC m=+0.576415051 container died 5cd0ceea52c6dd895775ca6afad5fd6db4f50e482ee3fec6c8a4072671a7ea31 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-15T23:37:05.711 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.10.service' 2024-09-15T23:37:05.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:05.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:05.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:05.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:05.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:05.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:05.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:05.220+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:05.751 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:05.752 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-15T23:37:05.752 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-15T23:37:05.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.11 2024-09-15T23:37:06.072 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:05 smithi159 systemd[1]: Stopping Ceph osd.11 for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.071+0000 7ffbd3f25640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.071+0000 7ffbd3f25640 -1 osd.11 95 *** Got signal Terminated *** 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.071+0000 7ffbd3f25640 -1 osd.11 95 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:06.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:06.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:06 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:06.243+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:07.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:07 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:07.201+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:08.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:08 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:08.194+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:09.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:09.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:09.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:09.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:09.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:09.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:09.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:09 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:09.154+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:10.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6806 osd.0 since back 2024-09-15T23:35:40.047922+0000 front 2024-09-15T23:35:40.047883+0000 (oldest deadline 2024-09-15T23:36:04.748055+0000) 2024-09-15T23:37:10.465 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-15T23:35:50.649188+0000 front 2024-09-15T23:35:50.649050+0000 (oldest deadline 2024-09-15T23:36:12.849502+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6804 osd.2 since back 2024-09-15T23:35:56.250789+0000 front 2024-09-15T23:35:56.250812+0000 (oldest deadline 2024-09-15T23:36:19.750932+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-15T23:36:14.953627+0000 front 2024-09-15T23:36:14.953795+0000 (oldest deadline 2024-09-15T23:36:36.053656+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6812 osd.5 since back 2024-09-15T23:36:19.554469+0000 front 2024-09-15T23:36:19.554445+0000 (oldest deadline 2024-09-15T23:36:48.354935+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.77:6822 osd.6 since back 2024-09-15T23:36:28.355406+0000 front 2024-09-15T23:36:28.355483+0000 (oldest deadline 2024-09-15T23:36:53.055453+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-15T23:36:38.257096+0000 front 2024-09-15T23:36:38.257159+0000 (oldest deadline 2024-09-15T23:36:59.956959+0000) 2024-09-15T23:37:10.466 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:10 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11[60558]: 2024-09-15T23:37:10.152+0000 7ffbcc533640 -1 osd.11 95 heartbeat_check: no reply from 172.21.15.159:6820 osd.8 since back 2024-09-15T23:36:45.758260+0000 front 2024-09-15T23:36:45.758281+0000 (oldest deadline 2024-09-15T23:37:09.858275+0000) 2024-09-15T23:37:11.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:11 smithi159 podman[69349]: 2024-09-15 23:37:11.456075298 +0000 UTC m=+5.504925189 container died 084471086bf29c9c17eedb590b06f5af753b533960723731e491024003149875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:37:12.106 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:11 smithi159 podman[69349]: 2024-09-15 23:37:11.82937914 +0000 UTC m=+5.878229031 container cleanup 084471086bf29c9c17eedb590b06f5af753b533960723731e491024003149875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2) 2024-09-15T23:37:12.106 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:11 smithi159 bash[69349]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11 2024-09-15T23:37:12.451 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69366]: 2024-09-15 23:37:12.10560459 +0000 UTC m=+0.648483875 container remove 084471086bf29c9c17eedb590b06f5af753b533960723731e491024003149875 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-15T23:37:12.715 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.353611454 +0000 UTC m=+0.016001902 image pull f1455bd0219c0836c14d3880561c736ab957883ab2384892956003bb36edc4ee quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80 2024-09-15T23:37:12.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.464855492 +0000 UTC m=+0.127245986 container create 41436cd65117aa064d6d452e7b3030845793096911ed9bace26ada1831b41168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:37:12.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.692159205 +0000 UTC m=+0.354549667 container init 41436cd65117aa064d6d452e7b3030845793096911ed9bace26ada1831b41168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-15T23:37:12.716 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.695483982 +0000 UTC m=+0.357874435 container start 41436cd65117aa064d6d452e7b3030845793096911ed9bace26ada1831b41168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-15T23:37:13.170 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.800506521 +0000 UTC m=+0.462896970 container attach 41436cd65117aa064d6d452e7b3030845793096911ed9bace26ada1831b41168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-15T23:37:13.170 INFO:journalctl@ceph.osd.11.smithi159.stdout:Sep 15 23:37:12 smithi159 podman[69453]: 2024-09-15 23:37:12.881945223 +0000 UTC m=+0.544335672 container died 41436cd65117aa064d6d452e7b3030845793096911ed9bace26ada1831b41168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-15T23:37:13.469 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@osd.11.service' 2024-09-15T23:37:13.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:13.510 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-15T23:37:13.511 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-15T23:37:13.511 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.a 2024-09-15T23:37:13.883 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:13 smithi077 systemd[1]: Stopping Ceph mds.a for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:14.383 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a[72401]: 2024-09-15T23:37:13.888+0000 7f087998a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:14.383 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:13 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a[72401]: 2024-09-15T23:37:13.888+0000 7f087998a640 -1 mds.a *** got signal Terminated *** 2024-09-15T23:37:18.206 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:17 smithi077 podman[96325]: 2024-09-15 23:37:17.901343483 +0000 UTC m=+4.191577691 container died 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-15T23:37:18.565 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:18 smithi077 podman[96325]: 2024-09-15 23:37:18.338741116 +0000 UTC m=+4.628975311 container cleanup 8af6fdb0fd0601f0171248d965835dcada966a0c4c69dccfc8daa83a7bb95443 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD) 2024-09-15T23:37:18.565 INFO:journalctl@ceph.mds.a.smithi077.stdout:Sep 15 23:37:18 smithi077 bash[96325]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-a 2024-09-15T23:37:18.712 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.a.service' 2024-09-15T23:37:18.746 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:18.746 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-15T23:37:18.746 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-15T23:37:18.747 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.d 2024-09-15T23:37:19.118 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:18 smithi077 systemd[1]: Stopping Ceph mds.d for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:19.383 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:19 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d[71176]: 2024-09-15T23:37:19.117+0000 7fbc1a85f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:19.383 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:19 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d[71176]: 2024-09-15T23:37:19.117+0000 7fbc1a85f640 -1 mds.d *** got signal Terminated *** 2024-09-15T23:37:23.118 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:22 smithi077 podman[96445]: 2024-09-15 23:37:22.702891621 +0000 UTC m=+3.736122298 container died 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:37:23.118 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:23 smithi077 podman[96445]: 2024-09-15 23:37:23.117598652 +0000 UTC m=+4.150829371 container cleanup 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-8921c8e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-15T23:37:23.383 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:23 smithi077 bash[96445]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d 2024-09-15T23:37:23.383 INFO:journalctl@ceph.mds.d.smithi077.stdout:Sep 15 23:37:23 smithi077 podman[96457]: 2024-09-15 23:37:23.327244318 +0000 UTC m=+0.622324671 container remove 615a18e09a346dd960293cd9968cb90d2cf94074e43a20c4d05bbcffc3b2a1e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:37:23.549 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.d.service' 2024-09-15T23:37:23.583 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:23.583 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-15T23:37:23.583 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-15T23:37:23.583 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.g 2024-09-15T23:37:23.883 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:23 smithi077 systemd[1]: Stopping Ceph mds.g for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:24.383 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g[72053]: 2024-09-15T23:37:23.920+0000 7feb15dce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:24.383 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:23 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g[72053]: 2024-09-15T23:37:23.920+0000 7feb15dce640 -1 mds.g *** got signal Terminated *** 2024-09-15T23:37:27.864 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:27 smithi077 podman[96566]: 2024-09-15 23:37:27.547934789 +0000 UTC m=+3.748053353 container died 3f3bf29ec5f74d6e5c0997a92229b5b708982e8132934be0c6ce62f8e549467c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:37:28.133 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:28 smithi077 podman[96566]: 2024-09-15 23:37:28.088219754 +0000 UTC m=+4.288338307 container cleanup 3f3bf29ec5f74d6e5c0997a92229b5b708982e8132934be0c6ce62f8e549467c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-15T23:37:28.133 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:28 smithi077 bash[96566]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g 2024-09-15T23:37:28.496 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.g.service' 2024-09-15T23:37:28.518 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:28 smithi077 podman[96580]: 2024-09-15 23:37:28.264710409 +0000 UTC m=+0.714867085 container remove 3f3bf29ec5f74d6e5c0997a92229b5b708982e8132934be0c6ce62f8e549467c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-15T23:37:28.518 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:28 smithi077 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-15T23:37:28.518 INFO:journalctl@ceph.mds.g.smithi077.stdout:Sep 15 23:37:28 smithi077 systemd[1]: Stopped Ceph mds.g for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:37:28.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:28.530 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-15T23:37:28.530 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-15T23:37:28.530 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.j 2024-09-15T23:37:28.843 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:28 smithi077 systemd[1]: Stopping Ceph mds.j for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:29.133 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j[70750]: 2024-09-15T23:37:28.841+0000 7fd53abd4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:29.133 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:28 smithi077 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j[70750]: 2024-09-15T23:37:28.841+0000 7fd53abd4640 -1 mds.j *** got signal Terminated *** 2024-09-15T23:37:31.368 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 podman[96686]: 2024-09-15 23:37:31.099896801 +0000 UTC m=+2.347832936 container died 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-15T23:37:31.633 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 podman[96686]: 2024-09-15 23:37:31.550431433 +0000 UTC m=+2.798367569 container cleanup 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0) 2024-09-15T23:37:31.633 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 bash[96686]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j 2024-09-15T23:37:31.973 DEBUG:teuthology.orchestra.run.smithi077:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.j.service' 2024-09-15T23:37:31.994 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 podman[96698]: 2024-09-15 23:37:31.735148574 +0000 UTC m=+0.624395579 container remove 78bd4c296a84d6217f62333015f54e97eaf137c86c0501d19a2f549e87733e30 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-j, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:37:31.994 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.j.service: Deactivated successfully. 2024-09-15T23:37:31.994 INFO:journalctl@ceph.mds.j.smithi077.stdout:Sep 15 23:37:31 smithi077 systemd[1]: Stopped Ceph mds.j for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:37:32.005 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:32.005 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-15T23:37:32.005 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-15T23:37:32.005 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.b 2024-09-15T23:37:35.285 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 15 23:37:34 smithi155 podman[69183]: 2024-09-15 23:37:34.993946977 +0000 UTC m=+2.795054091 container died f12973b6cc49488990f6c136b5fcbb7e253026248096dec3003bad705ab8baa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-b, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e) 2024-09-15T23:37:35.614 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 15 23:37:35 smithi155 podman[69183]: 2024-09-15 23:37:35.374935974 +0000 UTC m=+3.176043087 container cleanup f12973b6cc49488990f6c136b5fcbb7e253026248096dec3003bad705ab8baa2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-b, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-15T23:37:35.614 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 15 23:37:35 smithi155 bash[69183]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-b 2024-09-15T23:37:35.759 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.b.service' 2024-09-15T23:37:35.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:35.795 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-15T23:37:35.795 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-15T23:37:35.796 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.e 2024-09-15T23:37:36.364 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:35 smithi155 systemd[1]: Stopping Ceph mds.e for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:36.364 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-e[65065]: 2024-09-15T23:37:36.104+0000 7f142796f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:36.364 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:36 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-e[65065]: 2024-09-15T23:37:36.104+0000 7f142796f640 -1 mds.e *** got signal Terminated *** 2024-09-15T23:37:37.696 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:37 smithi155 podman[69316]: 2024-09-15 23:37:37.383429363 +0000 UTC m=+1.372140625 container died 2dc79a9abda891d3902eb49b8cb6a479fbabe314d30440fe9648c4eb1de01f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True) 2024-09-15T23:37:37.997 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:37 smithi155 podman[69316]: 2024-09-15 23:37:37.795522018 +0000 UTC m=+1.784233279 container cleanup 2dc79a9abda891d3902eb49b8cb6a479fbabe314d30440fe9648c4eb1de01f9d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-8921c8e, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T23:37:37.997 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 15 23:37:37 smithi155 bash[69316]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-e 2024-09-15T23:37:38.123 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.e.service' 2024-09-15T23:37:38.157 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:38.157 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-15T23:37:38.158 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-15T23:37:38.158 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.h 2024-09-15T23:37:38.363 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:38 smithi155 systemd[1]: Stopping Ceph mds.h for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:38.863 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h[65366]: 2024-09-15T23:37:38.482+0000 7f0e4d716640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:38.864 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:38 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h[65366]: 2024-09-15T23:37:38.482+0000 7f0e4d716640 -1 mds.h *** got signal Terminated *** 2024-09-15T23:37:41.675 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:41 smithi155 podman[69436]: 2024-09-15 23:37:41.388957034 +0000 UTC m=+3.011340956 container died 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-15T23:37:42.000 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:41 smithi155 podman[69436]: 2024-09-15 23:37:41.749026307 +0000 UTC m=+3.371410272 container cleanup 826bfcd2ac345e28f0f258462942f56fe40f4555841642624eef8ebd0a7d51b1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h, org.label-schema.build-date=20240731, RELEASE=squid-8921c8e, org.label-schema.license=GPLv2, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-15T23:37:42.000 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 15 23:37:41 smithi155 bash[69436]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-h 2024-09-15T23:37:42.176 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.h.service' 2024-09-15T23:37:42.207 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:42.208 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-15T23:37:42.208 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-15T23:37:42.208 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.k 2024-09-15T23:37:42.520 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:42 smithi155 systemd[1]: Stopping Ceph mds.k for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:42.864 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k[64745]: 2024-09-15T23:37:42.519+0000 7f185a3c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:42.864 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:42 smithi155 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k[64745]: 2024-09-15T23:37:42.519+0000 7f185a3c2640 -1 mds.k *** got signal Terminated *** 2024-09-15T23:37:44.654 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:44 smithi155 podman[69553]: 2024-09-15 23:37:44.379985505 +0000 UTC m=+1.957558469 container died 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k, org.label-schema.vendor=CentOS, RELEASE=squid-8921c8e, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-15T23:37:45.012 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:44 smithi155 podman[69553]: 2024-09-15 23:37:44.761399769 +0000 UTC m=+2.338972729 container cleanup 89b973726bbbd3af3efbe5cd21748c8b6c5325c111953180fe94b83254faa3a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-15T23:37:45.013 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 15 23:37:44 smithi155 bash[69553]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-k 2024-09-15T23:37:45.179 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.k.service' 2024-09-15T23:37:45.211 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:45.212 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-15T23:37:45.212 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-15T23:37:45.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.c 2024-09-15T23:37:45.521 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:45 smithi159 systemd[1]: Stopping Ceph mds.c for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:45.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c[65708]: 2024-09-15T23:37:45.519+0000 7f48f501f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:45.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:45 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c[65708]: 2024-09-15T23:37:45.519+0000 7f48f501f640 -1 mds.c *** got signal Terminated *** 2024-09-15T23:37:46.965 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:46 smithi159 podman[69556]: 2024-09-15 23:37:46.639393545 +0000 UTC m=+1.216723359 container died 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-15T23:37:47.465 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:47 smithi159 podman[69556]: 2024-09-15 23:37:47.211229773 +0000 UTC m=+1.788559586 container cleanup 850bdef748368edcc793eb3f39143f6a2cb3bf01c24017b1a59ca5669244a579 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-8921c8e, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-15T23:37:47.465 INFO:journalctl@ceph.mds.c.smithi159.stdout:Sep 15 23:37:47 smithi159 bash[69556]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-c 2024-09-15T23:37:47.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.c.service' 2024-09-15T23:37:47.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:47.672 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-15T23:37:47.673 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-15T23:37:47.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.f 2024-09-15T23:37:48.215 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:47 smithi159 systemd[1]: Stopping Ceph mds.f for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:48.215 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-f[65409]: 2024-09-15T23:37:47.990+0000 7f82b8b7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:48.215 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:47 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-f[65409]: 2024-09-15T23:37:47.990+0000 7f82b8b7d640 -1 mds.f *** got signal Terminated *** 2024-09-15T23:37:52.274 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:52 smithi159 podman[69686]: 2024-09-15 23:37:52.001220249 +0000 UTC m=+4.108183170 container died 92cb175125b2caa731dfb13b3edc09538abb5e377dd1a28a6b19417be9c627e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-15T23:37:52.633 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:52 smithi159 podman[69686]: 2024-09-15 23:37:52.390137432 +0000 UTC m=+4.497100356 container cleanup 92cb175125b2caa731dfb13b3edc09538abb5e377dd1a28a6b19417be9c627e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-f, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-15T23:37:52.633 INFO:journalctl@ceph.mds.f.smithi159.stdout:Sep 15 23:37:52 smithi159 bash[69686]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-f 2024-09-15T23:37:52.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.f.service' 2024-09-15T23:37:52.802 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:52.803 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-15T23:37:52.803 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-15T23:37:52.803 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.i 2024-09-15T23:37:53.215 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:52 smithi159 systemd[1]: Stopping Ceph mds.i for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:53.215 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: 2024-09-15T23:37:53.127+0000 7fed402b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:53.215 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:53 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i[66008]: 2024-09-15T23:37:53.127+0000 7fed402b6640 -1 mds.i *** got signal Terminated *** 2024-09-15T23:37:55.328 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 podman[69806]: 2024-09-15 23:37:55.000652215 +0000 UTC m=+1.976842114 container died f24a60fcc394ed25ff29d00e613fd0afa6500aaae12438552ea7f5a1bad5962b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-8921c8e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-15T23:37:55.637 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 podman[69806]: 2024-09-15 23:37:55.410611792 +0000 UTC m=+2.386801723 container cleanup f24a60fcc394ed25ff29d00e613fd0afa6500aaae12438552ea7f5a1bad5962b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-8921c8e, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-15T23:37:55.637 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 bash[69806]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i 2024-09-15T23:37:55.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.i.service' 2024-09-15T23:37:55.906 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 podman[69820]: 2024-09-15 23:37:55.636716174 +0000 UTC m=+0.637942297 container remove f24a60fcc394ed25ff29d00e613fd0afa6500aaae12438552ea7f5a1bad5962b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-8921c8e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:37:55.906 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-15T23:37:55.906 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 systemd[1]: Stopped Ceph mds.i for 1be60238-73b9-11ef-bceb-c7b262605968. 2024-09-15T23:37:55.906 INFO:journalctl@ceph.mds.i.smithi159.stdout:Sep 15 23:37:55 smithi159 systemd[1]: ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.i.service: Consumed 8.366s CPU time. 2024-09-15T23:37:55.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:55.917 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-15T23:37:55.917 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-15T23:37:55.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.l 2024-09-15T23:37:56.215 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:55 smithi159 systemd[1]: Stopping Ceph mds.l for 1be60238-73b9-11ef-bceb-c7b262605968... 2024-09-15T23:37:56.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l[65107]: 2024-09-15T23:37:56.239+0000 7f207af19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-15T23:37:56.575 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:56 smithi159 ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l[65107]: 2024-09-15T23:37:56.239+0000 7f207af19640 -1 mds.l *** got signal Terminated *** 2024-09-15T23:37:57.908 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:57 smithi159 podman[69927]: 2024-09-15 23:37:57.628866147 +0000 UTC m=+1.492023938 container died 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-15T23:37:58.215 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:57 smithi159 podman[69927]: 2024-09-15 23:37:57.989281549 +0000 UTC m=+1.852439339 container cleanup 5b4eaeabb22734671e83369bc25b79da84c9d74e5d2bfe6ccdd195d820ece911 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6b5c73953776cdbbe2c2650e2c9813ab5ac3fdead855fa68a3941507184c3a80, name=ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-8921c8e, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=009c5a8162e3d9e92e49bb850b92bd3cd406d965) 2024-09-15T23:37:58.215 INFO:journalctl@ceph.mds.l.smithi159.stdout:Sep 15 23:37:57 smithi159 bash[69927]: ceph-1be60238-73b9-11ef-bceb-c7b262605968-mds-l 2024-09-15T23:37:58.408 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1be60238-73b9-11ef-bceb-c7b262605968@mds.l.service' 2024-09-15T23:37:58.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-15T23:37:58.441 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-15T23:37:58.441 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:37:58.651 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:01.125 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:38:01.326 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:03.748 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-15T23:38:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:06.400 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:38:06.434 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:38:06.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-15T23:38:06.491 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-15T23:38:06.493 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi077/crash 2024-09-15T23:38:06.494 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:38:06.529 INFO:teuthology.orchestra.run.smithi077.stderr:tar: /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:38:06.530 INFO:teuthology.orchestra.run.smithi077.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:38:06.532 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi155/crash 2024-09-15T23:38:06.533 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:38:06.591 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:38:06.591 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:38:06.593 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi159/crash 2024-09-15T23:38:06.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash -- . 2024-09-15T23:38:06.643 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/1be60238-73b9-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-15T23:38:06.643 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-09-15T23:38:06.644 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-15T23:38:06.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-15T23:38:06.688 INFO:tasks.cephadm:Compressing logs... 2024-09-15T23:38:06.688 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:38:06.731 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:38:06.733 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T23:38:06.756 INFO:teuthology.orchestra.run.smithi077.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-15T23:38:06.756 INFO:teuthology.orchestra.run.smithi077.stderr:: No such file or directory 2024-09-15T23:38:06.756 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-15T23:38:06.759 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-15T23:38:06.759 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2024-09-15T23:38:06.759 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-15T23:38:06.759 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-15T23:38:06.760 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:38:06.760 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-15T23:38:06.760 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-15T23:38:06.760 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr: 83.0% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log.gz/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.a.log: 2024-09-15T23:38:06.762 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-15T23:38:06.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:38:06.763 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.6.log: 90.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:38:06.763 INFO:teuthology.orchestra.run.smithi077.stderr: 94.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-15T23:38:06.765 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:38:06.765 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:38:06.765 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log: 94.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-15T23:38:06.765 INFO:teuthology.orchestra.run.smithi155.stderr: 90.4% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:38:06.765 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-15T23:38:06.766 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:38:06.766 INFO:teuthology.orchestra.run.smithi155.stderr: 83.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:38:06.770 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.y.log: 92.3% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-15T23:38:06.770 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr: 94.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.x.log: 86.6% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:38:06.775 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-15T23:38:06.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.j.log: 94.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-15T23:38:06.776 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:38:06.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.3.log: 94.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-15T23:38:06.776 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/cephadm.log: 90.9% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:38:06.776 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.h.log: 86.5% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr: 90.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.e.log: 94.6% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr: 94.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-15T23:38:06.777 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/cephadm.log: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:38:06.780 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-15T23:38:06.780 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-09-15T23:38:06.780 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-15T23:38:06.780 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-15T23:38:06.780 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr: 83.1% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr: 90.4% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.5% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-15T23:38:06.781 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.8.log: 94.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.z.log: 92.4% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.c.log: 90.9% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.f.log: 94.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/cephadm.log: 94.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi159.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:38:06.782 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-15T23:38:06.911 INFO:teuthology.orchestra.run.smithi077.stderr: 90.0% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-15T23:38:06.962 INFO:teuthology.orchestra.run.smithi159.stderr: 91.8% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-15T23:38:06.966 INFO:teuthology.orchestra.run.smithi155.stderr: 91.9% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-15T23:38:06.996 INFO:teuthology.orchestra.run.smithi155.stderr: 96.5% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-15T23:38:07.383 INFO:teuthology.orchestra.run.smithi077.stderr: 90.6% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-15T23:38:08.261 INFO:teuthology.orchestra.run.smithi159.stderr: 95.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-15T23:38:10.091 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-15T23:38:10.826 INFO:teuthology.orchestra.run.smithi159.stderr: 93.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-15T23:38:11.428 INFO:teuthology.orchestra.run.smithi159.stderr: 93.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-15T23:38:11.604 INFO:teuthology.orchestra.run.smithi077.stderr: 93.3% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-15T23:38:11.876 INFO:teuthology.orchestra.run.smithi155.stderr: 93.0% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-15T23:38:12.217 INFO:teuthology.orchestra.run.smithi159.stderr: 92.7% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-15T23:38:12.548 INFO:teuthology.orchestra.run.smithi077.stderr: 93.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-15T23:38:12.712 INFO:teuthology.orchestra.run.smithi155.stderr: 93.1% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-15T23:38:12.724 INFO:teuthology.orchestra.run.smithi077.stderr: 93.2% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-15T23:38:13.085 INFO:teuthology.orchestra.run.smithi155.stderr: 93.0% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-15T23:38:13.086 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-15T23:38:13.087 INFO:teuthology.orchestra.run.smithi155.stderr:real 0m6.341s 2024-09-15T23:38:13.087 INFO:teuthology.orchestra.run.smithi155.stderr:user 0m20.463s 2024-09-15T23:38:13.087 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m0.731s 2024-09-15T23:38:13.450 INFO:teuthology.orchestra.run.smithi077.stderr: 93.0% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-15T23:38:13.452 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-15T23:38:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m6.707s 2024-09-15T23:38:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m23.062s 2024-09-15T23:38:13.452 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m0.881s 2024-09-15T23:38:14.804 INFO:teuthology.orchestra.run.smithi159.stderr: 92.9% -- replaced with /var/log/ceph/1be60238-73b9-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-15T23:38:14.806 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-15T23:38:14.806 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m8.058s 2024-09-15T23:38:14.806 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m23.146s 2024-09-15T23:38:14.806 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m0.809s 2024-09-15T23:38:14.807 INFO:tasks.cephadm:Archiving logs... 2024-09-15T23:38:14.807 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi077/log 2024-09-15T23:38:14.808 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:38:18.435 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi155/log 2024-09-15T23:38:18.436 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:38:21.793 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi159/log 2024-09-15T23:38:21.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T23:38:25.263 INFO:tasks.cephadm:Removing cluster... 2024-09-15T23:38:25.263 DEBUG:teuthology.orchestra.run.smithi077:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force 2024-09-15T23:38:25.464 INFO:teuthology.orchestra.run.smithi077.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:25.751 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force 2024-09-15T23:38:25.955 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:26.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1be60238-73b9-11ef-bceb-c7b262605968 --force 2024-09-15T23:38:26.630 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 1be60238-73b9-11ef-bceb-c7b262605968 2024-09-15T23:38:26.915 INFO:tasks.cephadm:Removing cephadm ... 2024-09-15T23:38:26.915 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:38:26.935 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:38:26.953 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-15T23:38:26.968 INFO:tasks.cephadm:Teardown complete 2024-09-15T23:38:26.968 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T23:38:26.980 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T23:38:26.980 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:38:26.982 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:38:26.996 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T23:38:27.106 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T23:38:27.117 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T23:38:27.117 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:38:27.120 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:38:27.122 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T23:38:27.134 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:38:27.135 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:38:27.136 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-09-15T23:38:27.140 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:38:27.141 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-15T23:38:27.141 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 9 +449us[ +441us] +/- 52ms 2024-09-15T23:38:27.141 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 4 -1340us[-1340us] +/- 79ms 2024-09-15T23:38:27.141 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 +656us[ +656us] +/- 89ms 2024-09-15T23:38:27.141 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:38:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:38:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-15T23:38:27.144 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +463us[ +440us] +/- 52ms 2024-09-15T23:38:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -1329us[-1329us] +/- 79ms 2024-09-15T23:38:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 +658us[ +658us] +/- 89ms 2024-09-15T23:38:27.145 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +495us[ +490us] +/- 52ms 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 4 -1267us[-1267us] +/- 79ms 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 72 +700us[ +685us] +/- 88ms 2024-09-15T23:38:27.146 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-15T23:38:27.146 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T23:38:27.157 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T23:38:27.158 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T23:38:27.186 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:38:27.269 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:38:27.337 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-15T23:38:27.404 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:38:27.435 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:27.435 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:38:27.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:27.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-15T23:38:27.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:27.494 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T23:38:27.505 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T23:38:27.543 INFO:teuthology.task.internal:Duration was 1417.530483 seconds 2024-09-15T23:38:27.544 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T23:38:27.578 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T23:38:27.578 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:38:27.581 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:38:27.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T23:38:27.620 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:38:27.621 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:38:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-15T23:38:28.005 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T23:38:28.005 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-15T23:38:28.005 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:38:28.027 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-15T23:38:28.027 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:38:28.056 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-15T23:38:28.057 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T23:38:28.080 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T23:38:28.080 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:38:28.082 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:38:28.099 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T23:38:28.146 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T23:38:28.146 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:38:28.150 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:38:28.167 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T23:38:28.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T23:38:28.859 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T23:38:28.859 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:38:28.884 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:38:28.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T23:38:28.939 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T23:38:28.950 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:28.953 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:28.955 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:28.973 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-15T23:38:28.980 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-15T23:38:29.005 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-15T23:38:29.026 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:29.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:29.046 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:29.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:29.062 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T23:38:29.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T23:38:29.082 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T23:38:29.100 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T23:38:29.101 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi077 2024-09-15T23:38:29.101 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:38:29.155 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi155 2024-09-15T23:38:29.155 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:38:29.195 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906315/remote/smithi159 2024-09-15T23:38:29.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T23:38:29.232 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T23:38:29.232 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:38:29.234 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:38:29.237 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T23:38:29.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T23:38:29.296 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T23:38:29.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T23:38:29.333 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T23:38:29.333 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:38:29.336 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:38:29.338 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T23:38:29.348 INFO:teuthology.orchestra.run.smithi077.stdout: 265644 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:38 /home/ubuntu/cephtest 2024-09-15T23:38:29.351 INFO:teuthology.orchestra.run.smithi155.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:38 /home/ubuntu/cephtest 2024-09-15T23:38:29.353 INFO:teuthology.orchestra.run.smithi159.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 23:38 /home/ubuntu/cephtest 2024-09-15T23:38:29.354 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T23:38:29.368 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T23:38:29.517 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/1 standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/suites/iozone}} duration: 1417.5304834842682 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T23:38:29.517 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T23:38:29.606 INFO:teuthology.run:pass